Jul 07 14:22:20.544800 ip-10-0-139-48 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 14:22:20.544813 ip-10-0-139-48 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 14:22:20.544823 ip-10-0-139-48 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 14:22:20.545434 ip-10-0-139-48 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 14:22:30.675866 ip-10-0-139-48 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 14:22:30.675885 ip-10-0-139-48 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 49c6b4f5c6934065b4a05db6b298fa70 --
Jul 07 14:24:04.650935 ip-10-0-139-48 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 14:24:05.117728 ip-10-0-139-48 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 14:24:05.117728 ip-10-0-139-48 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 14:24:05.117728 ip-10-0-139-48 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 14:24:05.117728 ip-10-0-139-48 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 14:24:05.117728 ip-10-0-139-48 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 14:24:05.118842 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.118758    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 14:24:05.125668 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125650    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:24:05.125668 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125667    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125673    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125678    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125682    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125684    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125687    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125690    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125693    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125696    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125698    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125701    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125703    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125706    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125708    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125711    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125713    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125716    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125718    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125720    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:24:05.125735 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125723    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125727    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125731    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125735    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125738    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125741    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125744    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125750    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125753    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125756    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125758    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125761    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125763    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125766    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125768    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125771    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125773    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125776    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125778    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125781    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:24:05.126181 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125783    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125785    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125788    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125790    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125793    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125795    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125797    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125801    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125803    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125806    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125808    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125811    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125813    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125815    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125819    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125822    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125824    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125833    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125836    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125838    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:24:05.126683 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125841    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125849    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125852    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125855    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125857    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125862    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125865    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125868    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125871    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125873    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125876    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125878    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125880    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125883    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125885    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125888    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125890    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125892    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125895    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:24:05.127314 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125897    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125899    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125902    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125904    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125907    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125909    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125912    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125915    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125918    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125920    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125923    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125926    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125929    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125931    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125934    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125936    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125938    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125941    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125943    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:24:05.127797 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.125946    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126685    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126693    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126696    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126700    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126702    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126706    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126708    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126711    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126714    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126716    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126719    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126721    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126724    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126726    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126729    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126731    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126734    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126736    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126739    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:24:05.128252 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126745    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126748    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126750    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126753    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126755    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126758    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126761    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126763    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126766    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126768    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126771    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126773    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126776    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126778    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126780    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126784    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126787    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126790    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126793    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126795    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:24:05.128757 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126798    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126800    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126802    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126805    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126807    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126810    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126812    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126815    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126818    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126821    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126824    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126826    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126830    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126832    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126835    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126838    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126841    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126844    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126847    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126850    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:24:05.129247 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126852    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126855    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126857    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126859    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126862    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126864    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126867    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126869    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126871    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126874    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126878    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126881    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126884    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126886    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126889    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126891    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126894    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126897    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126900    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:24:05.129765 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126902    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126906    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126909    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126912    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126915    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126919    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126922    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126925    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126928    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126931    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126934    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126936    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126940    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126942    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126945    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126948    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126950    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126953    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126956    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:24:05.130216 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126958    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.126961    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127329    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127334    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127338    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127340    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127343    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127346    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127348    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127351    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127354    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127356    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127359    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127362    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127364    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127367    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127369    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127372    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127376    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:24:05.130696 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127379    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127382    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127384    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127387    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127389    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127392    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127395    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127397    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127400    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127402    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127405    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127407    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127410    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127412    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127415    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127417    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127420    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127422    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127424    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127427    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:24:05.131148 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127429    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127432    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127434    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127437    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127439    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127442    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127444    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127446    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127449    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127451    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127454    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127458    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127460    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127463    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127466    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127468    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127471    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127473    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127475    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127478    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:24:05.131628 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127480    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127483    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127485    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127488    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127492    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127496    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127498    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127501    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127504    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127506    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127509    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127511    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127514    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127516    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127519    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127521    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127524    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127527    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127530    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:24:05.132144 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127534    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127538    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127541    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127543    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127548    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127551    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127554    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127557    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127560    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127562    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127565    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127567    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127570    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127573    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127575    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127578    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127580    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127583    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127599    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127602    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:24:05.132608 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127605    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127607    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.127610    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127676    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127684    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127690    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127694    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127698    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127703    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127714    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127719    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127722    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127725    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127729    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127732    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127735    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127739    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127742    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127744    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127747    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127750    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127755    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127758    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127761    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 14:24:05.133108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127764    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127767    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127771    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127774    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127777    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127780    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127783    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127786    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127789    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127792    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127795    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127799    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127802    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127805    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127807    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127810    2567 flags.go:64] FLAG: --enable-server="true"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127814    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127819    2567 flags.go:64] FLAG: --event-burst="100"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127822    2567 flags.go:64] FLAG: --event-qps="50"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127825    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127828    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127830    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127834    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127837    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127841    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 14:24:05.133700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127843    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127846    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127849    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127851    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127854    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127857    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127860    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127863    2567 flags.go:64] FLAG: --feature-gates=""
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127866    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127870    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127873    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127876    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127879    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127882    2567 flags.go:64] FLAG: --help="false"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127885    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127888    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127891    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127894    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127897    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127900    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127903    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127906    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127908    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 14:24:05.134290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127912    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127915    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127918    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127921    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127924    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127926    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127929    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127932    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127935    2567 flags.go:64] FLAG: --lock-file=""
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127938    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127940    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127944    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127949    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127951    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127954    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127957    2567 flags.go:64] FLAG: --logging-format="text"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127959    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127963    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127965    2567 flags.go:64] FLAG: --manifest-url=""
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127968    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127973    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127976    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127980    2567 flags.go:64] FLAG: --max-pods="110"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127983    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127986    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 14:24:05.134872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127988    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127991    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127994    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127996    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.127999    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128006    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128009    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128013    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128016    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128018    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128024    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128026    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128029    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128032    2567 flags.go:64] FLAG: --port="10250"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128035    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128039    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05732935429058037"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128042    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128045    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128048    2567 flags.go:64] FLAG: --register-node="true"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128050    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128054    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128056    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128059    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128062    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128066    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 14:24:05.135533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128069    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128072    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128074    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128077    2567 flags.go:64] FLAG: --runonce="false"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128080    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128083    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128086    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128089    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128091    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128094    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128097    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128100    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128103    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128105    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128108    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128112    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128115    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128117    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128120    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128125    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128128    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128130    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128135    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128138    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128141    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 14:24:05.136176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128144    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128146    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128149    2567 flags.go:64] FLAG: --v="2"
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128153    2567 flags.go:64] FLAG: --version="false"
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128159    2567 flags.go:64] FLAG: --vmodule=""
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128163    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.128166    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128281    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128285    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128288    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128291    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128295    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128299    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128301    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128304    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128307    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128310    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128313    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128316    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128319    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128322    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:24:05.136800 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128325    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128329    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128331    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128334    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128338    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128341    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128344    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128347    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128351    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128354    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128356    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128359    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128361    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128364    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128366    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128369    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128371    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128374    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128376    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128379    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:24:05.137306 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128382    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128384    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128387    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128390    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128392    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128395    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128397    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128400    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128402    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128405    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128407    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128409    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128412    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128415    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128418    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128420    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128423    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128425    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128428    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:24:05.137801 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128430    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128435    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128439    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128442    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128444    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128447    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128449    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128452    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128454    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128457    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128459    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128462    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128465    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128467    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128470    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128472    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128475    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128477    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128480    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128482    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:24:05.138264 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128485    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128487    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128490    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128492    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128494    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128497    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128500    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128503    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128505    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128508    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128510    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128513    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128516    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128519    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128522    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128524    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128527    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128529    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128532    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128534    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:24:05.138760 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128537    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:24:05.139485 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128539    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:24:05.139485 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128542    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:24:05.139485 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128544    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:24:05.139485 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128547    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:24:05.139485 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.128549    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:24:05.139485 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.129523    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 14:24:05.139485 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.136626    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 14:24:05.139485 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.136641    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 14:24:05.139485 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.136660    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 14:24:05.139485 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.136667    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 14:24:05.139485 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136721    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:24:05.139485 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136728    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:24:05.139485 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136731    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:24:05.139485 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136735    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136738    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136740    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136743    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136746    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136748    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136751    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136754    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136756    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136759    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136761    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136764    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136766    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136769    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136771    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136774    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136777    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136779    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136781    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:24:05.140074 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136784    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136787    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136789    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136791    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136794    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136798    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136802    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136807    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136811    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136813    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136816    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136819    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136821    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136824    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136826    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136829    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136831    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136833    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136836    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:24:05.140631 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136839    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136842    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136844    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136847    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136850    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136853    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136855    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136858    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136861    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136863    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136866    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136868    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136871    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136873    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136876    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136878    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136881    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136883    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136886    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136889    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:24:05.141102 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136892    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136895    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136897    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136899    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136902    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136904    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136907    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136909    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136912    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136914    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136917    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136919    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136922    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136925    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136927    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136930    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136932    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136935    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136937    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136940    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:24:05.141650 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136942    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136945    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136949    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136952    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136955    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136958    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136960    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136963    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136965    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136968    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136971    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136973    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136976    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136978    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136981    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136984    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136986    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:24:05.142132 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.136989    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:24:05.142536 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.136994    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 14:24:05.142536 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137107    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 14:24:05.142536 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137111    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 14:24:05.142536 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137113    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 14:24:05.142536 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137116    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 14:24:05.142536 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137119    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 14:24:05.142536 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137121    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 14:24:05.142536 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137124    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 14:24:05.142536 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137126    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 14:24:05.142536 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137129    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 14:24:05.142536 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137131    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 14:24:05.142536 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137134    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 14:24:05.142536 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137137    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 14:24:05.142536 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137139    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 14:24:05.142536 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137142    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137144    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137147    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137149    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137151    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137154    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137156    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137159    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137161    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137163    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137166    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137168    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137170    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137173    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137175    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137178    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137180    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137183    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137186    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137190    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 14:24:05.142925 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137192    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137195    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137197    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137199    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137202    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137205    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137207    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137210    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137213    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137217    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137220    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137223    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137226    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137228    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137231    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137234    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137237    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137239    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137242    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 14:24:05.143405 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137244    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137247    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137249    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137251    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137254    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137257    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137260    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137262    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137264    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137267    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137270    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137272    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137275    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137277    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137279    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137282    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137284    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137287    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137289    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137292    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 14:24:05.143880 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137294    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137297    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137299    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137302    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137304    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137307    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137309    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137312    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137315    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137318    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137321    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137323    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137326    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137328    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137331    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137333    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137336    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137338    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137342    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 14:24:05.144364 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137345    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 14:24:05.144951 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137348    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 14:24:05.144951 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137351    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 14:24:05.144951 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137353    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 14:24:05.144951 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137356    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 14:24:05.144951 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137359    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 14:24:05.144951 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137361    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 14:24:05.144951 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:05.137363    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 14:24:05.144951 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.137368    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 14:24:05.144951 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.137469    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 14:24:05.144951 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.141438    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 14:24:05.144951 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.143163    2567 server.go:1019] "Starting client certificate rotation"
Jul 07 14:24:05.144951 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.143262    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 14:24:05.144951 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.143300    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 14:24:05.145939 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.145926    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 14:24:05.150052 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.150030    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 14:24:05.162400 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.162381    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 07 14:24:05.165936 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.165917    2567 log.go:25] "Validated CRI v1 image API"
Jul 07 14:24:05.166853 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.166836    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 14:24:05.173038 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.173006    2567 fs.go:135] Filesystem UUIDs: map[0168c387-152b-428d-b765-f0aef5c1d0ba:/dev/nvme0n1p4 16dd5ef4-46c4-438d-9ff4-7f3cbb66521e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 07 14:24:05.173107 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.173041    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 14:24:05.179329 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.179206    2567 manager.go:216] Machine: {Timestamp:2026-07-07 14:24:05.177801447 +0000 UTC m=+0.383775567 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3073509 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2da65a88b493d54573124d9f42b0c9 SystemUUID:ec2da65a-88b4-93d5-4573-124d9f42b0c9 BootID:49c6b4f5-c693-4065-b4a0-5db6b298fa70 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bf:2f:7e:2f:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bf:2f:7e:2f:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:e4:b7:81:30:57 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 14:24:05.179329 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.179320    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 14:24:05.179441 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.179409    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 14:24:05.182831 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.182801    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 14:24:05.182983 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.182835    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-48.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 14:24:05.183762 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.183751    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 14:24:05.183803 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.183765    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 14:24:05.183803 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.183773    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 14:24:05.184573 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.184561    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 14:24:05.186077 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.186061    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 14:24:05.186462 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.186451    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 14:24:05.191067 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.191053    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 14:24:05.191211 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.191202    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 14:24:05.191249 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.191241    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 14:24:05.191281 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.191257    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 14:24:05.191281 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.191273    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 14:24:05.191341 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.191283    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 07 14:24:05.191341 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.191293    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 14:24:05.191689 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.191678    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 14:24:05.191738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.191696    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 14:24:05.196358 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.196337    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 14:24:05.198768 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.198755    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 14:24:05.198827 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.198786    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 14:24:05.200204 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.200192    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 14:24:05.200245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.200209    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 14:24:05.200245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.200216    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 14:24:05.200245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.200221    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 14:24:05.200245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.200229    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 14:24:05.200245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.200234    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 14:24:05.200245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.200242    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 14:24:05.200392 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.200248    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 14:24:05.200392 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.200255    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 14:24:05.200392 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.200260    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 14:24:05.200392 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.200268    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 14:24:05.200392 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.200274    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 14:24:05.201227 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.201217    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 14:24:05.201227 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.201227    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 14:24:05.204734 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.204720    2567 server.go:1268] "Started kubelet"
Jul 07 14:24:05.204854 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.204829    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 14:24:05.204907 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.204839    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 14:24:05.204957 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.204916    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 14:24:05.205094 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.205070    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 14:24:05.205171 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.205151    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 14:24:05.205227 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.205211    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-48.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 14:24:05.205797 ip-10-0-139-48 systemd[1]: Started Kubernetes Kubelet.
Jul 07 14:24:05.206462 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.206445    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 14:24:05.207132 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.207118    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 14:24:05.213521 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.213503    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 14:24:05.214815 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.214781    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 14:24:05.214815 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.214793    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 14:24:05.214938 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.214902    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 07 14:24:05.215653 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.215633    2567 factory.go:55] Registering systemd factory
Jul 07 14:24:05.215741 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.215658    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 07 14:24:05.215741 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.215638    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 14:24:05.215867 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.215640    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 14:24:05.216114 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.215981    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 14:24:05.216114 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.215895    2567 factory.go:153] Registering CRI-O factory
Jul 07 14:24:05.216114 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.216027    2567 factory.go:223] Registration of the crio container factory successfully
Jul 07 14:24:05.216114 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.216078    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 14:24:05.216114 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.216105    2567 factory.go:103] Registering Raw factory
Jul 07 14:24:05.216404 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.216119    2567 manager.go:1196] Started watching for new ooms in manager
Jul 07 14:24:05.216648 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.216119    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 14:24:05.216648 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.216647    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 14:24:05.216791 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.216709    2567 manager.go:349] Starting recovery of all containers
Jul 07 14:24:05.220466 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.220435    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 14:24:05.220833 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.220808    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 14:24:05.221943 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.220676    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-48.ec2.internal.18c007ff39b15171  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-48.ec2.internal,UID:ip-10-0-139-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-48.ec2.internal,},FirstTimestamp:2026-07-07 14:24:05.204693361 +0000 UTC m=+0.410667480,LastTimestamp:2026-07-07 14:24:05.204693361 +0000 UTC m=+0.410667480,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-48.ec2.internal,}"
Jul 07 14:24:05.227704 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.227605    2567 manager.go:354] Recovery completed
Jul 07 14:24:05.232732 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.232717    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:24:05.234506 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.234489    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:24:05.234560 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.234524    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:24:05.234560 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.234535    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:24:05.235062 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.235049    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 14:24:05.235062 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.235060    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 14:24:05.235176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.235075    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 14:24:05.235176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.235105    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:24:05.235853 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.235835    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:24:05.235919 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.235871    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:24:05.235919 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.235887    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:24:05.237159 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.237077    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-48.ec2.internal.18c007ff3b784193  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-48.ec2.internal,UID:ip-10-0-139-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-48.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-48.ec2.internal,},FirstTimestamp:2026-07-07 14:24:05.234508179 +0000 UTC m=+0.440482299,LastTimestamp:2026-07-07 14:24:05.234508179 +0000 UTC m=+0.440482299,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-48.ec2.internal,}"
Jul 07 14:24:05.237300 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.237279    2567 policy_none.go:49] "None policy: Start"
Jul 07 14:24:05.237300 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.237296    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 14:24:05.237408 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.237307    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 14:24:05.238128 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.238113    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gwmdp"
Jul 07 14:24:05.239290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.239279    2567 policy_none.go:47] "Start"
Jul 07 14:24:05.246405 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.246340    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-48.ec2.internal.18c007ff3b7893f8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-48.ec2.internal,UID:ip-10-0-139-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-48.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-48.ec2.internal,},FirstTimestamp:2026-07-07 14:24:05.234529272 +0000 UTC m=+0.440503391,LastTimestamp:2026-07-07 14:24:05.234529272 +0000 UTC m=+0.440503391,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-48.ec2.internal,}"
Jul 07 14:24:05.247604 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.247571    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gwmdp"
Jul 07 14:24:05.249945 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.249882    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-48.ec2.internal.18c007ff3b78b80a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-48.ec2.internal,UID:ip-10-0-139-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-48.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-48.ec2.internal,},FirstTimestamp:2026-07-07 14:24:05.234538506 +0000 UTC m=+0.440512626,LastTimestamp:2026-07-07 14:24:05.234538506 +0000 UTC m=+0.440512626,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-48.ec2.internal,}"
Jul 07 14:24:05.267209 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.267192    2567 manager.go:337] "Starting Device Plugin manager"
Jul 07 14:24:05.267329 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.267234    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 14:24:05.267329 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.267247    2567 server.go:87] "Starting device plugin registration server"
Jul 07 14:24:05.267525 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.267511    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 14:24:05.267578 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.267526    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 14:24:05.267639 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.267624    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 14:24:05.267730 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.267705    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 14:24:05.267730 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.267729    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 14:24:05.268326 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.268304    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 14:24:05.268413 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.268371    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 07 14:24:05.288509 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.288482    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 14:24:05.299405 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.289824    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 14:24:05.299405 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.289855    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 14:24:05.299405 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.289872    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 14:24:05.299405 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.289904    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 14:24:05.299405 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.291823    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:24:05.368418 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.368330    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:24:05.369531 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.369514    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:24:05.369619 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.369547    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:24:05.369619 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.369558    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:24:05.369619 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.369584    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.379418 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.379403    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.379476 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.379429    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-48.ec2.internal\": node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 07 14:24:05.390304 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.390270    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal"]
Jul 07 14:24:05.390391 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.390343    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:24:05.391195 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.391178    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:24:05.391294 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.391212    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:24:05.391294 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.391226    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:24:05.393693 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.393677    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:24:05.393780 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.393763    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.393848 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.393791    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:24:05.394441 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.394428    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:24:05.394441 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.394434    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:24:05.394543 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.394456    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:24:05.394543 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.394457    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:24:05.394543 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.394465    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:24:05.394543 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.394472    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:24:05.396790 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.396774    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.396870 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.396813    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:24:05.397520 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.397505    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:24:05.397634 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.397537    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:24:05.397634 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.397551    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:24:05.417270 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.417239    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad68e1f845990f6848aad9efe7f0aba0-config\") pod \"kube-apiserver-proxy-ip-10-0-139-48.ec2.internal\" (UID: \"ad68e1f845990f6848aad9efe7f0aba0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.417270 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.417270    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/91b5dea8c48704d74760c02950be0b78-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"91b5dea8c48704d74760c02950be0b78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.417442 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.417289    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91b5dea8c48704d74760c02950be0b78-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"91b5dea8c48704d74760c02950be0b78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.417442 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.417383    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-48.ec2.internal\" not found" node="ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.418380 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.418363    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 07 14:24:05.421976 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.421950    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-48.ec2.internal\" not found" node="ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.517497 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.517464    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/91b5dea8c48704d74760c02950be0b78-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"91b5dea8c48704d74760c02950be0b78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.517497 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.517483    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/91b5dea8c48704d74760c02950be0b78-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"91b5dea8c48704d74760c02950be0b78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.517733 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.517505    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91b5dea8c48704d74760c02950be0b78-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"91b5dea8c48704d74760c02950be0b78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.517733 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.517532    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91b5dea8c48704d74760c02950be0b78-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal\" (UID: \"91b5dea8c48704d74760c02950be0b78\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.517733 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.517557    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad68e1f845990f6848aad9efe7f0aba0-config\") pod \"kube-apiserver-proxy-ip-10-0-139-48.ec2.internal\" (UID: \"ad68e1f845990f6848aad9efe7f0aba0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.517733 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.517576    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad68e1f845990f6848aad9efe7f0aba0-config\") pod \"kube-apiserver-proxy-ip-10-0-139-48.ec2.internal\" (UID: \"ad68e1f845990f6848aad9efe7f0aba0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.519406 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.519390    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 07 14:24:05.620273 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.620190    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 07 14:24:05.721043 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.721015    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 07 14:24:05.721043 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.721017    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.726561 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:05.726428    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal"
Jul 07 14:24:05.822050 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.822011    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 07 14:24:05.922648 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:05.922558    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 07 14:24:06.023106 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:06.023060    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 07 14:24:06.123654 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:06.123618    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 07 14:24:06.130775 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.130749    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:24:06.142004 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.141978    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 14:24:06.142124 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.142105    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 14:24:06.142169 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.142140    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 14:24:06.224163 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:06.224099    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-48.ec2.internal\" not found"
Jul 07 14:24:06.251677 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.251645    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 14:24:06.253729 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.253704    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 14:24:06.253834 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.253738    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 14:24:06.253834 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.253753    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeHasSufficientPID"
Jul 07 14:24:06.253985 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.253955    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 14:19:05 +0000 UTC" deadline="2028-01-13 22:14:53.813691906 +0000 UTC"
Jul 07 14:24:06.254035 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.253988    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13327h50m47.559708512s"
Jul 07 14:24:06.274097 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.274072    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:24:06.315555 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.315516    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal"
Jul 07 14:24:06.340771 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.340750    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 14:24:06.341843 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.341829    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal"
Jul 07 14:24:06.355952 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.355894    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 14:24:06.397276 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:06.397248    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad68e1f845990f6848aad9efe7f0aba0.slice/crio-42011384476cab1907b768b536e38beac922ffe76a656e77972cdef599f28c03 WatchSource:0}: Error finding container 42011384476cab1907b768b536e38beac922ffe76a656e77972cdef599f28c03: Status 404 returned error can't find the container with id 42011384476cab1907b768b536e38beac922ffe76a656e77972cdef599f28c03
Jul 07 14:24:06.397537 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:06.397514    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91b5dea8c48704d74760c02950be0b78.slice/crio-85511f237df60544d5cf209a9bbd48f359d3b592abfed2233d654db4867804cf WatchSource:0}: Error finding container 85511f237df60544d5cf209a9bbd48f359d3b592abfed2233d654db4867804cf: Status 404 returned error can't find the container with id 85511f237df60544d5cf209a9bbd48f359d3b592abfed2233d654db4867804cf
Jul 07 14:24:06.401852 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.401835    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:24:06.589163 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:06.589078    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:24:07.192939 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.192902    2567 apiserver.go:52] "Watching apiserver"
Jul 07 14:24:07.202043 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.202018    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 14:24:07.203239 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.203216    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-cbtjg","kube-system/global-pull-secret-syncer-pr7wh","kube-system/konnectivity-agent-8f6xm","openshift-dns/node-resolver-5pgr7","openshift-image-registry/node-ca-lwnqf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal","openshift-multus/multus-8hz5f","openshift-multus/multus-additional-cni-plugins-l47cj","openshift-network-operator/iptables-alerter-jgsjh","kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49","openshift-cluster-node-tuning-operator/tuned-bctpc","openshift-multus/network-metrics-daemon-dtm6b","openshift-network-diagnostics/network-check-target-69stk"]
Jul 07 14:24:07.205885 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.205866    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.208194 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.208171    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:07.208287 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:07.208248    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:07.211059 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.211038    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8f6xm"
Jul 07 14:24:07.211516 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.211490    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 14:24:07.211601 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.211496    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 14:24:07.211839 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.211819    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 14:24:07.211949 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.211882    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-klhtc\""
Jul 07 14:24:07.211949 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.211894    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 14:24:07.213368 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.213353    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5pgr7"
Jul 07 14:24:07.215236 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.215212    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 14:24:07.215433 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.215410    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 14:24:07.215537 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.215446    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 14:24:07.215733 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.215717    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7czgm\""
Jul 07 14:24:07.215914 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.215898    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lwnqf"
Jul 07 14:24:07.216613 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.216597    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 14:24:07.216708 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.216639    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 14:24:07.216754 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.216742    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vmv7h\""
Jul 07 14:24:07.218167 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.218148    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jgsjh"
Jul 07 14:24:07.220742 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.220718    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.223369 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.223347    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:07.223466 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:07.223438    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:07.226346 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226325    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:07.226446 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:07.226394    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:07.226517 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226495    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-run-netns\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.226575 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226525    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/302a7403-a5f3-4749-92a3-05bcc8138f1a-serviceca\") pod \"node-ca-lwnqf\" (UID: \"302a7403-a5f3-4749-92a3-05bcc8138f1a\") " pod="openshift-image-registry/node-ca-lwnqf"
Jul 07 14:24:07.226575 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226553    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-var-lib-cni-multus\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.226711 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226582    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-hostroot\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.226711 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226623    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-etc-kubernetes\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.226711 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226649    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckfx9\" (UniqueName: \"kubernetes.io/projected/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-kube-api-access-ckfx9\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.226711 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226675    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs\") pod \"network-metrics-daemon-dtm6b\" (UID: \"e2990272-3824-4e47-9c86-367e50e46bfc\") " pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:07.226711 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226700    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95a06780-deaf-4ca6-82b5-3040caf89229-hosts-file\") pod \"node-resolver-5pgr7\" (UID: \"95a06780-deaf-4ca6-82b5-3040caf89229\") " pod="openshift-dns/node-resolver-5pgr7"
Jul 07 14:24:07.226925 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226729    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-run-k8s-cni-cncf-io\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.226925 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226754    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-multus-daemon-config\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.226925 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226789    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00f603e4-c02e-408c-bcf0-2dbc2f1338cd-konnectivity-ca\") pod \"konnectivity-agent-8f6xm\" (UID: \"00f603e4-c02e-408c-bcf0-2dbc2f1338cd\") " pod="kube-system/konnectivity-agent-8f6xm"
Jul 07 14:24:07.226925 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226815    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq2c5\" (UniqueName: \"kubernetes.io/projected/95a06780-deaf-4ca6-82b5-3040caf89229-kube-api-access-hq2c5\") pod \"node-resolver-5pgr7\" (UID: \"95a06780-deaf-4ca6-82b5-3040caf89229\") " pod="openshift-dns/node-resolver-5pgr7"
Jul 07 14:24:07.226925 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226850    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-system-cni-dir\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.226925 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226875    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-multus-socket-dir-parent\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.226925 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226914    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-run-multus-certs\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.227235 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226950    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96ddr\" (UniqueName: \"kubernetes.io/projected/302a7403-a5f3-4749-92a3-05bcc8138f1a-kube-api-access-96ddr\") pod \"node-ca-lwnqf\" (UID: \"302a7403-a5f3-4749-92a3-05bcc8138f1a\") " pod="openshift-image-registry/node-ca-lwnqf"
Jul 07 14:24:07.227235 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226975    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-multus-cni-dir\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.227235 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.226997    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-cni-binary-copy\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.227235 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.227019    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-var-lib-cni-bin\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.227235 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.227062    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-os-release\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.227235 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.227113    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-var-lib-kubelet\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.227235 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.227155    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/302a7403-a5f3-4749-92a3-05bcc8138f1a-host\") pod \"node-ca-lwnqf\" (UID: \"302a7403-a5f3-4749-92a3-05bcc8138f1a\") " pod="openshift-image-registry/node-ca-lwnqf"
Jul 07 14:24:07.227235 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.227206    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtfpj\" (UniqueName: \"kubernetes.io/projected/e2990272-3824-4e47-9c86-367e50e46bfc-kube-api-access-dtfpj\") pod \"network-metrics-daemon-dtm6b\" (UID: \"e2990272-3824-4e47-9c86-367e50e46bfc\") " pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:07.227652 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.227253    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-cnibin\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.227652 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.227297    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-multus-conf-dir\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.227652 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.227373    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00f603e4-c02e-408c-bcf0-2dbc2f1338cd-agent-certs\") pod \"konnectivity-agent-8f6xm\" (UID: \"00f603e4-c02e-408c-bcf0-2dbc2f1338cd\") " pod="kube-system/konnectivity-agent-8f6xm"
Jul 07 14:24:07.227652 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.227420    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95a06780-deaf-4ca6-82b5-3040caf89229-tmp-dir\") pod \"node-resolver-5pgr7\" (UID: \"95a06780-deaf-4ca6-82b5-3040caf89229\") " pod="openshift-dns/node-resolver-5pgr7"
Jul 07 14:24:07.228825 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.228699    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.229841 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.229136    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 14:24:07.229841 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.229351    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 14:24:07.229841 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.229388    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 14:24:07.229841 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.229433    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mh8jq\""
Jul 07 14:24:07.229841 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.229556    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 14:24:07.229841 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.229625    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 14:24:07.229841 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.229650    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 14:24:07.230768 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.230747    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 14:24:07.231561 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.230820    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9l67r\""
Jul 07 14:24:07.232377 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.232350    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v5pdp\""
Jul 07 14:24:07.233254 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.233205    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 14:24:07.234808 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.233387    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 14:24:07.234808 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.233421    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 14:24:07.234808 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.233539    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 14:24:07.234808 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.233592    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 14:24:07.234808 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.234102    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.234808 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.234123    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 14:24:07.234808 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.234222    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:24:07.234808 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.234693    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-np46r\""
Jul 07 14:24:07.234808 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.234736    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 14:24:07.236425 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.236026    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.239933 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.239911    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 14:24:07.240232 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.240201    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 14:24:07.240414 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.240395    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 14:24:07.240709 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.240657    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zx7p5\""
Jul 07 14:24:07.241092 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.241071    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xksww\""
Jul 07 14:24:07.241223 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.241205    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:24:07.241292 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.241274    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 14:24:07.259096 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.259074    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zdw5l"
Jul 07 14:24:07.268812 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.268790    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zdw5l"
Jul 07 14:24:07.284527 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.284497    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:24:07.295718 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.295598    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" event={"ID":"91b5dea8c48704d74760c02950be0b78","Type":"ContainerStarted","Data":"85511f237df60544d5cf209a9bbd48f359d3b592abfed2233d654db4867804cf"}
Jul 07 14:24:07.297176 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.297150    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal" event={"ID":"ad68e1f845990f6848aad9efe7f0aba0","Type":"ContainerStarted","Data":"42011384476cab1907b768b536e38beac922ffe76a656e77972cdef599f28c03"}
Jul 07 14:24:07.317179 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.317150    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 14:24:07.328014 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.327975    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/302a7403-a5f3-4749-92a3-05bcc8138f1a-host\") pod \"node-ca-lwnqf\" (UID: \"302a7403-a5f3-4749-92a3-05bcc8138f1a\") " pod="openshift-image-registry/node-ca-lwnqf"
Jul 07 14:24:07.328014 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328016    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-registration-dir\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.328300 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328088    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/302a7403-a5f3-4749-92a3-05bcc8138f1a-host\") pod \"node-ca-lwnqf\" (UID: \"302a7403-a5f3-4749-92a3-05bcc8138f1a\") " pod="openshift-image-registry/node-ca-lwnqf"
Jul 07 14:24:07.328300 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328124    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/643b0708-d08d-425c-986e-da5ace735337-etc-tuned\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.328300 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328147    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9179849a-ab60-492b-84ea-ee5de2c4c1b5-cnibin\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.328300 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328167    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.328300 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328193    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtfpj\" (UniqueName: \"kubernetes.io/projected/e2990272-3824-4e47-9c86-367e50e46bfc-kube-api-access-dtfpj\") pod \"network-metrics-daemon-dtm6b\" (UID: \"e2990272-3824-4e47-9c86-367e50e46bfc\") " pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:07.328300 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328225    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-modprobe-d\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.328300 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328242    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0485a5cf-bc99-4bea-8bdc-56670619a532-ovn-node-metrics-cert\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.328300 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328260    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-kubelet-config\") pod \"global-pull-secret-syncer-pr7wh\" (UID: \"b3a21f69-c388-41a9-9d35-f6c4aa77ed86\") " pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:07.328300 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328285    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-multus-conf-dir\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.328300 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328304    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95a06780-deaf-4ca6-82b5-3040caf89229-tmp-dir\") pod \"node-resolver-5pgr7\" (UID: \"95a06780-deaf-4ca6-82b5-3040caf89229\") " pod="openshift-dns/node-resolver-5pgr7"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328322    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pc4s\" (UniqueName: \"kubernetes.io/projected/cc6cc446-e473-4326-a212-8bae1f733cbd-kube-api-access-4pc4s\") pod \"iptables-alerter-jgsjh\" (UID: \"cc6cc446-e473-4326-a212-8bae1f733cbd\") " pod="openshift-network-operator/iptables-alerter-jgsjh"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328344    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-slash\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328371    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-cni-bin\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328388    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq9sd\" (UniqueName: \"kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd\") pod \"network-check-target-69stk\" (UID: \"78b243a2-83e5-47a1-ba40-72c405e83077\") " pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328408    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-run-netns\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328502    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-run-netns\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328533    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-multus-conf-dir\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328546    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-etc-selinux\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328577    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9179849a-ab60-492b-84ea-ee5de2c4c1b5-system-cni-dir\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328631    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9179849a-ab60-492b-84ea-ee5de2c4c1b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328667    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-run-netns\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328694    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-dbus\") pod \"global-pull-secret-syncer-pr7wh\" (UID: \"b3a21f69-c388-41a9-9d35-f6c4aa77ed86\") " pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328714    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret\") pod \"global-pull-secret-syncer-pr7wh\" (UID: \"b3a21f69-c388-41a9-9d35-f6c4aa77ed86\") " pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328737    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-var-lib-cni-multus\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328763    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckfx9\" (UniqueName: \"kubernetes.io/projected/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-kube-api-access-ckfx9\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.328832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328793    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95a06780-deaf-4ca6-82b5-3040caf89229-tmp-dir\") pod \"node-resolver-5pgr7\" (UID: \"95a06780-deaf-4ca6-82b5-3040caf89229\") " pod="openshift-dns/node-resolver-5pgr7"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328795    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95a06780-deaf-4ca6-82b5-3040caf89229-hosts-file\") pod \"node-resolver-5pgr7\" (UID: \"95a06780-deaf-4ca6-82b5-3040caf89229\") " pod="openshift-dns/node-resolver-5pgr7"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328850    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-var-lib-cni-multus\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328879    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv4n6\" (UniqueName: \"kubernetes.io/projected/ebf4a235-1b85-46b3-9124-4edc7761d91b-kube-api-access-wv4n6\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328905    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct4bb\" (UniqueName: \"kubernetes.io/projected/643b0708-d08d-425c-986e-da5ace735337-kube-api-access-ct4bb\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328910    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95a06780-deaf-4ca6-82b5-3040caf89229-hosts-file\") pod \"node-resolver-5pgr7\" (UID: \"95a06780-deaf-4ca6-82b5-3040caf89229\") " pod="openshift-dns/node-resolver-5pgr7"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328946    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-run-k8s-cni-cncf-io\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.328976    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq2c5\" (UniqueName: \"kubernetes.io/projected/95a06780-deaf-4ca6-82b5-3040caf89229-kube-api-access-hq2c5\") pod \"node-resolver-5pgr7\" (UID: \"95a06780-deaf-4ca6-82b5-3040caf89229\") " pod="openshift-dns/node-resolver-5pgr7"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329001    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-multus-socket-dir-parent\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329021    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-socket-dir\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329046    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-run-k8s-cni-cncf-io\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329048    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-kubernetes\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329089    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-sysctl-d\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329089    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-multus-socket-dir-parent\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329124    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9179849a-ab60-492b-84ea-ee5de2c4c1b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329142    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc6cc446-e473-4326-a212-8bae1f733cbd-host-slash\") pod \"iptables-alerter-jgsjh\" (UID: \"cc6cc446-e473-4326-a212-8bae1f733cbd\") " pod="openshift-network-operator/iptables-alerter-jgsjh"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329158    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-cni-netd\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.329738 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329176    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-multus-cni-dir\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329192    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-cni-binary-copy\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329215    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-sys\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329231    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-os-release\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329245    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-host\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329259    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/643b0708-d08d-425c-986e-da5ace735337-tmp\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329274    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9179849a-ab60-492b-84ea-ee5de2c4c1b5-os-release\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329289    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-multus-cni-dir\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329306    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-node-log\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329323    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m59fz\" (UniqueName: \"kubernetes.io/projected/0485a5cf-bc99-4bea-8bdc-56670619a532-kube-api-access-m59fz\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329360    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-var-lib-openvswitch\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329407    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-os-release\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329406    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-run-openvswitch\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329451    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0485a5cf-bc99-4bea-8bdc-56670619a532-ovnkube-script-lib\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329485    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-cnibin\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329507    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00f603e4-c02e-408c-bcf0-2dbc2f1338cd-agent-certs\") pod \"konnectivity-agent-8f6xm\" (UID: \"00f603e4-c02e-408c-bcf0-2dbc2f1338cd\") " pod="kube-system/konnectivity-agent-8f6xm"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329577    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-cnibin\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.330615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329664    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-sysctl-conf\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329692    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9179849a-ab60-492b-84ea-ee5de2c4c1b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329718    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-etc-openvswitch\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329746    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/302a7403-a5f3-4749-92a3-05bcc8138f1a-serviceca\") pod \"node-ca-lwnqf\" (UID: \"302a7403-a5f3-4749-92a3-05bcc8138f1a\") " pod="openshift-image-registry/node-ca-lwnqf"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329769    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-run\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329795    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9179849a-ab60-492b-84ea-ee5de2c4c1b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329820    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc6cc446-e473-4326-a212-8bae1f733cbd-iptables-alerter-script\") pod \"iptables-alerter-jgsjh\" (UID: \"cc6cc446-e473-4326-a212-8bae1f733cbd\") " pod="openshift-network-operator/iptables-alerter-jgsjh"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329844    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-run-systemd\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329844    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329871    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-run-ovn\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329937    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-hostroot\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329962    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-etc-kubernetes\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.329988    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs\") pod \"network-metrics-daemon-dtm6b\" (UID: \"e2990272-3824-4e47-9c86-367e50e46bfc\") " pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330012    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-cni-binary-copy\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330054    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-sysconfig\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330090    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-kubelet\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330119    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-log-socket\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.331347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330146    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-run-ovn-kubernetes\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330171    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0485a5cf-bc99-4bea-8bdc-56670619a532-ovnkube-config\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330201    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-multus-daemon-config\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330230    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-hostroot\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330241    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00f603e4-c02e-408c-bcf0-2dbc2f1338cd-konnectivity-ca\") pod \"konnectivity-agent-8f6xm\" (UID: \"00f603e4-c02e-408c-bcf0-2dbc2f1338cd\") " pod="kube-system/konnectivity-agent-8f6xm"
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:07.330261    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330268    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-systemd\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:07.330367    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs podName:e2990272-3824-4e47-9c86-367e50e46bfc nodeName:}" failed. No retries permitted until 2026-07-07 14:24:07.83034444 +0000 UTC m=+3.036318561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs") pod "network-metrics-daemon-dtm6b" (UID: "e2990272-3824-4e47-9c86-367e50e46bfc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330553    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-system-cni-dir\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330589    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-run-multus-certs\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330615    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96ddr\" (UniqueName: \"kubernetes.io/projected/302a7403-a5f3-4749-92a3-05bcc8138f1a-kube-api-access-96ddr\") pod \"node-ca-lwnqf\" (UID: \"302a7403-a5f3-4749-92a3-05bcc8138f1a\") " pod="openshift-image-registry/node-ca-lwnqf"
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330621    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/302a7403-a5f3-4749-92a3-05bcc8138f1a-serviceca\") pod \"node-ca-lwnqf\" (UID: \"302a7403-a5f3-4749-92a3-05bcc8138f1a\") " pod="openshift-image-registry/node-ca-lwnqf"
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330643    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-lib-modules\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330686    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-var-lib-kubelet\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330760    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-etc-kubernetes\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330803    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-run-multus-certs\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330852    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00f603e4-c02e-408c-bcf0-2dbc2f1338cd-konnectivity-ca\") pod \"konnectivity-agent-8f6xm\" (UID: \"00f603e4-c02e-408c-bcf0-2dbc2f1338cd\") " pod="kube-system/konnectivity-agent-8f6xm"
Jul 07 14:24:07.332230 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330844    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-system-cni-dir\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.333067 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.330893    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6l4q\" (UniqueName: \"kubernetes.io/projected/9179849a-ab60-492b-84ea-ee5de2c4c1b5-kube-api-access-d6l4q\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.333067 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.331008    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0485a5cf-bc99-4bea-8bdc-56670619a532-env-overrides\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.333067 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.331043    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-var-lib-cni-bin\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.333067 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.331071    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-device-dir\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.333067 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.331097    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-sys-fs\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.333067 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.331120    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-systemd-units\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.333067 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.331146    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-var-lib-kubelet\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.333067 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.331152    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-multus-daemon-config\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.333067 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.331227    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-var-lib-kubelet\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.333067 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.331236    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-host-var-lib-cni-bin\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.334063 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.334035    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00f603e4-c02e-408c-bcf0-2dbc2f1338cd-agent-certs\") pod \"konnectivity-agent-8f6xm\" (UID: \"00f603e4-c02e-408c-bcf0-2dbc2f1338cd\") " pod="kube-system/konnectivity-agent-8f6xm"
Jul 07 14:24:07.344767 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.344728    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq2c5\" (UniqueName: \"kubernetes.io/projected/95a06780-deaf-4ca6-82b5-3040caf89229-kube-api-access-hq2c5\") pod \"node-resolver-5pgr7\" (UID: \"95a06780-deaf-4ca6-82b5-3040caf89229\") " pod="openshift-dns/node-resolver-5pgr7"
Jul 07 14:24:07.345250 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.345180    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtfpj\" (UniqueName: \"kubernetes.io/projected/e2990272-3824-4e47-9c86-367e50e46bfc-kube-api-access-dtfpj\") pod \"network-metrics-daemon-dtm6b\" (UID: \"e2990272-3824-4e47-9c86-367e50e46bfc\") " pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:07.346724 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.346652    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckfx9\" (UniqueName: \"kubernetes.io/projected/e9ea96a3-1a0f-4d57-86f3-c63c9f346229-kube-api-access-ckfx9\") pod \"multus-8hz5f\" (UID: \"e9ea96a3-1a0f-4d57-86f3-c63c9f346229\") " pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.353407 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.353359    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96ddr\" (UniqueName: \"kubernetes.io/projected/302a7403-a5f3-4749-92a3-05bcc8138f1a-kube-api-access-96ddr\") pod \"node-ca-lwnqf\" (UID: \"302a7403-a5f3-4749-92a3-05bcc8138f1a\") " pod="openshift-image-registry/node-ca-lwnqf"
Jul 07 14:24:07.432066 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432032    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-lib-modules\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.432066 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432066    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-var-lib-kubelet\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.432326 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432085    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6l4q\" (UniqueName: \"kubernetes.io/projected/9179849a-ab60-492b-84ea-ee5de2c4c1b5-kube-api-access-d6l4q\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.432326 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432112    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0485a5cf-bc99-4bea-8bdc-56670619a532-env-overrides\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.432326 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432136    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-device-dir\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.432326 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432158    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-sys-fs\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.432326 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432206    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-var-lib-kubelet\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.432326 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432223    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-sys-fs\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.432326 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432243    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-lib-modules\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.432326 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432287    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-device-dir\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.432745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432336    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-systemd-units\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.432745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432397    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-registration-dir\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.432745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432422    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/643b0708-d08d-425c-986e-da5ace735337-etc-tuned\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.432745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432433    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-systemd-units\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.432745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432440    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9179849a-ab60-492b-84ea-ee5de2c4c1b5-cnibin\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.432745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432472    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.432745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432495    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-registration-dir\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.432745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432501    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-modprobe-d\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.432745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432542    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0485a5cf-bc99-4bea-8bdc-56670619a532-ovn-node-metrics-cert\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.432745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432545    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9179849a-ab60-492b-84ea-ee5de2c4c1b5-cnibin\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.432745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432550    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.432745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432597    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-modprobe-d\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.432745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432622    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-kubelet-config\") pod \"global-pull-secret-syncer-pr7wh\" (UID: \"b3a21f69-c388-41a9-9d35-f6c4aa77ed86\") " pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:07.432745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432670    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pc4s\" (UniqueName: \"kubernetes.io/projected/cc6cc446-e473-4326-a212-8bae1f733cbd-kube-api-access-4pc4s\") pod \"iptables-alerter-jgsjh\" (UID: \"cc6cc446-e473-4326-a212-8bae1f733cbd\") " pod="openshift-network-operator/iptables-alerter-jgsjh"
Jul 07 14:24:07.432745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432695    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-slash\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432761    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-cni-bin\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432788    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq9sd\" (UniqueName: \"kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd\") pod \"network-check-target-69stk\" (UID: \"78b243a2-83e5-47a1-ba40-72c405e83077\") " pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432787    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-kubelet-config\") pod \"global-pull-secret-syncer-pr7wh\" (UID: \"b3a21f69-c388-41a9-9d35-f6c4aa77ed86\") " pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432817    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432850    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0485a5cf-bc99-4bea-8bdc-56670619a532-env-overrides\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432860    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-cni-bin\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432915    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432906    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-etc-selinux\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432962    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9179849a-ab60-492b-84ea-ee5de2c4c1b5-system-cni-dir\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432982    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-slash\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.432987    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9179849a-ab60-492b-84ea-ee5de2c4c1b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433074    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-run-netns\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433104    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-dbus\") pod \"global-pull-secret-syncer-pr7wh\" (UID: \"b3a21f69-c388-41a9-9d35-f6c4aa77ed86\") " pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433132    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret\") pod \"global-pull-secret-syncer-pr7wh\" (UID: \"b3a21f69-c388-41a9-9d35-f6c4aa77ed86\") " pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433192    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-run-netns\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433239    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv4n6\" (UniqueName: \"kubernetes.io/projected/ebf4a235-1b85-46b3-9124-4edc7761d91b-kube-api-access-wv4n6\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.433491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct4bb\" (UniqueName: \"kubernetes.io/projected/643b0708-d08d-425c-986e-da5ace735337-kube-api-access-ct4bb\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433310    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-socket-dir\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433340    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-kubernetes\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433372    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-sysctl-d\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433403    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9179849a-ab60-492b-84ea-ee5de2c4c1b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:07.433417    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433445    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc6cc446-e473-4326-a212-8bae1f733cbd-host-slash\") pod \"iptables-alerter-jgsjh\" (UID: \"cc6cc446-e473-4326-a212-8bae1f733cbd\") " pod="openshift-network-operator/iptables-alerter-jgsjh"
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433473    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-dbus\") pod \"global-pull-secret-syncer-pr7wh\" (UID: \"b3a21f69-c388-41a9-9d35-f6c4aa77ed86\") " pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:07.433508    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret podName:b3a21f69-c388-41a9-9d35-f6c4aa77ed86 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:07.933458457 +0000 UTC m=+3.139432566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret") pod "global-pull-secret-syncer-pr7wh" (UID: "b3a21f69-c388-41a9-9d35-f6c4aa77ed86") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433408    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-etc-selinux\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433532    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-cni-netd\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433557    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-kubernetes\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433575    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-sys\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433502    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc6cc446-e473-4326-a212-8bae1f733cbd-host-slash\") pod \"iptables-alerter-jgsjh\" (UID: \"cc6cc446-e473-4326-a212-8bae1f733cbd\") " pod="openshift-network-operator/iptables-alerter-jgsjh"
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433635    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-host\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433663    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9179849a-ab60-492b-84ea-ee5de2c4c1b5-system-cni-dir\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433687    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/643b0708-d08d-425c-986e-da5ace735337-tmp\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.434333 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.433688    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ebf4a235-1b85-46b3-9124-4edc7761d91b-socket-dir\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.435180 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.434372    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-sysctl-d\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.435180 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.434787    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9179849a-ab60-492b-84ea-ee5de2c4c1b5-os-release\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.435180 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.435146    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-sys\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.435330 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.435185    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9179849a-ab60-492b-84ea-ee5de2c4c1b5-os-release\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.435330 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.435247    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-node-log\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.435330 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.435283    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m59fz\" (UniqueName: \"kubernetes.io/projected/0485a5cf-bc99-4bea-8bdc-56670619a532-kube-api-access-m59fz\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.435330 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.435323    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-var-lib-openvswitch\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.435532 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.435371    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-run-openvswitch\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.435532 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.435451    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0485a5cf-bc99-4bea-8bdc-56670619a532-ovnkube-script-lib\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.435636 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.435541    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-sysctl-conf\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.435636 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.435611    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9179849a-ab60-492b-84ea-ee5de2c4c1b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.435768 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.435653    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-etc-openvswitch\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.435768 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.435744    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-run\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.435874 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.435777    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9179849a-ab60-492b-84ea-ee5de2c4c1b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.435874 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.435834    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc6cc446-e473-4326-a212-8bae1f733cbd-iptables-alerter-script\") pod \"iptables-alerter-jgsjh\" (UID: \"cc6cc446-e473-4326-a212-8bae1f733cbd\") " pod="openshift-network-operator/iptables-alerter-jgsjh"
Jul 07 14:24:07.435976 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.435907    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-run-systemd\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.436027 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.435982    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-run-ovn\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.436106 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.436046    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-sysconfig\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.436177 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.436161    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-kubelet\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.436230 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.436204    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-log-socket\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.436276 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.436253    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-run-ovn-kubernetes\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.436326 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.436287    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0485a5cf-bc99-4bea-8bdc-56670619a532-ovnkube-config\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.436403 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.436375    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-systemd\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.436506 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.436359    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9179849a-ab60-492b-84ea-ee5de2c4c1b5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.436506 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.436477    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-host\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.436665    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-run\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.436780    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-kubelet\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.436817    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9179849a-ab60-492b-84ea-ee5de2c4c1b5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.436864    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-node-log\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.436891    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-run-systemd\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.436961    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-sysconfig\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.436986    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-log-socket\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.437069    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-run-ovn-kubernetes\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.437380    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-sysctl-conf\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.437414    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc6cc446-e473-4326-a212-8bae1f733cbd-iptables-alerter-script\") pod \"iptables-alerter-jgsjh\" (UID: \"cc6cc446-e473-4326-a212-8bae1f733cbd\") " pod="openshift-network-operator/iptables-alerter-jgsjh"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.437484    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-run-ovn\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.437617    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-var-lib-openvswitch\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.437702    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-host-cni-netd\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.437774    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0485a5cf-bc99-4bea-8bdc-56670619a532-ovnkube-script-lib\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.437780    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-etc-openvswitch\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.437837    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0485a5cf-bc99-4bea-8bdc-56670619a532-run-openvswitch\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.437886    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/643b0708-d08d-425c-986e-da5ace735337-etc-systemd\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.440002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.437883    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9179849a-ab60-492b-84ea-ee5de2c4c1b5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.440655 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.438014    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0485a5cf-bc99-4bea-8bdc-56670619a532-ovn-node-metrics-cert\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.440655 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.438219    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9179849a-ab60-492b-84ea-ee5de2c4c1b5-cni-binary-copy\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.440655 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.438362    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0485a5cf-bc99-4bea-8bdc-56670619a532-ovnkube-config\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.440655 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.439878    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/643b0708-d08d-425c-986e-da5ace735337-etc-tuned\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.440655 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.440349    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/643b0708-d08d-425c-986e-da5ace735337-tmp\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.441000 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:07.440983    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:24:07.441058 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:07.441004    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:24:07.441058 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:07.441016    2567 projected.go:196] Error preparing data for projected volume kube-api-access-vq9sd for pod openshift-network-diagnostics/network-check-target-69stk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:07.441141 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:07.441072    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd podName:78b243a2-83e5-47a1-ba40-72c405e83077 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:07.941058702 +0000 UTC m=+3.147032815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vq9sd" (UniqueName: "kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd") pod "network-check-target-69stk" (UID: "78b243a2-83e5-47a1-ba40-72c405e83077") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:07.446062 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.446035    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pc4s\" (UniqueName: \"kubernetes.io/projected/cc6cc446-e473-4326-a212-8bae1f733cbd-kube-api-access-4pc4s\") pod \"iptables-alerter-jgsjh\" (UID: \"cc6cc446-e473-4326-a212-8bae1f733cbd\") " pod="openshift-network-operator/iptables-alerter-jgsjh"
Jul 07 14:24:07.446326 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.446301    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6l4q\" (UniqueName: \"kubernetes.io/projected/9179849a-ab60-492b-84ea-ee5de2c4c1b5-kube-api-access-d6l4q\") pod \"multus-additional-cni-plugins-l47cj\" (UID: \"9179849a-ab60-492b-84ea-ee5de2c4c1b5\") " pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.447213 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.447186    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct4bb\" (UniqueName: \"kubernetes.io/projected/643b0708-d08d-425c-986e-da5ace735337-kube-api-access-ct4bb\") pod \"tuned-bctpc\" (UID: \"643b0708-d08d-425c-986e-da5ace735337\") " pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.449258 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.449234    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m59fz\" (UniqueName: \"kubernetes.io/projected/0485a5cf-bc99-4bea-8bdc-56670619a532-kube-api-access-m59fz\") pod \"ovnkube-node-cbtjg\" (UID: \"0485a5cf-bc99-4bea-8bdc-56670619a532\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.450287 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.450268    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv4n6\" (UniqueName: \"kubernetes.io/projected/ebf4a235-1b85-46b3-9124-4edc7761d91b-kube-api-access-wv4n6\") pod \"aws-ebs-csi-driver-node-bnf49\" (UID: \"ebf4a235-1b85-46b3-9124-4edc7761d91b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.515562 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.515526    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8hz5f"
Jul 07 14:24:07.526348 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.525575    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8f6xm"
Jul 07 14:24:07.545147 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.545120    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5pgr7"
Jul 07 14:24:07.551845 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.551808    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lwnqf"
Jul 07 14:24:07.560726 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.560705    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jgsjh"
Jul 07 14:24:07.568773 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.568752    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:07.577871 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.577848    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49"
Jul 07 14:24:07.585804 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.585780    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bctpc"
Jul 07 14:24:07.595783 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.595757    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l47cj"
Jul 07 14:24:07.840205 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.840101    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs\") pod \"network-metrics-daemon-dtm6b\" (UID: \"e2990272-3824-4e47-9c86-367e50e46bfc\") " pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:07.840351 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:07.840249    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:07.840351 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:07.840314    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs podName:e2990272-3824-4e47-9c86-367e50e46bfc nodeName:}" failed. No retries permitted until 2026-07-07 14:24:08.840297867 +0000 UTC m=+4.046271975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs") pod "network-metrics-daemon-dtm6b" (UID: "e2990272-3824-4e47-9c86-367e50e46bfc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:07.940611 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:07.940570    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret\") pod \"global-pull-secret-syncer-pr7wh\" (UID: \"b3a21f69-c388-41a9-9d35-f6c4aa77ed86\") " pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:07.940801 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:07.940748    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:07.940852 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:07.940826    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret podName:b3a21f69-c388-41a9-9d35-f6c4aa77ed86 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:08.940809735 +0000 UTC m=+4.146783844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret") pod "global-pull-secret-syncer-pr7wh" (UID: "b3a21f69-c388-41a9-9d35-f6c4aa77ed86") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:08.042046 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:08.042008    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq9sd\" (UniqueName: \"kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd\") pod \"network-check-target-69stk\" (UID: \"78b243a2-83e5-47a1-ba40-72c405e83077\") " pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:08.042240 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:08.042222    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:24:08.042290 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:08.042243    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:24:08.042290 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:08.042254    2567 projected.go:196] Error preparing data for projected volume kube-api-access-vq9sd for pod openshift-network-diagnostics/network-check-target-69stk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:08.042355 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:08.042320    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd podName:78b243a2-83e5-47a1-ba40-72c405e83077 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:09.042300317 +0000 UTC m=+4.248274464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq9sd" (UniqueName: "kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd") pod "network-check-target-69stk" (UID: "78b243a2-83e5-47a1-ba40-72c405e83077") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:08.272517 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:08.272431    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:19:07 +0000 UTC" deadline="2028-01-23 10:56:48.24447404 +0000 UTC"
Jul 07 14:24:08.272517 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:08.272468    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13556h32m39.972011365s"
Jul 07 14:24:08.291163 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:08.291123    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:08.291335 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:08.291256    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:08.447631 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:08.447591    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 14:24:08.649431 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:08.649245    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ea96a3_1a0f_4d57_86f3_c63c9f346229.slice/crio-c60c8532afecc4b49b6d564bb406e59da21012fed2e8b588deabe81701f2dd87 WatchSource:0}: Error finding container c60c8532afecc4b49b6d564bb406e59da21012fed2e8b588deabe81701f2dd87: Status 404 returned error can't find the container with id c60c8532afecc4b49b6d564bb406e59da21012fed2e8b588deabe81701f2dd87
Jul 07 14:24:08.650079 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:08.650057    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643b0708_d08d_425c_986e_da5ace735337.slice/crio-d84d3936081a04a49cddbac159c4d9144b2fa0e001247df78c73d8be4c038105 WatchSource:0}: Error finding container d84d3936081a04a49cddbac159c4d9144b2fa0e001247df78c73d8be4c038105: Status 404 returned error can't find the container with id d84d3936081a04a49cddbac159c4d9144b2fa0e001247df78c73d8be4c038105
Jul 07 14:24:08.658867 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:08.658843    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0485a5cf_bc99_4bea_8bdc_56670619a532.slice/crio-f39a8556c3d1f9ac38b47e783c6cda8f0b16f36e7dd0f9ff5de01a8206943846 WatchSource:0}: Error finding container f39a8556c3d1f9ac38b47e783c6cda8f0b16f36e7dd0f9ff5de01a8206943846: Status 404 returned error can't find the container with id f39a8556c3d1f9ac38b47e783c6cda8f0b16f36e7dd0f9ff5de01a8206943846
Jul 07 14:24:08.665349 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:08.665324    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc6cc446_e473_4326_a212_8bae1f733cbd.slice/crio-9ac2a9da21d74195b263a0992ed38e1a034f6287bd47674c4c7f66ae6b3ca32f WatchSource:0}: Error finding container 9ac2a9da21d74195b263a0992ed38e1a034f6287bd47674c4c7f66ae6b3ca32f: Status 404 returned error can't find the container with id 9ac2a9da21d74195b263a0992ed38e1a034f6287bd47674c4c7f66ae6b3ca32f
Jul 07 14:24:08.669253 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:08.669233    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod302a7403_a5f3_4749_92a3_05bcc8138f1a.slice/crio-2de614c67527e6d8be6fbfbdc0898b47c914e35bb3186b656517dd02de54c47a WatchSource:0}: Error finding container 2de614c67527e6d8be6fbfbdc0898b47c914e35bb3186b656517dd02de54c47a: Status 404 returned error can't find the container with id 2de614c67527e6d8be6fbfbdc0898b47c914e35bb3186b656517dd02de54c47a
Jul 07 14:24:08.670792 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:08.670773    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a06780_deaf_4ca6_82b5_3040caf89229.slice/crio-1427f056fe462d695912f268ddb6587995fbabe757e17a580daa657f18c2e2ee WatchSource:0}: Error finding container 1427f056fe462d695912f268ddb6587995fbabe757e17a580daa657f18c2e2ee: Status 404 returned error can't find the container with id 1427f056fe462d695912f268ddb6587995fbabe757e17a580daa657f18c2e2ee
Jul 07 14:24:08.672193 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:08.672168    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf4a235_1b85_46b3_9124_4edc7761d91b.slice/crio-ca64a91700affe1def55ee28b2a2b4b7761d39ae5411d1662a0eb47ada8ac1bc WatchSource:0}: Error finding container ca64a91700affe1def55ee28b2a2b4b7761d39ae5411d1662a0eb47ada8ac1bc: Status 404 returned error can't find the container with id ca64a91700affe1def55ee28b2a2b4b7761d39ae5411d1662a0eb47ada8ac1bc
Jul 07 14:24:08.673055 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:08.672964    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9179849a_ab60_492b_84ea_ee5de2c4c1b5.slice/crio-59ed521b3a457accb649122fa1248106e1710d1b2e90f39fe3daaafc88f87268 WatchSource:0}: Error finding container 59ed521b3a457accb649122fa1248106e1710d1b2e90f39fe3daaafc88f87268: Status 404 returned error can't find the container with id 59ed521b3a457accb649122fa1248106e1710d1b2e90f39fe3daaafc88f87268
Jul 07 14:24:08.674030 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:08.673929    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00f603e4_c02e_408c_bcf0_2dbc2f1338cd.slice/crio-5345f9017ecb8b59327bd65448c3348f74ee37df8aec512965440f4ca4ddfd62 WatchSource:0}: Error finding container 5345f9017ecb8b59327bd65448c3348f74ee37df8aec512965440f4ca4ddfd62: Status 404 returned error can't find the container with id 5345f9017ecb8b59327bd65448c3348f74ee37df8aec512965440f4ca4ddfd62
Jul 07 14:24:08.849099 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:08.849046    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs\") pod \"network-metrics-daemon-dtm6b\" (UID: \"e2990272-3824-4e47-9c86-367e50e46bfc\") " pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:08.849288 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:08.849272    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:08.849353 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:08.849343    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs podName:e2990272-3824-4e47-9c86-367e50e46bfc nodeName:}" failed. No retries permitted until 2026-07-07 14:24:10.849326371 +0000 UTC m=+6.055300481 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs") pod "network-metrics-daemon-dtm6b" (UID: "e2990272-3824-4e47-9c86-367e50e46bfc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:08.950401 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:08.950375    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret\") pod \"global-pull-secret-syncer-pr7wh\" (UID: \"b3a21f69-c388-41a9-9d35-f6c4aa77ed86\") " pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:08.950521 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:08.950479    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:08.950562 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:08.950531    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret podName:b3a21f69-c388-41a9-9d35-f6c4aa77ed86 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:10.950517513 +0000 UTC m=+6.156491621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret") pod "global-pull-secret-syncer-pr7wh" (UID: "b3a21f69-c388-41a9-9d35-f6c4aa77ed86") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:09.051627 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.051582    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq9sd\" (UniqueName: \"kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd\") pod \"network-check-target-69stk\" (UID: \"78b243a2-83e5-47a1-ba40-72c405e83077\") " pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:09.053938 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:09.051847    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:24:09.053938 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:09.051873    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:24:09.053938 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:09.051887    2567 projected.go:196] Error preparing data for projected volume kube-api-access-vq9sd for pod openshift-network-diagnostics/network-check-target-69stk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:09.053938 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:09.051958    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd podName:78b243a2-83e5-47a1-ba40-72c405e83077 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:11.051938729 +0000 UTC m=+6.257912857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq9sd" (UniqueName: "kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd") pod "network-check-target-69stk" (UID: "78b243a2-83e5-47a1-ba40-72c405e83077") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:09.273660 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.273505    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:19:07 +0000 UTC" deadline="2028-01-07 13:22:24.710166147 +0000 UTC"
Jul 07 14:24:09.273660 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.273569    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13174h58m15.436600155s"
Jul 07 14:24:09.292508 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.292477    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:09.292715 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:09.292611    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:09.293084 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.293061    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:09.293192 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:09.293168    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:09.304690 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.304596    2567 generic.go:356] "Generic (PLEG): container finished" podID="91b5dea8c48704d74760c02950be0b78" containerID="633bed4bbe7f545cd189fb11b47273cd48c1fbf214747faf3dedbff594f9139a" exitCode=0
Jul 07 14:24:09.305496 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.305288    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" event={"ID":"91b5dea8c48704d74760c02950be0b78","Type":"ContainerDied","Data":"633bed4bbe7f545cd189fb11b47273cd48c1fbf214747faf3dedbff594f9139a"}
Jul 07 14:24:09.310454 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.310385    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5pgr7" event={"ID":"95a06780-deaf-4ca6-82b5-3040caf89229","Type":"ContainerStarted","Data":"1427f056fe462d695912f268ddb6587995fbabe757e17a580daa657f18c2e2ee"}
Jul 07 14:24:09.314214 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.314163    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg" event={"ID":"0485a5cf-bc99-4bea-8bdc-56670619a532","Type":"ContainerStarted","Data":"f39a8556c3d1f9ac38b47e783c6cda8f0b16f36e7dd0f9ff5de01a8206943846"}
Jul 07 14:24:09.322131 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.322101    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jgsjh" event={"ID":"cc6cc446-e473-4326-a212-8bae1f733cbd","Type":"ContainerStarted","Data":"9ac2a9da21d74195b263a0992ed38e1a034f6287bd47674c4c7f66ae6b3ca32f"}
Jul 07 14:24:09.323805 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.323773    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8hz5f" event={"ID":"e9ea96a3-1a0f-4d57-86f3-c63c9f346229","Type":"ContainerStarted","Data":"c60c8532afecc4b49b6d564bb406e59da21012fed2e8b588deabe81701f2dd87"}
Jul 07 14:24:09.326359 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.326326    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal" event={"ID":"ad68e1f845990f6848aad9efe7f0aba0","Type":"ContainerStarted","Data":"2245795d313acd9b8b15cbd996ee767dcd1434e56cc678b317e81506d2098b24"}
Jul 07 14:24:09.328837 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.328810    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8f6xm" event={"ID":"00f603e4-c02e-408c-bcf0-2dbc2f1338cd","Type":"ContainerStarted","Data":"5345f9017ecb8b59327bd65448c3348f74ee37df8aec512965440f4ca4ddfd62"}
Jul 07 14:24:09.331222 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.331195    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l47cj" event={"ID":"9179849a-ab60-492b-84ea-ee5de2c4c1b5","Type":"ContainerStarted","Data":"59ed521b3a457accb649122fa1248106e1710d1b2e90f39fe3daaafc88f87268"}
Jul 07 14:24:09.333371 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.333342    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49" event={"ID":"ebf4a235-1b85-46b3-9124-4edc7761d91b","Type":"ContainerStarted","Data":"ca64a91700affe1def55ee28b2a2b4b7761d39ae5411d1662a0eb47ada8ac1bc"}
Jul 07 14:24:09.339047 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.338990    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lwnqf" event={"ID":"302a7403-a5f3-4749-92a3-05bcc8138f1a","Type":"ContainerStarted","Data":"2de614c67527e6d8be6fbfbdc0898b47c914e35bb3186b656517dd02de54c47a"}
Jul 07 14:24:09.340943 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:09.340871    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bctpc" event={"ID":"643b0708-d08d-425c-986e-da5ace735337","Type":"ContainerStarted","Data":"d84d3936081a04a49cddbac159c4d9144b2fa0e001247df78c73d8be4c038105"}
Jul 07 14:24:10.290823 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:10.290312    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:10.290823 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:10.290449    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:10.372363 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:10.372287    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" event={"ID":"91b5dea8c48704d74760c02950be0b78","Type":"ContainerStarted","Data":"65c18cfd0a0a94206c36b78b0215108ced1a300043f5e9e7f2ff46c85ca032c4"}
Jul 07 14:24:10.394594 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:10.393431    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-48.ec2.internal" podStartSLOduration=3.393409303 podStartE2EDuration="3.393409303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:09.356435337 +0000 UTC m=+4.562409471" watchObservedRunningTime="2026-07-07 14:24:10.393409303 +0000 UTC m=+5.599383437"
Jul 07 14:24:10.869357 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:10.868644    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs\") pod \"network-metrics-daemon-dtm6b\" (UID: \"e2990272-3824-4e47-9c86-367e50e46bfc\") " pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:10.869357 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:10.868882    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:10.869357 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:10.868957    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs podName:e2990272-3824-4e47-9c86-367e50e46bfc nodeName:}" failed. No retries permitted until 2026-07-07 14:24:14.868935308 +0000 UTC m=+10.074909449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs") pod "network-metrics-daemon-dtm6b" (UID: "e2990272-3824-4e47-9c86-367e50e46bfc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:10.969725 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:10.969686    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret\") pod \"global-pull-secret-syncer-pr7wh\" (UID: \"b3a21f69-c388-41a9-9d35-f6c4aa77ed86\") " pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:10.969915 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:10.969860    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:10.969996 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:10.969934    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret podName:b3a21f69-c388-41a9-9d35-f6c4aa77ed86 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:14.969905831 +0000 UTC m=+10.175879945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret") pod "global-pull-secret-syncer-pr7wh" (UID: "b3a21f69-c388-41a9-9d35-f6c4aa77ed86") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:11.070134 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:11.070089    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq9sd\" (UniqueName: \"kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd\") pod \"network-check-target-69stk\" (UID: \"78b243a2-83e5-47a1-ba40-72c405e83077\") " pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:11.070372 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:11.070351    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:24:11.070457 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:11.070384    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:24:11.070457 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:11.070398    2567 projected.go:196] Error preparing data for projected volume kube-api-access-vq9sd for pod openshift-network-diagnostics/network-check-target-69stk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:11.070570 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:11.070530    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd podName:78b243a2-83e5-47a1-ba40-72c405e83077 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:15.070509651 +0000 UTC m=+10.276483785 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq9sd" (UniqueName: "kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd") pod "network-check-target-69stk" (UID: "78b243a2-83e5-47a1-ba40-72c405e83077") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:11.291060 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:11.290982    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:11.291521 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:11.291125    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:11.293962 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:11.290942    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:11.294105 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:11.294084    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:12.290747 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:12.290714    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:12.290943 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:12.290851    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:13.290267 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:13.290233    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:13.290839 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:13.290377    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:13.290839 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:13.290807    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:13.290976 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:13.290879    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:14.290195 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:14.290100    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:14.290355 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:14.290237    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:14.905854 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:14.905810    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs\") pod \"network-metrics-daemon-dtm6b\" (UID: \"e2990272-3824-4e47-9c86-367e50e46bfc\") " pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:14.906071 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:14.906053    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:14.906152 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:14.906131    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs podName:e2990272-3824-4e47-9c86-367e50e46bfc nodeName:}" failed. No retries permitted until 2026-07-07 14:24:22.906110609 +0000 UTC m=+18.112084733 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs") pod "network-metrics-daemon-dtm6b" (UID: "e2990272-3824-4e47-9c86-367e50e46bfc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:15.006913 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:15.006360    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret\") pod \"global-pull-secret-syncer-pr7wh\" (UID: \"b3a21f69-c388-41a9-9d35-f6c4aa77ed86\") " pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:15.006913 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:15.006496    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:15.006913 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:15.006563    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret podName:b3a21f69-c388-41a9-9d35-f6c4aa77ed86 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:23.006543991 +0000 UTC m=+18.212518100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret") pod "global-pull-secret-syncer-pr7wh" (UID: "b3a21f69-c388-41a9-9d35-f6c4aa77ed86") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:15.107760 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:15.107663    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq9sd\" (UniqueName: \"kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd\") pod \"network-check-target-69stk\" (UID: \"78b243a2-83e5-47a1-ba40-72c405e83077\") " pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:15.107945 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:15.107847    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:24:15.107945 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:15.107871    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:24:15.107945 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:15.107885    2567 projected.go:196] Error preparing data for projected volume kube-api-access-vq9sd for pod openshift-network-diagnostics/network-check-target-69stk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:15.108117 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:15.107949    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd podName:78b243a2-83e5-47a1-ba40-72c405e83077 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:23.107931067 +0000 UTC m=+18.313905193 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq9sd" (UniqueName: "kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd") pod "network-check-target-69stk" (UID: "78b243a2-83e5-47a1-ba40-72c405e83077") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:15.294064 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:15.293983    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:15.294506 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:15.294108    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:15.294871 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:15.294849    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:15.294985 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:15.294956    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:16.290963 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:16.290928    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:16.291156 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:16.291130    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:17.290895 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:17.290856    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:17.291364 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:17.291017    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:17.291364 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:17.291069    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:17.291364 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:17.291199    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:18.291181 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:18.290737    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:18.291181 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:18.290851    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:19.290775 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:19.290741    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:19.290944 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:19.290880    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:19.290944 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:19.290932    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:19.291076 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:19.291052    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:20.290313 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:20.290234    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:20.290715 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:20.290349    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:21.290911 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:21.290865    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:21.291375 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:21.290986    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:21.291375 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:21.291048    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:21.291375 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:21.291156    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:22.290094 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:22.290059    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:22.290259 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:22.290196    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:22.975028 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:22.974976    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs\") pod \"network-metrics-daemon-dtm6b\" (UID: \"e2990272-3824-4e47-9c86-367e50e46bfc\") " pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:22.975472 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:22.975159    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:22.975472 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:22.975242    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs podName:e2990272-3824-4e47-9c86-367e50e46bfc nodeName:}" failed. No retries permitted until 2026-07-07 14:24:38.975224666 +0000 UTC m=+34.181198777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs") pod "network-metrics-daemon-dtm6b" (UID: "e2990272-3824-4e47-9c86-367e50e46bfc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:23.076129 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:23.076084    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret\") pod \"global-pull-secret-syncer-pr7wh\" (UID: \"b3a21f69-c388-41a9-9d35-f6c4aa77ed86\") " pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:23.076312 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:23.076227    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:23.076312 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:23.076294    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret podName:b3a21f69-c388-41a9-9d35-f6c4aa77ed86 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:39.076276893 +0000 UTC m=+34.282251005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret") pod "global-pull-secret-syncer-pr7wh" (UID: "b3a21f69-c388-41a9-9d35-f6c4aa77ed86") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:23.177025 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:23.176983    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq9sd\" (UniqueName: \"kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd\") pod \"network-check-target-69stk\" (UID: \"78b243a2-83e5-47a1-ba40-72c405e83077\") " pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:23.177203 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:23.177178    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:24:23.177255 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:23.177210    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:24:23.177255 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:23.177227    2567 projected.go:196] Error preparing data for projected volume kube-api-access-vq9sd for pod openshift-network-diagnostics/network-check-target-69stk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:23.177324 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:23.177285    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd podName:78b243a2-83e5-47a1-ba40-72c405e83077 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:39.177271446 +0000 UTC m=+34.383245553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq9sd" (UniqueName: "kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd") pod "network-check-target-69stk" (UID: "78b243a2-83e5-47a1-ba40-72c405e83077") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:23.291533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:23.291014    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:23.291533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:23.291021    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:23.291533 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:23.291144    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:23.291533 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:23.291245    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:24.290573 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:24.290537    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:24.291005 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:24.290702    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:25.292306 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:25.292273    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:25.292789 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:25.292380    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:25.292789 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:25.292422    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:25.292789 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:25.292510    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:26.291108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:26.291048    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:26.291275 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:26.291195    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:27.290715 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:27.290680    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:27.291222 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:27.290690    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:27.291222 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:27.290818    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:27.291222 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:27.290911    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:28.290873 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:28.290843    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:28.291237 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:28.290947    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:29.290671 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.290329    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:29.290803 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.290390    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:29.290803 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:29.290753    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:29.290911 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:29.290816    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:29.414658 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.414628    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bctpc" event={"ID":"643b0708-d08d-425c-986e-da5ace735337","Type":"ContainerStarted","Data":"6c863c52303018c160722577eea6a770dcc2b0e451420a38d2c1a642831fe2ef"}
Jul 07 14:24:29.416035 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.416012    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5pgr7" event={"ID":"95a06780-deaf-4ca6-82b5-3040caf89229","Type":"ContainerStarted","Data":"4c3eed4f06430d0bb3aff84e5bf5fe78a96aebbcc6e6beb16718eaedd5593906"}
Jul 07 14:24:29.418774 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.418753    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg" event={"ID":"0485a5cf-bc99-4bea-8bdc-56670619a532","Type":"ContainerStarted","Data":"71ae7facc09280e55e04b9c28bf9609a021ce8cf08ba027d7a72e1872704d9ca"}
Jul 07 14:24:29.418847 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.418823    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg" event={"ID":"0485a5cf-bc99-4bea-8bdc-56670619a532","Type":"ContainerStarted","Data":"cd5bacc0d8ad981045b38552630307f37a186651f4a719096a859f0478ae046a"}
Jul 07 14:24:29.418911 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.418874    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg" event={"ID":"0485a5cf-bc99-4bea-8bdc-56670619a532","Type":"ContainerStarted","Data":"5b134111cfffb256e3f6cc2a22625f742e87e5b36a10f8203e5362502c05bfe3"}
Jul 07 14:24:29.418946 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.418921    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg" event={"ID":"0485a5cf-bc99-4bea-8bdc-56670619a532","Type":"ContainerStarted","Data":"89c51ab298aa8b43927e9fd2ae099f0da08fc28f379473e02cacc638a55d8b9f"}
Jul 07 14:24:29.418979 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.418966    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg" event={"ID":"0485a5cf-bc99-4bea-8bdc-56670619a532","Type":"ContainerStarted","Data":"738b9ab3ae8ffdf7def8a1ab0e9ed4ffe5af05b4c215558121595bd3d5442031"}
Jul 07 14:24:29.420165 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.420136    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8hz5f" event={"ID":"e9ea96a3-1a0f-4d57-86f3-c63c9f346229","Type":"ContainerStarted","Data":"1df32f4d85bd060a003e314bbae62521671cca4cc22f7e0d2fcd637265bce88e"}
Jul 07 14:24:29.421316 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.421295    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8f6xm" event={"ID":"00f603e4-c02e-408c-bcf0-2dbc2f1338cd","Type":"ContainerStarted","Data":"7909165066b2bf462902902bb17c6cc5b2d1762052a3f6634276ca66c36391a7"}
Jul 07 14:24:29.422777 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.422754    2567 generic.go:356] "Generic (PLEG): container finished" podID="9179849a-ab60-492b-84ea-ee5de2c4c1b5" containerID="564b7031b876e973f10017e8f92754106c635a281e2c38f03fd2b51fc08c6ee4" exitCode=0
Jul 07 14:24:29.422860 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.422819    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l47cj" event={"ID":"9179849a-ab60-492b-84ea-ee5de2c4c1b5","Type":"ContainerDied","Data":"564b7031b876e973f10017e8f92754106c635a281e2c38f03fd2b51fc08c6ee4"}
Jul 07 14:24:29.424122 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.424072    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49" event={"ID":"ebf4a235-1b85-46b3-9124-4edc7761d91b","Type":"ContainerStarted","Data":"42d5993080d4a03a62f52edafc9feea755906602e91460fccbe04783c1eb0d04"}
Jul 07 14:24:29.425447 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.425377    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lwnqf" event={"ID":"302a7403-a5f3-4749-92a3-05bcc8138f1a","Type":"ContainerStarted","Data":"edb369158beecd20d3949b7808880afbe44e99c013e5ab0ae9b9a1a5ee2e1698"}
Jul 07 14:24:29.438684 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.438640    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-48.ec2.internal" podStartSLOduration=23.438629191 podStartE2EDuration="23.438629191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:10.394573354 +0000 UTC m=+5.600547493" watchObservedRunningTime="2026-07-07 14:24:29.438629191 +0000 UTC m=+24.644603320"
Jul 07 14:24:29.467775 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.467732    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bctpc" podStartSLOduration=3.723608256 podStartE2EDuration="23.467717435s" totalImagesPullingTime="19.744109179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:29.438407739 +0000 UTC m=+24.644381869" watchObservedRunningTime="2026-07-07 14:24:29.467717435 +0000 UTC m=+24.673691563"
Jul 07 14:24:29.488914 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.488867    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5pgr7" podStartSLOduration=3.680650461 podStartE2EDuration="23.488852339s" totalImagesPullingTime="19.808201878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:29.488388931 +0000 UTC m=+24.694363061" watchObservedRunningTime="2026-07-07 14:24:29.488852339 +0000 UTC m=+24.694826467"
Jul 07 14:24:29.508603 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.508547    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8hz5f" podStartSLOduration=3.683271015 podStartE2EDuration="23.508531514s" totalImagesPullingTime="19.825260499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:29.508177999 +0000 UTC m=+24.714152129" watchObservedRunningTime="2026-07-07 14:24:29.508531514 +0000 UTC m=+24.714505684"
Jul 07 14:24:29.526261 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.525888    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8f6xm" podStartSLOduration=3.8014204769999997 podStartE2EDuration="23.52586812s" totalImagesPullingTime="19.724447643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:29.525840166 +0000 UTC m=+24.731814297" watchObservedRunningTime="2026-07-07 14:24:29.52586812 +0000 UTC m=+24.731842247"
Jul 07 14:24:29.542871 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.542830    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lwnqf" podStartSLOduration=3.734004425 podStartE2EDuration="23.542815636s" totalImagesPullingTime="19.808811211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:29.542293546 +0000 UTC m=+24.748267676" watchObservedRunningTime="2026-07-07 14:24:29.542815636 +0000 UTC m=+24.748789800"
Jul 07 14:24:29.990022 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:29.989997    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 14:24:30.279220 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:30.279089    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T14:24:29.990019821Z","UUID":"6f1325ed-10c3-4671-b1fe-6b73d669f7c6","Handler":null,"Name":"","Endpoint":""}
Jul 07 14:24:30.280517 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:30.280499    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 14:24:30.280630 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:30.280534    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 14:24:30.290091 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:30.290071    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:30.290183 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:30.290161    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:30.430307 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:30.430278    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg" event={"ID":"0485a5cf-bc99-4bea-8bdc-56670619a532","Type":"ContainerStarted","Data":"56987b5ab8e84259bb783eb4d41a89304985fb85b3eecc0f92f9ec948681d544"}
Jul 07 14:24:30.431563 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:30.431538    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jgsjh" event={"ID":"cc6cc446-e473-4326-a212-8bae1f733cbd","Type":"ContainerStarted","Data":"60bfdabe5a9ea0e720bbfd6bd4fd7c43aef2902c31572c366a22c83c60fda632"}
Jul 07 14:24:30.433350 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:30.433324    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49" event={"ID":"ebf4a235-1b85-46b3-9124-4edc7761d91b","Type":"ContainerStarted","Data":"8a2c9cb71efc06923cd4ed6ce12487ae805ddd300aca2da7911bca609692fd7f"}
Jul 07 14:24:30.453301 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:30.453262    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jgsjh" podStartSLOduration=4.635724253 podStartE2EDuration="24.453248435s" totalImagesPullingTime="19.817524182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:30.453018233 +0000 UTC m=+25.658992361" watchObservedRunningTime="2026-07-07 14:24:30.453248435 +0000 UTC m=+25.659222564"
Jul 07 14:24:30.949914 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:30.949682    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8f6xm"
Jul 07 14:24:30.950554 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:30.950534    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8f6xm"
Jul 07 14:24:31.290360 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:31.290273    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:31.290360 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:31.290325    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:31.290547 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:31.290413    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:31.290547 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:31.290502    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:31.437363 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:31.437330    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49" event={"ID":"ebf4a235-1b85-46b3-9124-4edc7761d91b","Type":"ContainerStarted","Data":"6366cdec66ae8e1ade63fee3852350cb575659a0bbb86493e195f6d2fe9db8d5"}
Jul 07 14:24:31.437841 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:31.437812    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8f6xm"
Jul 07 14:24:31.438018 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:31.438000    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8f6xm"
Jul 07 14:24:31.459668 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:31.459624    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnf49" podStartSLOduration=3.690336744 podStartE2EDuration="25.459610523s" totalImagesPullingTime="21.769273779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:31.459318918 +0000 UTC m=+26.665293043" watchObservedRunningTime="2026-07-07 14:24:31.459610523 +0000 UTC m=+26.665584652"
Jul 07 14:24:32.290950 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:32.290913    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:32.291186 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:32.291030    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:32.442362 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:32.442324    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg" event={"ID":"0485a5cf-bc99-4bea-8bdc-56670619a532","Type":"ContainerStarted","Data":"9d2f0d09bfa8f24c81980b7c4287adfce5fefd5ce5fa0b49bbda02c653759817"}
Jul 07 14:24:33.290639 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:33.290583    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:33.290809 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:33.290767    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:33.290894 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:33.290813    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:33.290962 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:33.290938    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:34.290211 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:34.290171    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:34.290861 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:34.290297    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:35.291858 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:35.291549    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:35.292285 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:35.291625    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:35.292285 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:35.291901    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:35.292285 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:35.291957    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:35.451001 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:35.450969    2567 generic.go:356] "Generic (PLEG): container finished" podID="9179849a-ab60-492b-84ea-ee5de2c4c1b5" containerID="b4f13352efb8bc8c947420871598749f769aa1781ab837ecd64c5a937954aca6" exitCode=0
Jul 07 14:24:35.451188 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:35.451051    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l47cj" event={"ID":"9179849a-ab60-492b-84ea-ee5de2c4c1b5","Type":"ContainerDied","Data":"b4f13352efb8bc8c947420871598749f769aa1781ab837ecd64c5a937954aca6"}
Jul 07 14:24:35.454762 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:35.454732    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg" event={"ID":"0485a5cf-bc99-4bea-8bdc-56670619a532","Type":"ContainerStarted","Data":"450c1ea9c966d74332a9e70ba47cc99fcaa860371f3c80659f90e3a53c709e34"}
Jul 07 14:24:35.454979 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:35.454963    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:35.455050 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:35.455028    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:35.471648 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:35.471616    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:35.510018 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:35.509971    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg" podStartSLOduration=9.330104816 podStartE2EDuration="29.509954585s" totalImagesPullingTime="20.179849769s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:35.509019417 +0000 UTC m=+30.714993573" watchObservedRunningTime="2026-07-07 14:24:35.509954585 +0000 UTC m=+30.715928713"
Jul 07 14:24:36.290237 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:36.290204    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:36.290480 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:36.290347    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:36.457377 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:36.457345    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:36.472611 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:36.472567    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:24:36.764931 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:36.764719    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pr7wh"]
Jul 07 14:24:36.765081 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:36.765055    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:36.765165 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:36.765144    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:36.766944 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:36.766922    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-69stk"]
Jul 07 14:24:36.767058 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:36.767006    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:36.767104 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:36.767070    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:36.769980 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:36.769956    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dtm6b"]
Jul 07 14:24:36.770096 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:36.770060    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:36.770162 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:36.770143    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:37.461716 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:37.461676    2567 generic.go:356] "Generic (PLEG): container finished" podID="9179849a-ab60-492b-84ea-ee5de2c4c1b5" containerID="d907c06790e1642aaad0a9820213ed67ee9a6690b4cfd39114aaeb483a1e9c32" exitCode=0
Jul 07 14:24:37.462195 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:37.461755    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l47cj" event={"ID":"9179849a-ab60-492b-84ea-ee5de2c4c1b5","Type":"ContainerDied","Data":"d907c06790e1642aaad0a9820213ed67ee9a6690b4cfd39114aaeb483a1e9c32"}
Jul 07 14:24:38.290923 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:38.290052    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:38.290923 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:38.290162    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:38.290923 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:38.290630    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:38.290923 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:38.290706    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:38.290923 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:38.290746    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:38.290923 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:38.290801    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:38.993644 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:38.993617    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs\") pod \"network-metrics-daemon-dtm6b\" (UID: \"e2990272-3824-4e47-9c86-367e50e46bfc\") " pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:38.994250 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:38.993763    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:38.994250 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:38.993830    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs podName:e2990272-3824-4e47-9c86-367e50e46bfc nodeName:}" failed. No retries permitted until 2026-07-07 14:25:10.993813493 +0000 UTC m=+66.199787616 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs") pod "network-metrics-daemon-dtm6b" (UID: "e2990272-3824-4e47-9c86-367e50e46bfc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 14:24:39.093948 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:39.093916    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret\") pod \"global-pull-secret-syncer-pr7wh\" (UID: \"b3a21f69-c388-41a9-9d35-f6c4aa77ed86\") " pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:39.094124 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:39.094060    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:39.094124 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:39.094120    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret podName:b3a21f69-c388-41a9-9d35-f6c4aa77ed86 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:11.094106224 +0000 UTC m=+66.300080335 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret") pod "global-pull-secret-syncer-pr7wh" (UID: "b3a21f69-c388-41a9-9d35-f6c4aa77ed86") : object "kube-system"/"original-pull-secret" not registered
Jul 07 14:24:39.194968 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:39.194933    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq9sd\" (UniqueName: \"kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd\") pod \"network-check-target-69stk\" (UID: \"78b243a2-83e5-47a1-ba40-72c405e83077\") " pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:39.195126 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:39.195044    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 14:24:39.195126 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:39.195059    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 14:24:39.195126 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:39.195069    2567 projected.go:196] Error preparing data for projected volume kube-api-access-vq9sd for pod openshift-network-diagnostics/network-check-target-69stk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:39.195126 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:39.195117    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd podName:78b243a2-83e5-47a1-ba40-72c405e83077 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:11.195105274 +0000 UTC m=+66.401079385 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vq9sd" (UniqueName: "kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd") pod "network-check-target-69stk" (UID: "78b243a2-83e5-47a1-ba40-72c405e83077") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 14:24:39.467676 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:39.467645    2567 generic.go:356] "Generic (PLEG): container finished" podID="9179849a-ab60-492b-84ea-ee5de2c4c1b5" containerID="78cd735b9af96a595ea0b2009dbfbd274d93183602ab017361533030dfc1d093" exitCode=0
Jul 07 14:24:39.467868 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:39.467689    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l47cj" event={"ID":"9179849a-ab60-492b-84ea-ee5de2c4c1b5","Type":"ContainerDied","Data":"78cd735b9af96a595ea0b2009dbfbd274d93183602ab017361533030dfc1d093"}
Jul 07 14:24:40.290742 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:40.290705    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:40.290742 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:40.290741    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:40.291194 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:40.290724    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:40.291194 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:40.290834    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:40.291194 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:40.290923    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:40.291194 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:40.291015    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:42.290819 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.290318    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:42.290819 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.290351    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:42.290819 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.290326    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:42.290819 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:42.290478    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pr7wh" podUID="b3a21f69-c388-41a9-9d35-f6c4aa77ed86"
Jul 07 14:24:42.290819 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:42.290523    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtm6b" podUID="e2990272-3824-4e47-9c86-367e50e46bfc"
Jul 07 14:24:42.290819 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:42.290636    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-69stk" podUID="78b243a2-83e5-47a1-ba40-72c405e83077"
Jul 07 14:24:42.598693 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.598615    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-48.ec2.internal" event="NodeReady"
Jul 07 14:24:42.598854 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.598775    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 14:24:42.636763 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.636729    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7754b6d44-2jjsn"]
Jul 07 14:24:42.653214 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.653185    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lzhnd"]
Jul 07 14:24:42.653452 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.653320    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.656061 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.656038    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5f4rp\""
Jul 07 14:24:42.656285 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.656269    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 14:24:42.656445 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.656425    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 14:24:42.657107 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.657082    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 14:24:42.666650 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.666627    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 14:24:42.667016 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.666975    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7754b6d44-2jjsn"]
Jul 07 14:24:42.667016 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.667010    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s48x2"]
Jul 07 14:24:42.667122 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.667103    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:42.671955 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.671935    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 14:24:42.672079 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.671973    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 14:24:42.672244 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.671976    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-82rv6\""
Jul 07 14:24:42.687106 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.687077    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lzhnd"]
Jul 07 14:24:42.687226 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.687128    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s48x2"]
Jul 07 14:24:42.687226 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.687190    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s48x2"
Jul 07 14:24:42.690276 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.690256    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 14:24:42.690382 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.690316    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fpbkf\""
Jul 07 14:24:42.690382 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.690335    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 14:24:42.690666 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.690652    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 14:24:42.818330 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.818296    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfk8k\" (UniqueName: \"kubernetes.io/projected/c3570076-b2c5-4087-819a-412ab7f410df-kube-api-access-nfk8k\") pod \"ingress-canary-s48x2\" (UID: \"c3570076-b2c5-4087-819a-412ab7f410df\") " pod="openshift-ingress-canary/ingress-canary-s48x2"
Jul 07 14:24:42.818330 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.818336    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e6b77cc-7d10-449a-ae8e-553340a879a1-image-registry-private-configuration\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.818554 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.818374    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e6b77cc-7d10-449a-ae8e-553340a879a1-trusted-ca\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.818554 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.818391    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3570076-b2c5-4087-819a-412ab7f410df-cert\") pod \"ingress-canary-s48x2\" (UID: \"c3570076-b2c5-4087-819a-412ab7f410df\") " pod="openshift-ingress-canary/ingress-canary-s48x2"
Jul 07 14:24:42.818554 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.818416    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:42.818554 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.818484    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr5c6\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-kube-api-access-rr5c6\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.818554 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.818519    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-certificates\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.818554 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.818541    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/48d7352c-0608-4b17-aecf-ff2cf067b5fd-config-volume\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:42.818896 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.818568    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e6b77cc-7d10-449a-ae8e-553340a879a1-ca-trust-extracted\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.818896 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.818583    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48d7352c-0608-4b17-aecf-ff2cf067b5fd-tmp-dir\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:42.818896 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.818658    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-bound-sa-token\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.818896 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.818743    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e6b77cc-7d10-449a-ae8e-553340a879a1-installation-pull-secrets\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.818896 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.818775    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bldkm\" (UniqueName: \"kubernetes.io/projected/48d7352c-0608-4b17-aecf-ff2cf067b5fd-kube-api-access-bldkm\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:42.818896 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.818804    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.862468 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.862382    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:42.919443 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.919413    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e6b77cc-7d10-449a-ae8e-553340a879a1-installation-pull-secrets\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.919626 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.919455    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bldkm\" (UniqueName: \"kubernetes.io/projected/48d7352c-0608-4b17-aecf-ff2cf067b5fd-kube-api-access-bldkm\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:42.919626 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.919489    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.919626 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.919525    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfk8k\" (UniqueName: \"kubernetes.io/projected/c3570076-b2c5-4087-819a-412ab7f410df-kube-api-access-nfk8k\") pod \"ingress-canary-s48x2\" (UID: \"c3570076-b2c5-4087-819a-412ab7f410df\") " pod="openshift-ingress-canary/ingress-canary-s48x2"
Jul 07 14:24:42.919626 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.919552    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e6b77cc-7d10-449a-ae8e-553340a879a1-image-registry-private-configuration\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.919626 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.919621    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e6b77cc-7d10-449a-ae8e-553340a879a1-trusted-ca\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.919882 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.919642    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3570076-b2c5-4087-819a-412ab7f410df-cert\") pod \"ingress-canary-s48x2\" (UID: \"c3570076-b2c5-4087-819a-412ab7f410df\") " pod="openshift-ingress-canary/ingress-canary-s48x2"
Jul 07 14:24:42.919882 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.919663    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:42.919882 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:42.919677    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 14:24:42.919882 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.919689    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr5c6\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-kube-api-access-rr5c6\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.919882 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:42.919695    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7754b6d44-2jjsn: secret "image-registry-tls" not found
Jul 07 14:24:42.919882 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:42.919775    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls podName:4e6b77cc-7d10-449a-ae8e-553340a879a1 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:43.419755514 +0000 UTC m=+38.625729620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls") pod "image-registry-7754b6d44-2jjsn" (UID: "4e6b77cc-7d10-449a-ae8e-553340a879a1") : secret "image-registry-tls" not found
Jul 07 14:24:42.920382 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.920352    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-certificates\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.920508 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.920395    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/48d7352c-0608-4b17-aecf-ff2cf067b5fd-config-volume\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:42.920508 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.920428    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e6b77cc-7d10-449a-ae8e-553340a879a1-ca-trust-extracted\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.920508 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:42.920431    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:24:42.920508 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:42.920501    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls podName:48d7352c-0608-4b17-aecf-ff2cf067b5fd nodeName:}" failed. No retries permitted until 2026-07-07 14:24:43.420482238 +0000 UTC m=+38.626456367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls") pod "dns-default-lzhnd" (UID: "48d7352c-0608-4b17-aecf-ff2cf067b5fd") : secret "dns-default-metrics-tls" not found
Jul 07 14:24:42.920748 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.920679    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e6b77cc-7d10-449a-ae8e-553340a879a1-trusted-ca\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.920805 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.920790    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e6b77cc-7d10-449a-ae8e-553340a879a1-ca-trust-extracted\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.920865 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.920835    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48d7352c-0608-4b17-aecf-ff2cf067b5fd-tmp-dir\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:42.920919 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.920867    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-bound-sa-token\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.920998 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.920974    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/48d7352c-0608-4b17-aecf-ff2cf067b5fd-config-volume\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:42.921173 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.921154    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-certificates\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.921252 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.921198    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48d7352c-0608-4b17-aecf-ff2cf067b5fd-tmp-dir\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:42.924212 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.924188    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e6b77cc-7d10-449a-ae8e-553340a879a1-image-registry-private-configuration\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.924212 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.924200    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3570076-b2c5-4087-819a-412ab7f410df-cert\") pod \"ingress-canary-s48x2\" (UID: \"c3570076-b2c5-4087-819a-412ab7f410df\") " pod="openshift-ingress-canary/ingress-canary-s48x2"
Jul 07 14:24:42.924520 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.924497    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e6b77cc-7d10-449a-ae8e-553340a879a1-installation-pull-secrets\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.933319 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.933295    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr5c6\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-kube-api-access-rr5c6\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.935686 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.935665    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfk8k\" (UniqueName: \"kubernetes.io/projected/c3570076-b2c5-4087-819a-412ab7f410df-kube-api-access-nfk8k\") pod \"ingress-canary-s48x2\" (UID: \"c3570076-b2c5-4087-819a-412ab7f410df\") " pod="openshift-ingress-canary/ingress-canary-s48x2"
Jul 07 14:24:42.938211 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.938178    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bldkm\" (UniqueName: \"kubernetes.io/projected/48d7352c-0608-4b17-aecf-ff2cf067b5fd-kube-api-access-bldkm\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:42.939957 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.939936    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-bound-sa-token\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:42.953436 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.953412    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:42.997527 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:42.997482    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s48x2"
Jul 07 14:24:43.186955 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:43.186784    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s48x2"]
Jul 07 14:24:43.425012 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:43.424980    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:43.425479 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:43.425050    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:43.425479 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:43.425159    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 14:24:43.425479 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:43.425191    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7754b6d44-2jjsn: secret "image-registry-tls" not found
Jul 07 14:24:43.425479 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:43.425257    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls podName:4e6b77cc-7d10-449a-ae8e-553340a879a1 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:44.425235075 +0000 UTC m=+39.631209195 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls") pod "image-registry-7754b6d44-2jjsn" (UID: "4e6b77cc-7d10-449a-ae8e-553340a879a1") : secret "image-registry-tls" not found
Jul 07 14:24:43.425479 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:43.425166    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:24:43.425479 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:43.425312    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls podName:48d7352c-0608-4b17-aecf-ff2cf067b5fd nodeName:}" failed. No retries permitted until 2026-07-07 14:24:44.425298272 +0000 UTC m=+39.631272378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls") pod "dns-default-lzhnd" (UID: "48d7352c-0608-4b17-aecf-ff2cf067b5fd") : secret "dns-default-metrics-tls" not found
Jul 07 14:24:44.290570 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:44.290533    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:24:44.290570 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:44.290559    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:24:44.290863 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:44.290532    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:24:44.295374 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:44.295001    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 14:24:44.295374 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:44.295063    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rzdvx\""
Jul 07 14:24:44.295374 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:44.295001    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 14:24:44.295374 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:44.295003    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p9bwj\""
Jul 07 14:24:44.295374 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:44.295064    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 14:24:44.295374 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:44.295001    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 14:24:44.434018 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:44.433983    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:44.434459 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:44.434052    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:44.434459 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:44.434142    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:24:44.434459 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:44.434141    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 14:24:44.434459 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:44.434169    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7754b6d44-2jjsn: secret "image-registry-tls" not found
Jul 07 14:24:44.434459 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:44.434216    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls podName:48d7352c-0608-4b17-aecf-ff2cf067b5fd nodeName:}" failed. No retries permitted until 2026-07-07 14:24:46.434195991 +0000 UTC m=+41.640170098 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls") pod "dns-default-lzhnd" (UID: "48d7352c-0608-4b17-aecf-ff2cf067b5fd") : secret "dns-default-metrics-tls" not found
Jul 07 14:24:44.434459 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:44.434231    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls podName:4e6b77cc-7d10-449a-ae8e-553340a879a1 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:46.434225488 +0000 UTC m=+41.640199595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls") pod "image-registry-7754b6d44-2jjsn" (UID: "4e6b77cc-7d10-449a-ae8e-553340a879a1") : secret "image-registry-tls" not found
Jul 07 14:24:44.716036 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:44.716005    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3570076_b2c5_4087_819a_412ab7f410df.slice/crio-6aeb1b9079f9ec2bb1e478348c735140393e3f30eb03258e0b600d6fe864dc08 WatchSource:0}: Error finding container 6aeb1b9079f9ec2bb1e478348c735140393e3f30eb03258e0b600d6fe864dc08: Status 404 returned error can't find the container with id 6aeb1b9079f9ec2bb1e478348c735140393e3f30eb03258e0b600d6fe864dc08
Jul 07 14:24:45.485551 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:45.485505    2567 generic.go:356] "Generic (PLEG): container finished" podID="9179849a-ab60-492b-84ea-ee5de2c4c1b5" containerID="c23d4f7dd919d4bbd9dad089fe3e1668907769be155275c7e199793d7685edaa" exitCode=0
Jul 07 14:24:45.485551 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:45.485547    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l47cj" event={"ID":"9179849a-ab60-492b-84ea-ee5de2c4c1b5","Type":"ContainerDied","Data":"c23d4f7dd919d4bbd9dad089fe3e1668907769be155275c7e199793d7685edaa"}
Jul 07 14:24:45.487784 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:45.487753    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s48x2" event={"ID":"c3570076-b2c5-4087-819a-412ab7f410df","Type":"ContainerStarted","Data":"6aeb1b9079f9ec2bb1e478348c735140393e3f30eb03258e0b600d6fe864dc08"}
Jul 07 14:24:46.451915 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:46.451873    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:46.452112 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:46.451964    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:46.452112 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:46.452009    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 14:24:46.452112 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:46.452028    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7754b6d44-2jjsn: secret "image-registry-tls" not found
Jul 07 14:24:46.452112 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:46.452064    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:24:46.452112 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:46.452098    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls podName:4e6b77cc-7d10-449a-ae8e-553340a879a1 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:50.452078492 +0000 UTC m=+45.658052619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls") pod "image-registry-7754b6d44-2jjsn" (UID: "4e6b77cc-7d10-449a-ae8e-553340a879a1") : secret "image-registry-tls" not found
Jul 07 14:24:46.452112 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:46.452115    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls podName:48d7352c-0608-4b17-aecf-ff2cf067b5fd nodeName:}" failed. No retries permitted until 2026-07-07 14:24:50.45210787 +0000 UTC m=+45.658081977 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls") pod "dns-default-lzhnd" (UID: "48d7352c-0608-4b17-aecf-ff2cf067b5fd") : secret "dns-default-metrics-tls" not found
Jul 07 14:24:46.493682 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:46.493649    2567 generic.go:356] "Generic (PLEG): container finished" podID="9179849a-ab60-492b-84ea-ee5de2c4c1b5" containerID="a575e1f26f19790c30495fe878cc52687dcfb26621ed417bd2f21eab9ccb2bdb" exitCode=0
Jul 07 14:24:46.494067 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:46.493697    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l47cj" event={"ID":"9179849a-ab60-492b-84ea-ee5de2c4c1b5","Type":"ContainerDied","Data":"a575e1f26f19790c30495fe878cc52687dcfb26621ed417bd2f21eab9ccb2bdb"}
Jul 07 14:24:47.034976 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:47.034938    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:47.137262 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:47.137218    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:47.497893 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:47.497801    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s48x2" event={"ID":"c3570076-b2c5-4087-819a-412ab7f410df","Type":"ContainerStarted","Data":"e5a80894b904e86de3996752c1e7212bb4c9de9ac09637affcea3cf0fe1c2c77"}
Jul 07 14:24:47.502521 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:47.502487    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l47cj" event={"ID":"9179849a-ab60-492b-84ea-ee5de2c4c1b5","Type":"ContainerStarted","Data":"eb870670bd8d7ce8550ce4165c080c7a58799af7766ed2cd81dd620a29f09d58"}
Jul 07 14:24:47.518501 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:47.518451    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s48x2" podStartSLOduration=3.037970768 podStartE2EDuration="5.518436155s" totalImagesPullingTime="2.480465387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:47.518269841 +0000 UTC m=+42.724243984" watchObservedRunningTime="2026-07-07 14:24:47.518436155 +0000 UTC m=+42.724410283"
Jul 07 14:24:47.547036 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:47.546967    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l47cj" podStartSLOduration=8.777556072 podStartE2EDuration="41.546946809s" totalImagesPullingTime="32.769390737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:47.546345126 +0000 UTC m=+42.752319249" watchObservedRunningTime="2026-07-07 14:24:47.546946809 +0000 UTC m=+42.752920939"
Jul 07 14:24:47.691880 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:47.691840    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:47.792794 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:47.792704    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:47.892638 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:47.892575    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:50.481634 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:50.481566    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:50.482066 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:50.481654    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:50.482066 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:50.481719    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 14:24:50.482066 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:50.481740    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7754b6d44-2jjsn: secret "image-registry-tls" not found
Jul 07 14:24:50.482066 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:50.481742    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:24:50.482066 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:50.481796    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls podName:48d7352c-0608-4b17-aecf-ff2cf067b5fd nodeName:}" failed. No retries permitted until 2026-07-07 14:24:58.481781166 +0000 UTC m=+53.687755273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls") pod "dns-default-lzhnd" (UID: "48d7352c-0608-4b17-aecf-ff2cf067b5fd") : secret "dns-default-metrics-tls" not found
Jul 07 14:24:50.482066 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:50.481827    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls podName:4e6b77cc-7d10-449a-ae8e-553340a879a1 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:58.481804458 +0000 UTC m=+53.687778584 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls") pod "image-registry-7754b6d44-2jjsn" (UID: "4e6b77cc-7d10-449a-ae8e-553340a879a1") : secret "image-registry-tls" not found
Jul 07 14:24:51.790881 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.790846    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:51.841242 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.841206    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-btm8c"]
Jul 07 14:24:51.860104 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.860070    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-btm8c"]
Jul 07 14:24:51.860266 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.860183    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-btm8c"
Jul 07 14:24:51.863009 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.862980    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 07 14:24:51.863957 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.863934    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:51.864086 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.864065    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:24:51.864154 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.864093    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9xwcp\""
Jul 07 14:24:51.899739 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.899707    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-85qbn"]
Jul 07 14:24:51.904299 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.904260    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"]
Jul 07 14:24:51.904449 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.904407    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-85qbn"
Jul 07 14:24:51.907345 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.907305    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-kkgdx\""
Jul 07 14:24:51.907496 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.907477    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-m4684"]
Jul 07 14:24:51.907639 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.907613    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:24:51.910372 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.910352    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 07 14:24:51.911700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.911674    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 14:24:51.911819 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.911681    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 14:24:51.912032 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.911851    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 07 14:24:51.912115 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.912098    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z"]
Jul 07 14:24:51.912347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.912106    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2trxq\""
Jul 07 14:24:51.912962 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.912483    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:51.915288 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.915266    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 07 14:24:51.915520 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.915501    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 14:24:51.915697 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.915537    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 14:24:51.915757 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.915735    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6tsgj\""
Jul 07 14:24:51.915757 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.915741    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 07 14:24:51.920561 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.920540    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 07 14:24:51.927044 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.927015    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5df69cc7c9-xdxbd"]
Jul 07 14:24:51.927918 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.927892    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z"
Jul 07 14:24:51.930638 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.930572    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 07 14:24:51.930889 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.930870    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vct9l\""
Jul 07 14:24:51.931002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.930900    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:24:51.931237 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.931220    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 07 14:24:51.936664 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.936643    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-85qbn"]
Jul 07 14:24:51.936763 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.936676    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"]
Jul 07 14:24:51.936763 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.936693    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-m4684"]
Jul 07 14:24:51.936763 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.936706    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z"]
Jul 07 14:24:51.936763 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.936730    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5df69cc7c9-xdxbd"]
Jul 07 14:24:51.936763 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.936758    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:51.939294 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.939276    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 14:24:51.939430 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.939303    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 14:24:51.939691 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.939677    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bml9j\""
Jul 07 14:24:51.939780 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.939767    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 14:24:51.939825 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.939775    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 14:24:51.939860 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.939846    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 14:24:51.939899 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.939860    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 14:24:51.943965 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.943906    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:51.992269 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:51.992237    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhwnh\" (UniqueName: \"kubernetes.io/projected/8a8c4c65-4c6f-4780-a9af-e0501ba8ae27-kube-api-access-xhwnh\") pod \"volume-data-source-validator-5d456fdbcd-btm8c\" (UID: \"8a8c4c65-4c6f-4780-a9af-e0501ba8ae27\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-btm8c"
Jul 07 14:24:52.004133 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.004099    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv"]
Jul 07 14:24:52.016057 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.016036    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-wsdv5"]
Jul 07 14:24:52.016214 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.016157    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv"
Jul 07 14:24:52.018902 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.018853    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 07 14:24:52.019855 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.019834    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-krqkt\""
Jul 07 14:24:52.019979 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.019925    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 07 14:24:52.020038 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.019975    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 07 14:24:52.020038 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.019925    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:24:52.026273 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.026255    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-wsdv5"]
Jul 07 14:24:52.026377 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.026280    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv"]
Jul 07 14:24:52.026377 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.026363    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:24:52.029213 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.029196    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 07 14:24:52.029325 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.029247    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 07 14:24:52.029325 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.029304    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:24:52.029446 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.029349    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 07 14:24:52.029446 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.029383    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hnf9t\""
Jul 07 14:24:52.034668 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.034651    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 07 14:24:52.093347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093260    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kfp8s\" (UID: \"51ff0204-46fd-46b7-bd27-4a28a0683ae4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:24:52.093347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093298    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-stats-auth\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:52.093347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093322    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/246e477f-d040-4356-a575-f78f652b6192-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.093347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093343    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:52.093627 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093392    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/246e477f-d040-4356-a575-f78f652b6192-snapshots\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.093627 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093449    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/246e477f-d040-4356-a575-f78f652b6192-serving-cert\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.093627 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093508    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wtfs\" (UniqueName: \"kubernetes.io/projected/af38995e-857b-4418-ad86-18cb186dc0e8-kube-api-access-2wtfs\") pod \"network-check-source-989f8b8dc-85qbn\" (UID: \"af38995e-857b-4418-ad86-18cb186dc0e8\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-85qbn"
Jul 07 14:24:52.093627 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093543    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhwnh\" (UniqueName: \"kubernetes.io/projected/8a8c4c65-4c6f-4780-a9af-e0501ba8ae27-kube-api-access-xhwnh\") pod \"volume-data-source-validator-5d456fdbcd-btm8c\" (UID: \"8a8c4c65-4c6f-4780-a9af-e0501ba8ae27\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-btm8c"
Jul 07 14:24:52.093627 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093563    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfvzh\" (UniqueName: \"kubernetes.io/projected/ec46e625-a505-4243-97cd-b319c114f668-kube-api-access-rfvzh\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:52.093627 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093607    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/51ff0204-46fd-46b7-bd27-4a28a0683ae4-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-kfp8s\" (UID: \"51ff0204-46fd-46b7-bd27-4a28a0683ae4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:24:52.093846 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093646    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bxw8z\" (UID: \"8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z"
Jul 07 14:24:52.093846 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093674    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:52.093846 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093692    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbg5n\" (UniqueName: \"kubernetes.io/projected/246e477f-d040-4356-a575-f78f652b6192-kube-api-access-kbg5n\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.093846 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093712    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm2zh\" (UniqueName: \"kubernetes.io/projected/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-kube-api-access-gm2zh\") pod \"cluster-samples-operator-56fcf86bf-bxw8z\" (UID: \"8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z"
Jul 07 14:24:52.093846 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093735    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/246e477f-d040-4356-a575-f78f652b6192-tmp\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.093846 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093774    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-default-certificate\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:52.094021 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093844    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/246e477f-d040-4356-a575-f78f652b6192-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.094021 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.093884    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-259x8\" (UniqueName: \"kubernetes.io/projected/51ff0204-46fd-46b7-bd27-4a28a0683ae4-kube-api-access-259x8\") pod \"cluster-monitoring-operator-64786d9cbb-kfp8s\" (UID: \"51ff0204-46fd-46b7-bd27-4a28a0683ae4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:24:52.099709 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.099689    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf"]
Jul 07 14:24:52.110582 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.110551    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:52.111720 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.111695    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhwnh\" (UniqueName: \"kubernetes.io/projected/8a8c4c65-4c6f-4780-a9af-e0501ba8ae27-kube-api-access-xhwnh\") pod \"volume-data-source-validator-5d456fdbcd-btm8c\" (UID: \"8a8c4c65-4c6f-4780-a9af-e0501ba8ae27\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-btm8c"
Jul 07 14:24:52.132887 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.132857    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf"]
Jul 07 14:24:52.133035 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.132972    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf"
Jul 07 14:24:52.135742 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.135714    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 14:24:52.135742 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.135739    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ph97z\""
Jul 07 14:24:52.135899 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.135861    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 14:24:52.135963 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.135948    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 14:24:52.136390 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.136375    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 14:24:52.169637 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.169608    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-btm8c"
Jul 07 14:24:52.178442 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.178400    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:52.195167 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.195137    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/246e477f-d040-4356-a575-f78f652b6192-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.195292 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.195177    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-259x8\" (UniqueName: \"kubernetes.io/projected/51ff0204-46fd-46b7-bd27-4a28a0683ae4-kube-api-access-259x8\") pod \"cluster-monitoring-operator-64786d9cbb-kfp8s\" (UID: \"51ff0204-46fd-46b7-bd27-4a28a0683ae4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:24:52.195292 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.195225    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/feff296c-ca8b-401c-840d-819465005d5d-config\") pod \"console-operator-68b757fb67-wsdv5\" (UID: \"feff296c-ca8b-401c-840d-819465005d5d\") " pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:24:52.195292 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.195255    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kfp8s\" (UID: \"51ff0204-46fd-46b7-bd27-4a28a0683ae4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:24:52.195450 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.195295    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-stats-auth\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:52.195450 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.195319    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/246e477f-d040-4356-a575-f78f652b6192-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.195450 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.195344    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:52.195450 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.195368    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/246e477f-d040-4356-a575-f78f652b6192-snapshots\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.195450 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.195392    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ee660c9-2199-46ff-96b4-bf0e99a0cdfc-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-rx5vv\" (UID: \"6ee660c9-2199-46ff-96b4-bf0e99a0cdfc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv"
Jul 07 14:24:52.195450 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.195419    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/feff296c-ca8b-401c-840d-819465005d5d-trusted-ca\") pod \"console-operator-68b757fb67-wsdv5\" (UID: \"feff296c-ca8b-401c-840d-819465005d5d\") " pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:24:52.195450 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.195445    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/246e477f-d040-4356-a575-f78f652b6192-serving-cert\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.195819 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:52.195675    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 14:24:52.196071 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:52.196050    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls podName:51ff0204-46fd-46b7-bd27-4a28a0683ae4 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:52.696022893 +0000 UTC m=+47.901997014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kfp8s" (UID: "51ff0204-46fd-46b7-bd27-4a28a0683ae4") : secret "cluster-monitoring-operator-tls" not found
Jul 07 14:24:52.196174 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.196063    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ee660c9-2199-46ff-96b4-bf0e99a0cdfc-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-rx5vv\" (UID: \"6ee660c9-2199-46ff-96b4-bf0e99a0cdfc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv"
Jul 07 14:24:52.196292 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.196276    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wtfs\" (UniqueName: \"kubernetes.io/projected/af38995e-857b-4418-ad86-18cb186dc0e8-kube-api-access-2wtfs\") pod \"network-check-source-989f8b8dc-85qbn\" (UID: \"af38995e-857b-4418-ad86-18cb186dc0e8\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-85qbn"
Jul 07 14:24:52.196424 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.196408    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfvzh\" (UniqueName: \"kubernetes.io/projected/ec46e625-a505-4243-97cd-b319c114f668-kube-api-access-rfvzh\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:52.198568 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.196811    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/51ff0204-46fd-46b7-bd27-4a28a0683ae4-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-kfp8s\" (UID: \"51ff0204-46fd-46b7-bd27-4a28a0683ae4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:24:52.198568 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.196897    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bxw8z\" (UID: \"8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z"
Jul 07 14:24:52.198568 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.197089    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tkfb\" (UniqueName: \"kubernetes.io/projected/feff296c-ca8b-401c-840d-819465005d5d-kube-api-access-5tkfb\") pod \"console-operator-68b757fb67-wsdv5\" (UID: \"feff296c-ca8b-401c-840d-819465005d5d\") " pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:24:52.198568 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:52.197148    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 14:24:52.198568 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:52.197213    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs podName:ec46e625-a505-4243-97cd-b319c114f668 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:52.697195242 +0000 UTC m=+47.903169370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs") pod "router-default-5df69cc7c9-xdxbd" (UID: "ec46e625-a505-4243-97cd-b319c114f668") : secret "router-metrics-certs-default" not found
Jul 07 14:24:52.198568 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.197302    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:52.198568 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.197341    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbg5n\" (UniqueName: \"kubernetes.io/projected/246e477f-d040-4356-a575-f78f652b6192-kube-api-access-kbg5n\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.198568 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.197375    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/feff296c-ca8b-401c-840d-819465005d5d-serving-cert\") pod \"console-operator-68b757fb67-wsdv5\" (UID: \"feff296c-ca8b-401c-840d-819465005d5d\") " pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:24:52.198568 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.197412    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm2zh\" (UniqueName: \"kubernetes.io/projected/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-kube-api-access-gm2zh\") pod \"cluster-samples-operator-56fcf86bf-bxw8z\" (UID: \"8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z"
Jul 07 14:24:52.198568 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:52.197433    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 14:24:52.198568 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:52.197491    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls podName:8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:52.697474926 +0000 UTC m=+47.903449033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bxw8z" (UID: "8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033") : secret "samples-operator-tls" not found
Jul 07 14:24:52.198568 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.197550    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m5qm\" (UniqueName: \"kubernetes.io/projected/6ee660c9-2199-46ff-96b4-bf0e99a0cdfc-kube-api-access-5m5qm\") pod \"kube-storage-version-migrator-operator-846bf668f7-rx5vv\" (UID: \"6ee660c9-2199-46ff-96b4-bf0e99a0cdfc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv"
Jul 07 14:24:52.198568 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:52.197664    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle podName:ec46e625-a505-4243-97cd-b319c114f668 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:52.697648044 +0000 UTC m=+47.903622169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle") pod "router-default-5df69cc7c9-xdxbd" (UID: "ec46e625-a505-4243-97cd-b319c114f668") : configmap references non-existent config key: service-ca.crt
Jul 07 14:24:52.198568 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.196287    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/246e477f-d040-4356-a575-f78f652b6192-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.199338 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.197719    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/246e477f-d040-4356-a575-f78f652b6192-tmp\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.199338 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.197760    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-default-certificate\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:52.199338 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.198745    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/246e477f-d040-4356-a575-f78f652b6192-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.199338 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.198892    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/51ff0204-46fd-46b7-bd27-4a28a0683ae4-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-kfp8s\" (UID: \"51ff0204-46fd-46b7-bd27-4a28a0683ae4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:24:52.203113 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.203084    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/246e477f-d040-4356-a575-f78f652b6192-serving-cert\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.203732 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.203704    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/246e477f-d040-4356-a575-f78f652b6192-tmp\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.203883 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.203861    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-stats-auth\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:52.203952 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.203915    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/246e477f-d040-4356-a575-f78f652b6192-snapshots\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.204957 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.204936    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-default-certificate\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:52.207341 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.207317    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-259x8\" (UniqueName: \"kubernetes.io/projected/51ff0204-46fd-46b7-bd27-4a28a0683ae4-kube-api-access-259x8\") pod \"cluster-monitoring-operator-64786d9cbb-kfp8s\" (UID: \"51ff0204-46fd-46b7-bd27-4a28a0683ae4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:24:52.208486 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.208451    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfvzh\" (UniqueName: \"kubernetes.io/projected/ec46e625-a505-4243-97cd-b319c114f668-kube-api-access-rfvzh\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:52.209684 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.209659    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbg5n\" (UniqueName: \"kubernetes.io/projected/246e477f-d040-4356-a575-f78f652b6192-kube-api-access-kbg5n\") pod \"insights-operator-5c847dcfc4-m4684\" (UID: \"246e477f-d040-4356-a575-f78f652b6192\") " pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.210757 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.210711    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm2zh\" (UniqueName: \"kubernetes.io/projected/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-kube-api-access-gm2zh\") pod \"cluster-samples-operator-56fcf86bf-bxw8z\" (UID: \"8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z"
Jul 07 14:24:52.211458 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.211434    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wtfs\" (UniqueName: \"kubernetes.io/projected/af38995e-857b-4418-ad86-18cb186dc0e8-kube-api-access-2wtfs\") pod \"network-check-source-989f8b8dc-85qbn\" (UID: \"af38995e-857b-4418-ad86-18cb186dc0e8\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-85qbn"
Jul 07 14:24:52.216418 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.216385    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-85qbn"
Jul 07 14:24:52.235066 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.235031    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-m4684"
Jul 07 14:24:52.298480 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.298439    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/feff296c-ca8b-401c-840d-819465005d5d-serving-cert\") pod \"console-operator-68b757fb67-wsdv5\" (UID: \"feff296c-ca8b-401c-840d-819465005d5d\") " pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:24:52.298670 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.298514    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m5qm\" (UniqueName: \"kubernetes.io/projected/6ee660c9-2199-46ff-96b4-bf0e99a0cdfc-kube-api-access-5m5qm\") pod \"kube-storage-version-migrator-operator-846bf668f7-rx5vv\" (UID: \"6ee660c9-2199-46ff-96b4-bf0e99a0cdfc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv"
Jul 07 14:24:52.298670 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.298566    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/feff296c-ca8b-401c-840d-819465005d5d-config\") pod \"console-operator-68b757fb67-wsdv5\" (UID: \"feff296c-ca8b-401c-840d-819465005d5d\") " pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:24:52.298670 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.298616    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8lkh\" (UniqueName: \"kubernetes.io/projected/f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2-kube-api-access-l8lkh\") pod \"service-ca-operator-5d46d9ffd4-7vdvf\" (UID: \"f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf"
Jul 07 14:24:52.298854 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.298676    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ee660c9-2199-46ff-96b4-bf0e99a0cdfc-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-rx5vv\" (UID: \"6ee660c9-2199-46ff-96b4-bf0e99a0cdfc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv"
Jul 07 14:24:52.298854 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.298701    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/feff296c-ca8b-401c-840d-819465005d5d-trusted-ca\") pod \"console-operator-68b757fb67-wsdv5\" (UID: \"feff296c-ca8b-401c-840d-819465005d5d\") " pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:24:52.298854 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.298722    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2-config\") pod \"service-ca-operator-5d46d9ffd4-7vdvf\" (UID: \"f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf"
Jul 07 14:24:52.298854 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.298772    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ee660c9-2199-46ff-96b4-bf0e99a0cdfc-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-rx5vv\" (UID: \"6ee660c9-2199-46ff-96b4-bf0e99a0cdfc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv"
Jul 07 14:24:52.299049 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.298855    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tkfb\" (UniqueName: \"kubernetes.io/projected/feff296c-ca8b-401c-840d-819465005d5d-kube-api-access-5tkfb\") pod \"console-operator-68b757fb67-wsdv5\" (UID: \"feff296c-ca8b-401c-840d-819465005d5d\") " pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:24:52.299049 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.298889    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-7vdvf\" (UID: \"f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf"
Jul 07 14:24:52.300750 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.300462    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6ee660c9-2199-46ff-96b4-bf0e99a0cdfc-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-rx5vv\" (UID: \"6ee660c9-2199-46ff-96b4-bf0e99a0cdfc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv"
Jul 07 14:24:52.300750 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.300542    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/feff296c-ca8b-401c-840d-819465005d5d-trusted-ca\") pod \"console-operator-68b757fb67-wsdv5\" (UID: \"feff296c-ca8b-401c-840d-819465005d5d\") " pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:24:52.301086 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.301014    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/feff296c-ca8b-401c-840d-819465005d5d-config\") pod \"console-operator-68b757fb67-wsdv5\" (UID: \"feff296c-ca8b-401c-840d-819465005d5d\") " pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:24:52.303131 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.303079    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ee660c9-2199-46ff-96b4-bf0e99a0cdfc-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-rx5vv\" (UID: \"6ee660c9-2199-46ff-96b4-bf0e99a0cdfc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv"
Jul 07 14:24:52.303310 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.303289    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/feff296c-ca8b-401c-840d-819465005d5d-serving-cert\") pod \"console-operator-68b757fb67-wsdv5\" (UID: \"feff296c-ca8b-401c-840d-819465005d5d\") " pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:24:52.312606 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.312554    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tkfb\" (UniqueName: \"kubernetes.io/projected/feff296c-ca8b-401c-840d-819465005d5d-kube-api-access-5tkfb\") pod \"console-operator-68b757fb67-wsdv5\" (UID: \"feff296c-ca8b-401c-840d-819465005d5d\") " pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:24:52.313054 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.313030    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m5qm\" (UniqueName: \"kubernetes.io/projected/6ee660c9-2199-46ff-96b4-bf0e99a0cdfc-kube-api-access-5m5qm\") pod \"kube-storage-version-migrator-operator-846bf668f7-rx5vv\" (UID: \"6ee660c9-2199-46ff-96b4-bf0e99a0cdfc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv"
Jul 07 14:24:52.326603 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.326402    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv"
Jul 07 14:24:52.335297 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.335166    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:24:52.354817 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.354738    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-btm8c"]
Jul 07 14:24:52.360637 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:52.360568    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8c4c65_4c6f_4780_a9af_e0501ba8ae27.slice/crio-b69b8b3ab7ed1366c390ef4a356ee4a70b09349f21e3a2d46e564ff960cf329c WatchSource:0}: Error finding container b69b8b3ab7ed1366c390ef4a356ee4a70b09349f21e3a2d46e564ff960cf329c: Status 404 returned error can't find the container with id b69b8b3ab7ed1366c390ef4a356ee4a70b09349f21e3a2d46e564ff960cf329c
Jul 07 14:24:52.400085 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.400055    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2-config\") pod \"service-ca-operator-5d46d9ffd4-7vdvf\" (UID: \"f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf"
Jul 07 14:24:52.400307 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.400175    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-7vdvf\" (UID: \"f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf"
Jul 07 14:24:52.400307 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.400282    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8lkh\" (UniqueName: \"kubernetes.io/projected/f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2-kube-api-access-l8lkh\") pod \"service-ca-operator-5d46d9ffd4-7vdvf\" (UID: \"f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf"
Jul 07 14:24:52.400654 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.400629    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2-config\") pod \"service-ca-operator-5d46d9ffd4-7vdvf\" (UID: \"f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf"
Jul 07 14:24:52.403021 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.402968    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-7vdvf\" (UID: \"f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf"
Jul 07 14:24:52.416266 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.415984    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-85qbn"]
Jul 07 14:24:52.419010 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:52.417927    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf38995e_857b_4418_ad86_18cb186dc0e8.slice/crio-7d268d660642947641dbf58cf98229a6b2366a70b6298eb6fa7fe2c57f4d9952 WatchSource:0}: Error finding container 7d268d660642947641dbf58cf98229a6b2366a70b6298eb6fa7fe2c57f4d9952: Status 404 returned error can't find the container with id 7d268d660642947641dbf58cf98229a6b2366a70b6298eb6fa7fe2c57f4d9952
Jul 07 14:24:52.421224 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.421118    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8lkh\" (UniqueName: \"kubernetes.io/projected/f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2-kube-api-access-l8lkh\") pod \"service-ca-operator-5d46d9ffd4-7vdvf\" (UID: \"f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf"
Jul 07 14:24:52.431822 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.431785    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-m4684"]
Jul 07 14:24:52.437553 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:52.437483    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod246e477f_d040_4356_a575_f78f652b6192.slice/crio-15c74b8e3ee18db242af140f2243b377fa178d41d3537909338213731077b65e WatchSource:0}: Error finding container 15c74b8e3ee18db242af140f2243b377fa178d41d3537909338213731077b65e: Status 404 returned error can't find the container with id 15c74b8e3ee18db242af140f2243b377fa178d41d3537909338213731077b65e
Jul 07 14:24:52.441994 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.441968    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf"
Jul 07 14:24:52.504273 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.504244    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv"]
Jul 07 14:24:52.508273 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:52.508251    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee660c9_2199_46ff_96b4_bf0e99a0cdfc.slice/crio-3e70287c51c2143c4b9ebe1ed59560365e062cc0511d6b3c13c97d8f5217a332 WatchSource:0}: Error finding container 3e70287c51c2143c4b9ebe1ed59560365e062cc0511d6b3c13c97d8f5217a332: Status 404 returned error can't find the container with id 3e70287c51c2143c4b9ebe1ed59560365e062cc0511d6b3c13c97d8f5217a332
Jul 07 14:24:52.514540 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.514517    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv" event={"ID":"6ee660c9-2199-46ff-96b4-bf0e99a0cdfc","Type":"ContainerStarted","Data":"3e70287c51c2143c4b9ebe1ed59560365e062cc0511d6b3c13c97d8f5217a332"}
Jul 07 14:24:52.515751 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.515731    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-m4684" event={"ID":"246e477f-d040-4356-a575-f78f652b6192","Type":"ContainerStarted","Data":"15c74b8e3ee18db242af140f2243b377fa178d41d3537909338213731077b65e"}
Jul 07 14:24:52.517169 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.517150    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-btm8c" event={"ID":"8a8c4c65-4c6f-4780-a9af-e0501ba8ae27","Type":"ContainerStarted","Data":"b69b8b3ab7ed1366c390ef4a356ee4a70b09349f21e3a2d46e564ff960cf329c"}
Jul 07 14:24:52.519160 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.519126    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-85qbn" event={"ID":"af38995e-857b-4418-ad86-18cb186dc0e8","Type":"ContainerStarted","Data":"7d268d660642947641dbf58cf98229a6b2366a70b6298eb6fa7fe2c57f4d9952"}
Jul 07 14:24:52.533426 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.533391    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-wsdv5"]
Jul 07 14:24:52.537339 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:52.537309    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeff296c_ca8b_401c_840d_819465005d5d.slice/crio-2d3ebf158614713e976ca976e8de2e948935714ee6674dad27ec3e4f7f375990 WatchSource:0}: Error finding container 2d3ebf158614713e976ca976e8de2e948935714ee6674dad27ec3e4f7f375990: Status 404 returned error can't find the container with id 2d3ebf158614713e976ca976e8de2e948935714ee6674dad27ec3e4f7f375990
Jul 07 14:24:52.611710 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.611637    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf"]
Jul 07 14:24:52.614843 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:24:52.614820    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6e8e5ee_73c0_407a_be5a_4dd9b9748fe2.slice/crio-895345e6ea35d4668ea1a279afdfdfe1038af272960215862f9791de659de558 WatchSource:0}: Error finding container 895345e6ea35d4668ea1a279afdfdfe1038af272960215862f9791de659de558: Status 404 returned error can't find the container with id 895345e6ea35d4668ea1a279afdfdfe1038af272960215862f9791de659de558
Jul 07 14:24:52.702561 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.702532    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kfp8s\" (UID: \"51ff0204-46fd-46b7-bd27-4a28a0683ae4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:24:52.702729 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.702570    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:52.702729 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.702644    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bxw8z\" (UID: \"8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z"
Jul 07 14:24:52.702729 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.702675    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:52.702729 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:52.702707    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 14:24:52.702894 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:52.702770    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 14:24:52.702894 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:52.702772    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 14:24:52.702894 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:52.702785    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls podName:51ff0204-46fd-46b7-bd27-4a28a0683ae4 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:53.702763666 +0000 UTC m=+48.908737776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kfp8s" (UID: "51ff0204-46fd-46b7-bd27-4a28a0683ae4") : secret "cluster-monitoring-operator-tls" not found
Jul 07 14:24:52.702894 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:52.702823    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle podName:ec46e625-a505-4243-97cd-b319c114f668 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:53.702812757 +0000 UTC m=+48.908786864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle") pod "router-default-5df69cc7c9-xdxbd" (UID: "ec46e625-a505-4243-97cd-b319c114f668") : configmap references non-existent config key: service-ca.crt
Jul 07 14:24:52.702894 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:52.702837    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls podName:8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:53.702829509 +0000 UTC m=+48.908803621 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bxw8z" (UID: "8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033") : secret "samples-operator-tls" not found
Jul 07 14:24:52.702894 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:52.702851    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs podName:ec46e625-a505-4243-97cd-b319c114f668 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:53.702843917 +0000 UTC m=+48.908818030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs") pod "router-default-5df69cc7c9-xdxbd" (UID: "ec46e625-a505-4243-97cd-b319c114f668") : secret "router-metrics-certs-default" not found
Jul 07 14:24:52.740988 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.740952    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:52.842693 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:52.842655    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:53.524628 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:53.524571    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf" event={"ID":"f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2","Type":"ContainerStarted","Data":"895345e6ea35d4668ea1a279afdfdfe1038af272960215862f9791de659de558"}
Jul 07 14:24:53.526097 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:53.526067    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-wsdv5" event={"ID":"feff296c-ca8b-401c-840d-819465005d5d","Type":"ContainerStarted","Data":"2d3ebf158614713e976ca976e8de2e948935714ee6674dad27ec3e4f7f375990"}
Jul 07 14:24:53.712935 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:53.712893    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kfp8s\" (UID: \"51ff0204-46fd-46b7-bd27-4a28a0683ae4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:24:53.713184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:53.712962    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:53.713184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:53.713052    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bxw8z\" (UID: \"8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z"
Jul 07 14:24:53.713184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:53.713103    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:53.713476 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:53.713267    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle podName:ec46e625-a505-4243-97cd-b319c114f668 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:55.713247776 +0000 UTC m=+50.919221899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle") pod "router-default-5df69cc7c9-xdxbd" (UID: "ec46e625-a505-4243-97cd-b319c114f668") : configmap references non-existent config key: service-ca.crt
Jul 07 14:24:53.713476 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:53.713359    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 14:24:53.713476 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:53.713398    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls podName:51ff0204-46fd-46b7-bd27-4a28a0683ae4 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:55.713385813 +0000 UTC m=+50.919359926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kfp8s" (UID: "51ff0204-46fd-46b7-bd27-4a28a0683ae4") : secret "cluster-monitoring-operator-tls" not found
Jul 07 14:24:53.713476 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:53.713470    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 14:24:53.713732 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:53.713520    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs podName:ec46e625-a505-4243-97cd-b319c114f668 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:55.713507854 +0000 UTC m=+50.919481961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs") pod "router-default-5df69cc7c9-xdxbd" (UID: "ec46e625-a505-4243-97cd-b319c114f668") : secret "router-metrics-certs-default" not found
Jul 07 14:24:53.714067 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:53.714047    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 14:24:53.714139 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:53.714116    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls podName:8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:55.714099483 +0000 UTC m=+50.920073595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bxw8z" (UID: "8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033") : secret "samples-operator-tls" not found
Jul 07 14:24:54.700752 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:54.700716    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:55.134059 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:55.133974    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:55.207065 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:55.207017    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log" limit=1024
Jul 07 14:24:55.736567 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:55.736516    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kfp8s\" (UID: \"51ff0204-46fd-46b7-bd27-4a28a0683ae4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:24:55.737048 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:55.736584    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:55.737048 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:55.736696    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bxw8z\" (UID: \"8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z"
Jul 07 14:24:55.737048 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:55.736699    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 14:24:55.737048 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:55.736744    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:55.737048 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:55.736799    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls podName:51ff0204-46fd-46b7-bd27-4a28a0683ae4 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:59.736775819 +0000 UTC m=+54.942749952 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kfp8s" (UID: "51ff0204-46fd-46b7-bd27-4a28a0683ae4") : secret "cluster-monitoring-operator-tls" not found
Jul 07 14:24:55.737048 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:55.736880    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle podName:ec46e625-a505-4243-97cd-b319c114f668 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:59.736867465 +0000 UTC m=+54.942841573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle") pod "router-default-5df69cc7c9-xdxbd" (UID: "ec46e625-a505-4243-97cd-b319c114f668") : configmap references non-existent config key: service-ca.crt
Jul 07 14:24:55.737048 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:55.736946    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 14:24:55.737048 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:55.736973    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs podName:ec46e625-a505-4243-97cd-b319c114f668 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:59.736964314 +0000 UTC m=+54.942938421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs") pod "router-default-5df69cc7c9-xdxbd" (UID: "ec46e625-a505-4243-97cd-b319c114f668") : secret "router-metrics-certs-default" not found
Jul 07 14:24:55.737048 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:55.737014    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 14:24:55.737048 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:55.737047    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls podName:8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033 nodeName:}" failed. No retries permitted until 2026-07-07 14:24:59.737036304 +0000 UTC m=+54.943010411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bxw8z" (UID: "8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033") : secret "samples-operator-tls" not found
Jul 07 14:24:58.563118 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:58.563090    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:24:58.563692 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:58.563143    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:24:58.563692 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:58.563293    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 14:24:58.563692 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:58.563315    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7754b6d44-2jjsn: secret "image-registry-tls" not found
Jul 07 14:24:58.563692 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:58.563342    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 14:24:58.563692 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:58.563400    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls podName:4e6b77cc-7d10-449a-ae8e-553340a879a1 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:14.563377228 +0000 UTC m=+69.769351336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls") pod "image-registry-7754b6d44-2jjsn" (UID: "4e6b77cc-7d10-449a-ae8e-553340a879a1") : secret "image-registry-tls" not found
Jul 07 14:24:58.563692 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:58.563421    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls podName:48d7352c-0608-4b17-aecf-ff2cf067b5fd nodeName:}" failed. No retries permitted until 2026-07-07 14:25:14.563411487 +0000 UTC m=+69.769385595 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls") pod "dns-default-lzhnd" (UID: "48d7352c-0608-4b17-aecf-ff2cf067b5fd") : secret "dns-default-metrics-tls" not found
Jul 07 14:24:59.545652 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.545626    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/0.log"
Jul 07 14:24:59.545797 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.545673    2567 generic.go:356] "Generic (PLEG): container finished" podID="feff296c-ca8b-401c-840d-819465005d5d" containerID="896ef56c427b09f10c829b7e8b7809ec706d3513f35986eb025586ffcdadc883" exitCode=255
Jul 07 14:24:59.545797 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.545766    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-wsdv5" event={"ID":"feff296c-ca8b-401c-840d-819465005d5d","Type":"ContainerDied","Data":"896ef56c427b09f10c829b7e8b7809ec706d3513f35986eb025586ffcdadc883"}
Jul 07 14:24:59.546297 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.545998    2567 scope.go:117] "RemoveContainer" containerID="896ef56c427b09f10c829b7e8b7809ec706d3513f35986eb025586ffcdadc883"
Jul 07 14:24:59.547540 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.547509    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf" event={"ID":"f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2","Type":"ContainerStarted","Data":"f8a87a8961589350658490c0fa04c60a562ebbaf6bb71507a5e3b763beb8451d"}
Jul 07 14:24:59.549168 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.549128    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-m4684" event={"ID":"246e477f-d040-4356-a575-f78f652b6192","Type":"ContainerStarted","Data":"9477356016cf2d2bcf81f5fa575886eff6d5d3501671b9da2a78578bb2709ff1"}
Jul 07 14:24:59.553864 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.553807    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-btm8c" event={"ID":"8a8c4c65-4c6f-4780-a9af-e0501ba8ae27","Type":"ContainerStarted","Data":"e27ed7a9b1f0e9f61f1cab822df12f2fc1870b550f095e37c8bc0b07d7fe37a0"}
Jul 07 14:24:59.556171 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.556146    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-85qbn" event={"ID":"af38995e-857b-4418-ad86-18cb186dc0e8","Type":"ContainerStarted","Data":"f8f9d1c7862418fceffbc22f4579ff7720827021227ea733abee38188eac35be"}
Jul 07 14:24:59.558206 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.558181    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv" event={"ID":"6ee660c9-2199-46ff-96b4-bf0e99a0cdfc","Type":"ContainerStarted","Data":"eeb99f475ac10f5e67227c74ac9e5b5eb35e806570c991ddbce7b2dbb6b7b7a6"}
Jul 07 14:24:59.593422 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.593374    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-m4684" podStartSLOduration=2.110077272 podStartE2EDuration="8.59335528s" totalImagesPullingTime="6.483278008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:59.59226555 +0000 UTC m=+54.798239680" watchObservedRunningTime="2026-07-07 14:24:59.59335528 +0000 UTC m=+54.799329403"
Jul 07 14:24:59.612988 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.612941    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv" podStartSLOduration=2.200806543 podStartE2EDuration="8.612925154s" totalImagesPullingTime="6.412118611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:59.611488518 +0000 UTC m=+54.817462646" watchObservedRunningTime="2026-07-07 14:24:59.612925154 +0000 UTC m=+54.818899282"
Jul 07 14:24:59.637615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.637500    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf" podStartSLOduration=1.331460682 podStartE2EDuration="7.637479257s" totalImagesPullingTime="6.306018575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:59.637274087 +0000 UTC m=+54.843248218" watchObservedRunningTime="2026-07-07 14:24:59.637479257 +0000 UTC m=+54.843453388"
Jul 07 14:24:59.658479 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.658407    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-btm8c" podStartSLOduration=2.12105514 podStartE2EDuration="8.658385565s" totalImagesPullingTime="6.537330425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:59.655216337 +0000 UTC m=+54.861190466" watchObservedRunningTime="2026-07-07 14:24:59.658385565 +0000 UTC m=+54.864359696"
Jul 07 14:24:59.678791 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.678721    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-85qbn" podStartSLOduration=1.906684776 podStartE2EDuration="8.678701567s" totalImagesPullingTime="6.772016791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:24:59.676214425 +0000 UTC m=+54.882188555" watchObservedRunningTime="2026-07-07 14:24:59.678701567 +0000 UTC m=+54.884675698"
Jul 07 14:24:59.773376 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.773277    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:59.773548 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.773396    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bxw8z\" (UID: \"8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z"
Jul 07 14:24:59.773548 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.773441    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:24:59.773548 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:59.773461    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 14:24:59.773548 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:24:59.773517    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kfp8s\" (UID: \"51ff0204-46fd-46b7-bd27-4a28a0683ae4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:24:59.773781 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:59.773561    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs podName:ec46e625-a505-4243-97cd-b319c114f668 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:07.773530521 +0000 UTC m=+62.979504631 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs") pod "router-default-5df69cc7c9-xdxbd" (UID: "ec46e625-a505-4243-97cd-b319c114f668") : secret "router-metrics-certs-default" not found
Jul 07 14:24:59.773781 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:59.773634    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 14:24:59.773781 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:59.773652    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle podName:ec46e625-a505-4243-97cd-b319c114f668 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:07.773633613 +0000 UTC m=+62.979607728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle") pod "router-default-5df69cc7c9-xdxbd" (UID: "ec46e625-a505-4243-97cd-b319c114f668") : configmap references non-existent config key: service-ca.crt
Jul 07 14:24:59.773781 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:59.773681    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls podName:51ff0204-46fd-46b7-bd27-4a28a0683ae4 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:07.773667273 +0000 UTC m=+62.979641385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kfp8s" (UID: "51ff0204-46fd-46b7-bd27-4a28a0683ae4") : secret "cluster-monitoring-operator-tls" not found
Jul 07 14:24:59.773781 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:59.773725    2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 14:24:59.773781 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:24:59.773766    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls podName:8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:07.773754904 +0000 UTC m=+62.979729013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-bxw8z" (UID: "8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033") : secret "samples-operator-tls" not found
Jul 07 14:25:00.289074 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.289039    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-l9sxj"]
Jul 07 14:25:00.292268 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.292235    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l9sxj"
Jul 07 14:25:00.295210 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.295097    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 07 14:25:00.295210 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.295111    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 07 14:25:00.296331 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.296144    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-vt42l\""
Jul 07 14:25:00.301783 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.301749    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-l9sxj"]
Jul 07 14:25:00.379817 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.379784    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6q86\" (UniqueName: \"kubernetes.io/projected/a9f9c58c-009f-4689-b082-c16a652a71d6-kube-api-access-s6q86\") pod \"migrator-d57d58cc9-l9sxj\" (UID: \"a9f9c58c-009f-4689-b082-c16a652a71d6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l9sxj"
Jul 07 14:25:00.481073 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.481037    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6q86\" (UniqueName: \"kubernetes.io/projected/a9f9c58c-009f-4689-b082-c16a652a71d6-kube-api-access-s6q86\") pod \"migrator-d57d58cc9-l9sxj\" (UID: \"a9f9c58c-009f-4689-b082-c16a652a71d6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l9sxj"
Jul 07 14:25:00.491576 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.491553    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6q86\" (UniqueName: \"kubernetes.io/projected/a9f9c58c-009f-4689-b082-c16a652a71d6-kube-api-access-s6q86\") pod \"migrator-d57d58cc9-l9sxj\" (UID: \"a9f9c58c-009f-4689-b082-c16a652a71d6\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l9sxj"
Jul 07 14:25:00.564001 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.563931    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:25:00.564917 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.564893    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/0.log"
Jul 07 14:25:00.565075 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.565053    2567 generic.go:356] "Generic (PLEG): container finished" podID="feff296c-ca8b-401c-840d-819465005d5d" containerID="e10ba13957d6ef0c49f6acd602fc70bd9a4e64ff868fb449536349fac376660e" exitCode=255
Jul 07 14:25:00.565272 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.565256    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-wsdv5" event={"ID":"feff296c-ca8b-401c-840d-819465005d5d","Type":"ContainerDied","Data":"e10ba13957d6ef0c49f6acd602fc70bd9a4e64ff868fb449536349fac376660e"}
Jul 07 14:25:00.565438 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.565425    2567 scope.go:117] "RemoveContainer" containerID="896ef56c427b09f10c829b7e8b7809ec706d3513f35986eb025586ffcdadc883"
Jul 07 14:25:00.566266 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.566247    2567 scope.go:117] "RemoveContainer" containerID="e10ba13957d6ef0c49f6acd602fc70bd9a4e64ff868fb449536349fac376660e"
Jul 07 14:25:00.572696 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:00.568908    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-wsdv5_openshift-console-operator(feff296c-ca8b-401c-840d-819465005d5d)\"" pod="openshift-console-operator/console-operator-68b757fb67-wsdv5" podUID="feff296c-ca8b-401c-840d-819465005d5d"
Jul 07 14:25:00.603819 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.603789    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l9sxj"
Jul 07 14:25:00.747173 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:00.747148    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-l9sxj"]
Jul 07 14:25:00.749703 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:25:00.749665    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f9c58c_009f_4689_b082_c16a652a71d6.slice/crio-e77b6a2dc40f9e7d256fbf6acff2942cff35829e9b76ebaac064b786eabc5474 WatchSource:0}: Error finding container e77b6a2dc40f9e7d256fbf6acff2942cff35829e9b76ebaac064b786eabc5474: Status 404 returned error can't find the container with id e77b6a2dc40f9e7d256fbf6acff2942cff35829e9b76ebaac064b786eabc5474
Jul 07 14:25:01.049052 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.049020    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8r8r6"]
Jul 07 14:25:01.053819 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.053785    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:01.057808 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.057783    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5ms4k\""
Jul 07 14:25:01.058259 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.058242    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 14:25:01.058313 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.058243    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 14:25:01.069094 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.069073    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8r8r6"]
Jul 07 14:25:01.087368 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.087343    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr9ls\" (UniqueName: \"kubernetes.io/projected/bddc2009-c225-47db-b309-a7a961b6997f-kube-api-access-tr9ls\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:01.087484 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.087384    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bddc2009-c225-47db-b309-a7a961b6997f-crio-socket\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:01.087484 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.087442    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:01.087484 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.087478    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:01.087581 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.087527    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bddc2009-c225-47db-b309-a7a961b6997f-data-volume\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:01.188920 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.188882    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr9ls\" (UniqueName: \"kubernetes.io/projected/bddc2009-c225-47db-b309-a7a961b6997f-kube-api-access-tr9ls\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:01.188920 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.188924    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bddc2009-c225-47db-b309-a7a961b6997f-crio-socket\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:01.189146 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.188951    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:01.189146 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.188980    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:01.189146 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.188999    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bddc2009-c225-47db-b309-a7a961b6997f-data-volume\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:01.189146 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:01.189092    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 14:25:01.189146 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.189122    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bddc2009-c225-47db-b309-a7a961b6997f-crio-socket\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:01.189414 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:01.189153    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:25:01.189414 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:01.189160    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm podName:bddc2009-c225-47db-b309-a7a961b6997f nodeName:}" failed. No retries permitted until 2026-07-07 14:25:01.689138395 +0000 UTC m=+56.895112516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8r8r6" (UID: "bddc2009-c225-47db-b309-a7a961b6997f") : configmap "kube-rbac-proxy" not found
Jul 07 14:25:01.189414 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:01.189211    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls podName:bddc2009-c225-47db-b309-a7a961b6997f nodeName:}" failed. No retries permitted until 2026-07-07 14:25:01.689198916 +0000 UTC m=+56.895173026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8r8r6" (UID: "bddc2009-c225-47db-b309-a7a961b6997f") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:25:01.189414 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.189317    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bddc2009-c225-47db-b309-a7a961b6997f-data-volume\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:01.200671 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.200645    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr9ls\" (UniqueName: \"kubernetes.io/projected/bddc2009-c225-47db-b309-a7a961b6997f-kube-api-access-tr9ls\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:01.572014 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.571981    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:25:01.572395 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.572376    2567 scope.go:117] "RemoveContainer" containerID="e10ba13957d6ef0c49f6acd602fc70bd9a4e64ff868fb449536349fac376660e"
Jul 07 14:25:01.572609 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:01.572565    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-wsdv5_openshift-console-operator(feff296c-ca8b-401c-840d-819465005d5d)\"" pod="openshift-console-operator/console-operator-68b757fb67-wsdv5" podUID="feff296c-ca8b-401c-840d-819465005d5d"
Jul 07 14:25:01.573407 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.573378    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l9sxj" event={"ID":"a9f9c58c-009f-4689-b082-c16a652a71d6","Type":"ContainerStarted","Data":"e77b6a2dc40f9e7d256fbf6acff2942cff35829e9b76ebaac064b786eabc5474"}
Jul 07 14:25:01.692975 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.692945    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:01.693402 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:01.693017    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:01.693402 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:01.693122    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 14:25:01.693402 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:01.693198    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm podName:bddc2009-c225-47db-b309-a7a961b6997f nodeName:}" failed. No retries permitted until 2026-07-07 14:25:02.6931772 +0000 UTC m=+57.899151330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8r8r6" (UID: "bddc2009-c225-47db-b309-a7a961b6997f") : configmap "kube-rbac-proxy" not found
Jul 07 14:25:01.693402 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:01.693250    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:25:01.693402 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:01.693302    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls podName:bddc2009-c225-47db-b309-a7a961b6997f nodeName:}" failed. No retries permitted until 2026-07-07 14:25:02.693292579 +0000 UTC m=+57.899266686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8r8r6" (UID: "bddc2009-c225-47db-b309-a7a961b6997f") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:25:02.335732 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:02.335691    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:25:02.336000 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:02.335770    2567 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:25:02.576339 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:02.576319    2567 scope.go:117] "RemoveContainer" containerID="e10ba13957d6ef0c49f6acd602fc70bd9a4e64ff868fb449536349fac376660e"
Jul 07 14:25:02.576483 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:02.576465    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-wsdv5_openshift-console-operator(feff296c-ca8b-401c-840d-819465005d5d)\"" pod="openshift-console-operator/console-operator-68b757fb67-wsdv5" podUID="feff296c-ca8b-401c-840d-819465005d5d"
Jul 07 14:25:02.704613 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:02.704553    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:02.705110 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:02.704652    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:02.705110 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:02.704738    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 14:25:02.705110 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:02.704826    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm podName:bddc2009-c225-47db-b309-a7a961b6997f nodeName:}" failed. No retries permitted until 2026-07-07 14:25:04.704801548 +0000 UTC m=+59.910775657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8r8r6" (UID: "bddc2009-c225-47db-b309-a7a961b6997f") : configmap "kube-rbac-proxy" not found
Jul 07 14:25:02.705110 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:02.704879    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:25:02.705110 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:02.704936    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls podName:bddc2009-c225-47db-b309-a7a961b6997f nodeName:}" failed. No retries permitted until 2026-07-07 14:25:04.704918628 +0000 UTC m=+59.910892740 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8r8r6" (UID: "bddc2009-c225-47db-b309-a7a961b6997f") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:25:02.843362 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:02.843284    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5pgr7_95a06780-deaf-4ca6-82b5-3040caf89229/dns-node-resolver/0.log"
Jul 07 14:25:03.185674 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.185641    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-qh9tm"]
Jul 07 14:25:03.190337 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.190308    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-qh9tm"
Jul 07 14:25:03.194473 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.194454    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 07 14:25:03.194620 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.194457    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 07 14:25:03.195350 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.195331    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 07 14:25:03.195468 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.195334    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 07 14:25:03.195707 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.195690    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9sqrr\""
Jul 07 14:25:03.203272 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.203245    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-qh9tm"]
Jul 07 14:25:03.311770 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.311715    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5145ff11-4cae-4fba-81ab-d482c4e1e2d0-signing-key\") pod \"service-ca-758f599c5-qh9tm\" (UID: \"5145ff11-4cae-4fba-81ab-d482c4e1e2d0\") " pod="openshift-service-ca/service-ca-758f599c5-qh9tm"
Jul 07 14:25:03.311964 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.311811    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz7nw\" (UniqueName: \"kubernetes.io/projected/5145ff11-4cae-4fba-81ab-d482c4e1e2d0-kube-api-access-kz7nw\") pod \"service-ca-758f599c5-qh9tm\" (UID: \"5145ff11-4cae-4fba-81ab-d482c4e1e2d0\") " pod="openshift-service-ca/service-ca-758f599c5-qh9tm"
Jul 07 14:25:03.311964 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.311915    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5145ff11-4cae-4fba-81ab-d482c4e1e2d0-signing-cabundle\") pod \"service-ca-758f599c5-qh9tm\" (UID: \"5145ff11-4cae-4fba-81ab-d482c4e1e2d0\") " pod="openshift-service-ca/service-ca-758f599c5-qh9tm"
Jul 07 14:25:03.412562 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.412527    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5145ff11-4cae-4fba-81ab-d482c4e1e2d0-signing-key\") pod \"service-ca-758f599c5-qh9tm\" (UID: \"5145ff11-4cae-4fba-81ab-d482c4e1e2d0\") " pod="openshift-service-ca/service-ca-758f599c5-qh9tm"
Jul 07 14:25:03.412562 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.412569    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz7nw\" (UniqueName: \"kubernetes.io/projected/5145ff11-4cae-4fba-81ab-d482c4e1e2d0-kube-api-access-kz7nw\") pod \"service-ca-758f599c5-qh9tm\" (UID: \"5145ff11-4cae-4fba-81ab-d482c4e1e2d0\") " pod="openshift-service-ca/service-ca-758f599c5-qh9tm"
Jul 07 14:25:03.412808 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.412653    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5145ff11-4cae-4fba-81ab-d482c4e1e2d0-signing-cabundle\") pod \"service-ca-758f599c5-qh9tm\" (UID: \"5145ff11-4cae-4fba-81ab-d482c4e1e2d0\") " pod="openshift-service-ca/service-ca-758f599c5-qh9tm"
Jul 07 14:25:03.413425 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.413343    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5145ff11-4cae-4fba-81ab-d482c4e1e2d0-signing-cabundle\") pod \"service-ca-758f599c5-qh9tm\" (UID: \"5145ff11-4cae-4fba-81ab-d482c4e1e2d0\") " pod="openshift-service-ca/service-ca-758f599c5-qh9tm"
Jul 07 14:25:03.415262 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.415236    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5145ff11-4cae-4fba-81ab-d482c4e1e2d0-signing-key\") pod \"service-ca-758f599c5-qh9tm\" (UID: \"5145ff11-4cae-4fba-81ab-d482c4e1e2d0\") " pod="openshift-service-ca/service-ca-758f599c5-qh9tm"
Jul 07 14:25:03.422879 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.422855    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz7nw\" (UniqueName: \"kubernetes.io/projected/5145ff11-4cae-4fba-81ab-d482c4e1e2d0-kube-api-access-kz7nw\") pod \"service-ca-758f599c5-qh9tm\" (UID: \"5145ff11-4cae-4fba-81ab-d482c4e1e2d0\") " pod="openshift-service-ca/service-ca-758f599c5-qh9tm"
Jul 07 14:25:03.499319 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.499236    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-qh9tm"
Jul 07 14:25:03.583329 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.583286    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l9sxj" event={"ID":"a9f9c58c-009f-4689-b082-c16a652a71d6","Type":"ContainerStarted","Data":"3d0545d6de7994fed7da40da1cf43a4a20fadce27b73ad4b5c0c36831b35af5e"}
Jul 07 14:25:03.583481 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.583352    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l9sxj" event={"ID":"a9f9c58c-009f-4689-b082-c16a652a71d6","Type":"ContainerStarted","Data":"47a0315a66427c02fff9de38ab346af9522e120a1f643ebacbd43f9695303e22"}
Jul 07 14:25:03.603023 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.602971    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-l9sxj" podStartSLOduration=1.830948417 podStartE2EDuration="3.602952114s" totalImagesPullingTime="1.772003697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:03.602007235 +0000 UTC m=+58.807981364" watchObservedRunningTime="2026-07-07 14:25:03.602952114 +0000 UTC m=+58.808926266"
Jul 07 14:25:03.633776 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:03.633742    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-qh9tm"]
Jul 07 14:25:03.637277 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:25:03.637210    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5145ff11_4cae_4fba_81ab_d482c4e1e2d0.slice/crio-7ca281b59e5f1e2c26f95181f454c370872015eb7d91621ed98cac41446f72d6 WatchSource:0}: Error finding container 7ca281b59e5f1e2c26f95181f454c370872015eb7d91621ed98cac41446f72d6: Status 404 returned error can't find the container with id 7ca281b59e5f1e2c26f95181f454c370872015eb7d91621ed98cac41446f72d6
Jul 07 14:25:04.044971 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:04.044948    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lwnqf_302a7403-a5f3-4749-92a3-05bcc8138f1a/node-ca/0.log"
Jul 07 14:25:04.588692 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:04.588654    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-qh9tm" event={"ID":"5145ff11-4cae-4fba-81ab-d482c4e1e2d0","Type":"ContainerStarted","Data":"23d9de4071323c937fdcd1e68af388f93f298f945d127a250020b619c36f604f"}
Jul 07 14:25:04.588863 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:04.588716    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-qh9tm" event={"ID":"5145ff11-4cae-4fba-81ab-d482c4e1e2d0","Type":"ContainerStarted","Data":"7ca281b59e5f1e2c26f95181f454c370872015eb7d91621ed98cac41446f72d6"}
Jul 07 14:25:04.614303 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:04.614245    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-qh9tm" podStartSLOduration=1.614224576 podStartE2EDuration="1.614224576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:04.613392786 +0000 UTC m=+59.819366928" watchObservedRunningTime="2026-07-07 14:25:04.614224576 +0000 UTC m=+59.820198746"
Jul 07 14:25:04.647116 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:04.647081    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s48x2_c3570076-b2c5-4087-819a-412ab7f410df/serve-healthcheck-canary/0.log"
Jul 07 14:25:04.724171 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:04.724131    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:04.724364 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:04.724291    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:25:04.724364 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:04.724351    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls podName:bddc2009-c225-47db-b309-a7a961b6997f nodeName:}" failed. No retries permitted until 2026-07-07 14:25:08.724335134 +0000 UTC m=+63.930309241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8r8r6" (UID: "bddc2009-c225-47db-b309-a7a961b6997f") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:25:04.724488 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:04.724474    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:04.724562 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:04.724546    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 14:25:04.724641 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:04.724618    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm podName:bddc2009-c225-47db-b309-a7a961b6997f nodeName:}" failed. No retries permitted until 2026-07-07 14:25:08.724578012 +0000 UTC m=+63.930552132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8r8r6" (UID: "bddc2009-c225-47db-b309-a7a961b6997f") : configmap "kube-rbac-proxy" not found
Jul 07 14:25:04.844547 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:04.844458    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-l9sxj_a9f9c58c-009f-4689-b082-c16a652a71d6/migrator/0.log"
Jul 07 14:25:05.043942 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:05.043906    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-l9sxj_a9f9c58c-009f-4689-b082-c16a652a71d6/graceful-termination/0.log"
Jul 07 14:25:05.248879 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:05.248426    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-rx5vv_6ee660c9-2199-46ff-96b4-bf0e99a0cdfc/kube-storage-version-migrator-operator/0.log"
Jul 07 14:25:07.858318 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:07.858275    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bxw8z\" (UID: \"8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z"
Jul 07 14:25:07.858815 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:07.858334    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:25:07.858815 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:07.858407    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kfp8s\" (UID: \"51ff0204-46fd-46b7-bd27-4a28a0683ae4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:25:07.858815 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:07.858450    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:25:07.858815 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:07.858518    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle podName:ec46e625-a505-4243-97cd-b319c114f668 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:23.858493315 +0000 UTC m=+79.064467426 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle") pod "router-default-5df69cc7c9-xdxbd" (UID: "ec46e625-a505-4243-97cd-b319c114f668") : configmap references non-existent config key: service-ca.crt
Jul 07 14:25:07.858815 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:07.858577    2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 14:25:07.858815 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:07.858658    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs podName:ec46e625-a505-4243-97cd-b319c114f668 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:23.858641431 +0000 UTC m=+79.064615558 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs") pod "router-default-5df69cc7c9-xdxbd" (UID: "ec46e625-a505-4243-97cd-b319c114f668") : secret "router-metrics-certs-default" not found
Jul 07 14:25:07.858815 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:07.858580    2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 14:25:07.858815 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:07.858708    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls podName:51ff0204-46fd-46b7-bd27-4a28a0683ae4 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:23.858697467 +0000 UTC m=+79.064671577 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-kfp8s" (UID: "51ff0204-46fd-46b7-bd27-4a28a0683ae4") : secret "cluster-monitoring-operator-tls" not found
Jul 07 14:25:07.860898 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:07.860870    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-bxw8z\" (UID: \"8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z"
Jul 07 14:25:08.142447 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:08.142357    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vct9l\""
Jul 07 14:25:08.150595 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:08.150564    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z"
Jul 07 14:25:08.287876 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:08.287844    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z"]
Jul 07 14:25:08.475151 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:08.475123    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbtjg"
Jul 07 14:25:08.605019 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:08.604980    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z" event={"ID":"8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033","Type":"ContainerStarted","Data":"0b2ba5bc76353f1591aad6e9a0847fe91700d45fa802ae9ac402e7c1ea1fe100"}
Jul 07 14:25:08.766973 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:08.766870    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:08.766973 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:08.766923    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:08.767218 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:08.767024    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 14:25:08.767218 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:08.767061    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 14:25:08.767218 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:08.767101    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm podName:bddc2009-c225-47db-b309-a7a961b6997f nodeName:}" failed. No retries permitted until 2026-07-07 14:25:16.767080945 +0000 UTC m=+71.973055070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8r8r6" (UID: "bddc2009-c225-47db-b309-a7a961b6997f") : configmap "kube-rbac-proxy" not found
Jul 07 14:25:08.767218 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:08.767171    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls podName:bddc2009-c225-47db-b309-a7a961b6997f nodeName:}" failed. No retries permitted until 2026-07-07 14:25:16.767161267 +0000 UTC m=+71.973135381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8r8r6" (UID: "bddc2009-c225-47db-b309-a7a961b6997f") : secret "insights-runtime-extractor-tls" not found
Jul 07 14:25:10.614157 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:10.614126    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z" event={"ID":"8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033","Type":"ContainerStarted","Data":"6c0851745b0ccf69d9f8a2f3a0bb011c639d5c344e8cc5a8b5d5459d196d95d8"}
Jul 07 14:25:10.614563 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:10.614175    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z" event={"ID":"8bf62f9f-9c1c-43c5-ab9b-93b7abd2d033","Type":"ContainerStarted","Data":"adfa8c37be3dd7e599aec9c6ef292a9ceb8fc9a5cb80dfcd049e35436d1acccb"}
Jul 07 14:25:10.633660 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:10.633614    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-bxw8z" podStartSLOduration=17.535131353 podStartE2EDuration="19.633582987s" totalImagesPullingTime="2.098451634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:10.632563541 +0000 UTC m=+65.838537672" watchObservedRunningTime="2026-07-07 14:25:10.633582987 +0000 UTC m=+65.839557115"
Jul 07 14:25:11.089549 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.089512    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs\") pod \"network-metrics-daemon-dtm6b\" (UID: \"e2990272-3824-4e47-9c86-367e50e46bfc\") " pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:25:11.092262 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.092235    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 14:25:11.100540 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:11.100508    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 14:25:11.100696 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:11.100584    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs podName:e2990272-3824-4e47-9c86-367e50e46bfc nodeName:}" failed. No retries permitted until 2026-07-07 14:26:15.100563716 +0000 UTC m=+130.306537845 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs") pod "network-metrics-daemon-dtm6b" (UID: "e2990272-3824-4e47-9c86-367e50e46bfc") : secret "metrics-daemon-secret" not found
Jul 07 14:25:11.190987 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.190955    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret\") pod \"global-pull-secret-syncer-pr7wh\" (UID: \"b3a21f69-c388-41a9-9d35-f6c4aa77ed86\") " pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:25:11.194135 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.194117    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 14:25:11.203847 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.203824    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b3a21f69-c388-41a9-9d35-f6c4aa77ed86-original-pull-secret\") pod \"global-pull-secret-syncer-pr7wh\" (UID: \"b3a21f69-c388-41a9-9d35-f6c4aa77ed86\") " pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:25:11.292001 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.291965    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq9sd\" (UniqueName: \"kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd\") pod \"network-check-target-69stk\" (UID: \"78b243a2-83e5-47a1-ba40-72c405e83077\") " pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:25:11.294972 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.294945    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq9sd\" (UniqueName: \"kubernetes.io/projected/78b243a2-83e5-47a1-ba40-72c405e83077-kube-api-access-vq9sd\") pod \"network-check-target-69stk\" (UID: \"78b243a2-83e5-47a1-ba40-72c405e83077\") " pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:25:11.313804 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.313780    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rzdvx\""
Jul 07 14:25:11.317234 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.317220    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pr7wh"
Jul 07 14:25:11.321358 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.321330    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:25:11.460427 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.460087    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pr7wh"]
Jul 07 14:25:11.462851 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:25:11.462825    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a21f69_c388_41a9_9d35_f6c4aa77ed86.slice/crio-b515c6d1b3ab768c9f183c730eccc53dcb2f39a09b6430fc5a0e1492fde72b8b WatchSource:0}: Error finding container b515c6d1b3ab768c9f183c730eccc53dcb2f39a09b6430fc5a0e1492fde72b8b: Status 404 returned error can't find the container with id b515c6d1b3ab768c9f183c730eccc53dcb2f39a09b6430fc5a0e1492fde72b8b
Jul 07 14:25:11.476990 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.476964    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-69stk"]
Jul 07 14:25:11.479419 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:25:11.479394    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78b243a2_83e5_47a1_ba40_72c405e83077.slice/crio-379298004dd94a392b1049b44440e9215b07d3922d4f8586a410f8123515aa01 WatchSource:0}: Error finding container 379298004dd94a392b1049b44440e9215b07d3922d4f8586a410f8123515aa01: Status 404 returned error can't find the container with id 379298004dd94a392b1049b44440e9215b07d3922d4f8586a410f8123515aa01
Jul 07 14:25:11.624439 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.624404    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-69stk" event={"ID":"78b243a2-83e5-47a1-ba40-72c405e83077","Type":"ContainerStarted","Data":"22182aba2e2070358956813adaab143c60bb410d772042c729d3abb5b5365276"}
Jul 07 14:25:11.624958 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.624493    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-69stk" event={"ID":"78b243a2-83e5-47a1-ba40-72c405e83077","Type":"ContainerStarted","Data":"379298004dd94a392b1049b44440e9215b07d3922d4f8586a410f8123515aa01"}
Jul 07 14:25:11.624958 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.624523    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:25:11.625657 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.625609    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pr7wh" event={"ID":"b3a21f69-c388-41a9-9d35-f6c4aa77ed86","Type":"ContainerStarted","Data":"b515c6d1b3ab768c9f183c730eccc53dcb2f39a09b6430fc5a0e1492fde72b8b"}
Jul 07 14:25:11.647903 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:11.647858    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-69stk" podStartSLOduration=65.64783983 podStartE2EDuration="1m5.64783983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:11.647382092 +0000 UTC m=+66.853356221" watchObservedRunningTime="2026-07-07 14:25:11.64783983 +0000 UTC m=+66.853813937"
Jul 07 14:25:13.290789 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:13.290756    2567 scope.go:117] "RemoveContainer" containerID="e10ba13957d6ef0c49f6acd602fc70bd9a4e64ff868fb449536349fac376660e"
Jul 07 14:25:13.636670 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:13.636343    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:25:13.636670 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:13.636444    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-wsdv5" event={"ID":"feff296c-ca8b-401c-840d-819465005d5d","Type":"ContainerStarted","Data":"10c29ef1e00889226c4e3a633e597b9351cf075a4dccd020502b89eedf812b98"}
Jul 07 14:25:13.637320 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:13.637293    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:25:13.672165 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:13.672109    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-wsdv5" podStartSLOduration=16.283866217 podStartE2EDuration="22.67209254s" totalImagesPullingTime="6.388226323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:13.670806805 +0000 UTC m=+68.876780971" watchObservedRunningTime="2026-07-07 14:25:13.67209254 +0000 UTC m=+68.878066684"
Jul 07 14:25:14.626456 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:14.626413    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:25:14.626959 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:14.626483    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:25:14.629502 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:14.629475    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls\") pod \"image-registry-7754b6d44-2jjsn\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") " pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:25:14.629667 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:14.629507    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48d7352c-0608-4b17-aecf-ff2cf067b5fd-metrics-tls\") pod \"dns-default-lzhnd\" (UID: \"48d7352c-0608-4b17-aecf-ff2cf067b5fd\") " pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:25:14.638688 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:14.638657    2567 patch_prober.go:28] interesting pod/console-operator-68b757fb67-wsdv5 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.16:8443/readyz\": context deadline exceeded" start-of-body=
Jul 07 14:25:14.638804 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:14.638716    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-wsdv5" podUID="feff296c-ca8b-401c-840d-819465005d5d" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.16:8443/readyz\": context deadline exceeded"
Jul 07 14:25:14.680910 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:14.680678    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-wsdv5"
Jul 07 14:25:14.771644 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:14.771613    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5f4rp\""
Jul 07 14:25:14.779391 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:14.779352    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:25:14.779970 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:14.779942    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-82rv6\""
Jul 07 14:25:14.788321 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:14.788297    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:25:15.584164 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:15.584135    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7754b6d44-2jjsn"]
Jul 07 14:25:15.594708 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:25:15.594683    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6b77cc_7d10_449a_ae8e_553340a879a1.slice/crio-b92a124c6397d9ded760387a24a771bba5afa636d94e2a8641505e04c3c3277c WatchSource:0}: Error finding container b92a124c6397d9ded760387a24a771bba5afa636d94e2a8641505e04c3c3277c: Status 404 returned error can't find the container with id b92a124c6397d9ded760387a24a771bba5afa636d94e2a8641505e04c3c3277c
Jul 07 14:25:15.602582 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:15.601691    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lzhnd"]
Jul 07 14:25:15.604527 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:25:15.604501    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d7352c_0608_4b17_aecf_ff2cf067b5fd.slice/crio-e603d69162a2bc726bcbe987728ccea982b52fbd7dc8ef87698f73f33a063ae9 WatchSource:0}: Error finding container e603d69162a2bc726bcbe987728ccea982b52fbd7dc8ef87698f73f33a063ae9: Status 404 returned error can't find the container with id e603d69162a2bc726bcbe987728ccea982b52fbd7dc8ef87698f73f33a063ae9
Jul 07 14:25:15.651521 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:15.651487    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pr7wh" event={"ID":"b3a21f69-c388-41a9-9d35-f6c4aa77ed86","Type":"ContainerStarted","Data":"cfd800802782ab3109551fdb3472f110023c8ab72201d77044c751fa1df4fefd"}
Jul 07 14:25:15.652995 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:15.652967    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7754b6d44-2jjsn" event={"ID":"4e6b77cc-7d10-449a-ae8e-553340a879a1","Type":"ContainerStarted","Data":"b92a124c6397d9ded760387a24a771bba5afa636d94e2a8641505e04c3c3277c"}
Jul 07 14:25:15.654165 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:15.654144    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lzhnd" event={"ID":"48d7352c-0608-4b17-aecf-ff2cf067b5fd","Type":"ContainerStarted","Data":"e603d69162a2bc726bcbe987728ccea982b52fbd7dc8ef87698f73f33a063ae9"}
Jul 07 14:25:16.658973 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:16.658935    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7754b6d44-2jjsn" event={"ID":"4e6b77cc-7d10-449a-ae8e-553340a879a1","Type":"ContainerStarted","Data":"36afa612d0f0cb9134b5975538c553ab364de9d97b32a308d499b33b42bc2a18"}
Jul 07 14:25:16.659359 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:16.659232    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:25:16.687783 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:16.687633    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pr7wh" podStartSLOduration=66.651768243 podStartE2EDuration="1m10.6876129s" totalImagesPullingTime="4.035844657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:15.673247427 +0000 UTC m=+70.879221557" watchObservedRunningTime="2026-07-07 14:25:16.6876129 +0000 UTC m=+71.893587022"
Jul 07 14:25:16.688387 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:16.688356    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7754b6d44-2jjsn" podStartSLOduration=70.688345136 podStartE2EDuration="1m10.688345136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:16.687091196 +0000 UTC m=+71.893065324" watchObservedRunningTime="2026-07-07 14:25:16.688345136 +0000 UTC m=+71.894319264"
Jul 07 14:25:16.846438 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:16.846404    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:16.846574 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:16.846500    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:16.847002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:16.846972    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bddc2009-c225-47db-b309-a7a961b6997f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:16.848879 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:16.848858    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bddc2009-c225-47db-b309-a7a961b6997f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8r8r6\" (UID: \"bddc2009-c225-47db-b309-a7a961b6997f\") " pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:16.969141 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:16.969062    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5ms4k\""
Jul 07 14:25:16.976532 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:16.976500    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8r8r6"
Jul 07 14:25:17.143307 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:17.143283    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8r8r6"]
Jul 07 14:25:17.146119 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:25:17.146086    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbddc2009_c225_47db_b309_a7a961b6997f.slice/crio-d764a3d684c41bd50c22d4c902b256c070c007e016b5fb78bd6675a63bb3adb1 WatchSource:0}: Error finding container d764a3d684c41bd50c22d4c902b256c070c007e016b5fb78bd6675a63bb3adb1: Status 404 returned error can't find the container with id d764a3d684c41bd50c22d4c902b256c070c007e016b5fb78bd6675a63bb3adb1
Jul 07 14:25:17.663156 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:17.663116    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8r8r6" event={"ID":"bddc2009-c225-47db-b309-a7a961b6997f","Type":"ContainerStarted","Data":"d764a3d684c41bd50c22d4c902b256c070c007e016b5fb78bd6675a63bb3adb1"}
Jul 07 14:25:18.671449 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:18.671411    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lzhnd" event={"ID":"48d7352c-0608-4b17-aecf-ff2cf067b5fd","Type":"ContainerStarted","Data":"20b2a9fbe8b39e6e5c6b2c6eaa63ec8f30874e969abec5c12b9cde99fc961cba"}
Jul 07 14:25:18.672052 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:18.671500    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lzhnd" event={"ID":"48d7352c-0608-4b17-aecf-ff2cf067b5fd","Type":"ContainerStarted","Data":"9dbb9285277cc4673ad5f165a197b2d28cdc082055e0af241046aeb80e554636"}
Jul 07 14:25:18.672052 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:18.671536    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:25:18.696444 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:18.696386    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lzhnd" podStartSLOduration=34.395711783 podStartE2EDuration="36.696363652s" totalImagesPullingTime="2.300651869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:18.69543006 +0000 UTC m=+73.901404212" watchObservedRunningTime="2026-07-07 14:25:18.696363652 +0000 UTC m=+73.902337781"
Jul 07 14:25:21.684448 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:21.684416    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8r8r6" event={"ID":"bddc2009-c225-47db-b309-a7a961b6997f","Type":"ContainerStarted","Data":"b00b207866e8d1c4a81d5615af9dc4d75e7bc385cb91ced63a540dd43bcbb395"}
Jul 07 14:25:22.690688 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:22.690654    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8r8r6" event={"ID":"bddc2009-c225-47db-b309-a7a961b6997f","Type":"ContainerStarted","Data":"7b35f460b2cf516ded2a4e03dbe7e89e710d12ddff287e6c3bd898fbf2835873"}
Jul 07 14:25:23.917418 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:23.917380    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:25:23.917923 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:23.917457    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kfp8s\" (UID: \"51ff0204-46fd-46b7-bd27-4a28a0683ae4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:25:23.917923 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:23.917498    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:25:23.918111 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:23.918081    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec46e625-a505-4243-97cd-b319c114f668-service-ca-bundle\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:25:23.920250 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:23.920222    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec46e625-a505-4243-97cd-b319c114f668-metrics-certs\") pod \"router-default-5df69cc7c9-xdxbd\" (UID: \"ec46e625-a505-4243-97cd-b319c114f668\") " pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:25:23.920416 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:23.920391    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/51ff0204-46fd-46b7-bd27-4a28a0683ae4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-kfp8s\" (UID: \"51ff0204-46fd-46b7-bd27-4a28a0683ae4\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:25:24.037489 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:24.037452    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2trxq\""
Jul 07 14:25:24.044025 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:24.044002    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"
Jul 07 14:25:24.048944 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:24.048920    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-bml9j\""
Jul 07 14:25:24.056983 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:24.056954    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:25:24.701495 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:24.701466    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8r8r6" event={"ID":"bddc2009-c225-47db-b309-a7a961b6997f","Type":"ContainerStarted","Data":"6fbe38bfbc19d0cabe88acaca00c97a5e3eb79a8f85bec6b2b24910077544f44"}
Jul 07 14:25:24.709506 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:24.709452    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5df69cc7c9-xdxbd"]
Jul 07 14:25:24.713105 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:25:24.713070    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec46e625_a505_4243_97cd_b319c114f668.slice/crio-d442a16865fde2c8a37e6b857d93246575ee9ffb43c8f02bdba067f2d54dc144 WatchSource:0}: Error finding container d442a16865fde2c8a37e6b857d93246575ee9ffb43c8f02bdba067f2d54dc144: Status 404 returned error can't find the container with id d442a16865fde2c8a37e6b857d93246575ee9ffb43c8f02bdba067f2d54dc144
Jul 07 14:25:24.731697 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:24.731655    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8r8r6" podStartSLOduration=16.377099915 podStartE2EDuration="23.73163932s" totalImagesPullingTime="7.354539405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:25:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:24.730167468 +0000 UTC m=+79.936141599" watchObservedRunningTime="2026-07-07 14:25:24.73163932 +0000 UTC m=+79.937613449"
Jul 07 14:25:24.734352 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:24.734334    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s"]
Jul 07 14:25:24.746643 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:25:24.746612    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ff0204_46fd_46b7_bd27_4a28a0683ae4.slice/crio-ea6c19bd3a8d7898aa093f6278afd6b3189aa23b5e6fd37de65daacb99d38470 WatchSource:0}: Error finding container ea6c19bd3a8d7898aa093f6278afd6b3189aa23b5e6fd37de65daacb99d38470: Status 404 returned error can't find the container with id ea6c19bd3a8d7898aa093f6278afd6b3189aa23b5e6fd37de65daacb99d38470
Jul 07 14:25:25.706388 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:25.706351    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s" event={"ID":"51ff0204-46fd-46b7-bd27-4a28a0683ae4","Type":"ContainerStarted","Data":"ea6c19bd3a8d7898aa093f6278afd6b3189aa23b5e6fd37de65daacb99d38470"}
Jul 07 14:25:25.707984 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:25.707954    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5df69cc7c9-xdxbd" event={"ID":"ec46e625-a505-4243-97cd-b319c114f668","Type":"ContainerStarted","Data":"5c6ce756dda0a5643af820f99def640a07574291d54fb5def424a472fa1f3104"}
Jul 07 14:25:25.708119 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:25.708010    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5df69cc7c9-xdxbd" event={"ID":"ec46e625-a505-4243-97cd-b319c114f668","Type":"ContainerStarted","Data":"d442a16865fde2c8a37e6b857d93246575ee9ffb43c8f02bdba067f2d54dc144"}
Jul 07 14:25:25.749185 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:25.749141    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5df69cc7c9-xdxbd" podStartSLOduration=34.749126358 podStartE2EDuration="34.749126358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:25.748741402 +0000 UTC m=+80.954715530" watchObservedRunningTime="2026-07-07 14:25:25.749126358 +0000 UTC m=+80.955100487"
Jul 07 14:25:26.057581 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:26.057490    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:25:26.060645 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:26.060616    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:25:26.712492 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:26.712353    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:25:26.713890 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:26.713868    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5df69cc7c9-xdxbd"
Jul 07 14:25:27.718092 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.718046    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s" event={"ID":"51ff0204-46fd-46b7-bd27-4a28a0683ae4","Type":"ContainerStarted","Data":"459cbb26263cc15ff90f98f2210e593c39018ab86c9bd7b3fed28c42dfdf149e"}
Jul 07 14:25:27.809299 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.809245    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-kfp8s" podStartSLOduration=34.743552807 podStartE2EDuration="36.809228076s" totalImagesPullingTime="2.065675269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:27.780052165 +0000 UTC m=+82.986026294" watchObservedRunningTime="2026-07-07 14:25:27.809228076 +0000 UTC m=+83.015202204"
Jul 07 14:25:27.810541 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.810515    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn"]
Jul 07 14:25:27.813788 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.813765    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn"
Jul 07 14:25:27.815481 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.815460    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8bc48c46-fqgxb"]
Jul 07 14:25:27.818290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.818269    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8bc48c46-fqgxb"
Jul 07 14:25:27.830232 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.830214    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 07 14:25:27.830331 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.830264    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 14:25:27.831948 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.831934    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 14:25:27.833137 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.833118    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 14:25:27.836472 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.836454    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-gk984\""
Jul 07 14:25:27.837078 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.837063    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 14:25:27.848043 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.848013    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6c478ce-57da-45ab-a504-087981088f4c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b8bc48c46-fqgxb\" (UID: \"d6c478ce-57da-45ab-a504-087981088f4c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8bc48c46-fqgxb"
Jul 07 14:25:27.848141 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.848047    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f23d62c0-ab95-431c-9686-ae0de1c009fd-klusterlet-config\") pod \"klusterlet-addon-workmgr-6795d8786b-vjxtn\" (UID: \"f23d62c0-ab95-431c-9686-ae0de1c009fd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn"
Jul 07 14:25:27.848141 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.848072    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxkdj\" (UniqueName: \"kubernetes.io/projected/d6c478ce-57da-45ab-a504-087981088f4c-kube-api-access-hxkdj\") pod \"managed-serviceaccount-addon-agent-b8bc48c46-fqgxb\" (UID: \"d6c478ce-57da-45ab-a504-087981088f4c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8bc48c46-fqgxb"
Jul 07 14:25:27.848141 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.848093    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f23d62c0-ab95-431c-9686-ae0de1c009fd-tmp\") pod \"klusterlet-addon-workmgr-6795d8786b-vjxtn\" (UID: \"f23d62c0-ab95-431c-9686-ae0de1c009fd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn"
Jul 07 14:25:27.848294 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.848223    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csm6f\" (UniqueName: \"kubernetes.io/projected/f23d62c0-ab95-431c-9686-ae0de1c009fd-kube-api-access-csm6f\") pod \"klusterlet-addon-workmgr-6795d8786b-vjxtn\" (UID: \"f23d62c0-ab95-431c-9686-ae0de1c009fd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn"
Jul 07 14:25:27.864731 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.864709    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"]
Jul 07 14:25:27.868106 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.868088    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:27.877558 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.877543    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 14:25:27.893605 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.893565    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8bc48c46-fqgxb"]
Jul 07 14:25:27.899343 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.899322    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 14:25:27.899343 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.899338    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 14:25:27.904360 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.904346    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 14:25:27.912842 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.912820    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn"]
Jul 07 14:25:27.949271 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.949202    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6c478ce-57da-45ab-a504-087981088f4c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b8bc48c46-fqgxb\" (UID: \"d6c478ce-57da-45ab-a504-087981088f4c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8bc48c46-fqgxb"
Jul 07 14:25:27.949271 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.949253    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f23d62c0-ab95-431c-9686-ae0de1c009fd-klusterlet-config\") pod \"klusterlet-addon-workmgr-6795d8786b-vjxtn\" (UID: \"f23d62c0-ab95-431c-9686-ae0de1c009fd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn"
Jul 07 14:25:27.949459 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.949280    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:27.949459 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.949318    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxkdj\" (UniqueName: \"kubernetes.io/projected/d6c478ce-57da-45ab-a504-087981088f4c-kube-api-access-hxkdj\") pod \"managed-serviceaccount-addon-agent-b8bc48c46-fqgxb\" (UID: \"d6c478ce-57da-45ab-a504-087981088f4c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8bc48c46-fqgxb"
Jul 07 14:25:27.949459 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.949342    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:27.949459 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.949368    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:27.949459 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.949395    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f23d62c0-ab95-431c-9686-ae0de1c009fd-tmp\") pod \"klusterlet-addon-workmgr-6795d8786b-vjxtn\" (UID: \"f23d62c0-ab95-431c-9686-ae0de1c009fd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn"
Jul 07 14:25:27.949722 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.949464    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-hub\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:27.949722 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.949502    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78hcx\" (UniqueName: \"kubernetes.io/projected/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-kube-api-access-78hcx\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:27.949722 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.949553    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-ca\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:27.949871 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.949770    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f23d62c0-ab95-431c-9686-ae0de1c009fd-tmp\") pod \"klusterlet-addon-workmgr-6795d8786b-vjxtn\" (UID: \"f23d62c0-ab95-431c-9686-ae0de1c009fd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn"
Jul 07 14:25:27.949871 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.949804    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csm6f\" (UniqueName: \"kubernetes.io/projected/f23d62c0-ab95-431c-9686-ae0de1c009fd-kube-api-access-csm6f\") pod \"klusterlet-addon-workmgr-6795d8786b-vjxtn\" (UID: \"f23d62c0-ab95-431c-9686-ae0de1c009fd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn"
Jul 07 14:25:27.952651 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.952624    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/f23d62c0-ab95-431c-9686-ae0de1c009fd-klusterlet-config\") pod \"klusterlet-addon-workmgr-6795d8786b-vjxtn\" (UID: \"f23d62c0-ab95-431c-9686-ae0de1c009fd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn"
Jul 07 14:25:27.953007 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.952989    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6c478ce-57da-45ab-a504-087981088f4c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b8bc48c46-fqgxb\" (UID: \"d6c478ce-57da-45ab-a504-087981088f4c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8bc48c46-fqgxb"
Jul 07 14:25:27.969285 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:27.969262    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"]
Jul 07 14:25:28.006551 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.006518    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csm6f\" (UniqueName: \"kubernetes.io/projected/f23d62c0-ab95-431c-9686-ae0de1c009fd-kube-api-access-csm6f\") pod \"klusterlet-addon-workmgr-6795d8786b-vjxtn\" (UID: \"f23d62c0-ab95-431c-9686-ae0de1c009fd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn"
Jul 07 14:25:28.020328 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.020296    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxkdj\" (UniqueName: \"kubernetes.io/projected/d6c478ce-57da-45ab-a504-087981088f4c-kube-api-access-hxkdj\") pod \"managed-serviceaccount-addon-agent-b8bc48c46-fqgxb\" (UID: \"d6c478ce-57da-45ab-a504-087981088f4c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8bc48c46-fqgxb"
Jul 07 14:25:28.050334 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.050302    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:28.050477 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.050360    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:28.050477 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.050398    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:28.050477 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.050429    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-hub\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:28.050477 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.050452    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78hcx\" (UniqueName: \"kubernetes.io/projected/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-kube-api-access-78hcx\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:28.050699 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.050498    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-ca\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:28.051565 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.051506    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:28.053603 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.053564    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-hub\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:28.053707 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.053654    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:28.053990 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.053969    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:28.054057 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.053991    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-ca\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:28.078856 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.078829    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78hcx\" (UniqueName: \"kubernetes.io/projected/c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7-kube-api-access-78hcx\") pod \"cluster-proxy-proxy-agent-595788-h2xcp\" (UID: \"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:28.124188 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.124158    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn"
Jul 07 14:25:28.139478 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.139446    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8bc48c46-fqgxb"
Jul 07 14:25:28.176864 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.176757    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"
Jul 07 14:25:28.291024 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.290998    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn"]
Jul 07 14:25:28.293577 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:25:28.293546    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf23d62c0_ab95_431c_9686_ae0de1c009fd.slice/crio-2b16295cbffeccee10081f9d1780d14fde5e25024faecb08a8285cd0eb474fc3 WatchSource:0}: Error finding container 2b16295cbffeccee10081f9d1780d14fde5e25024faecb08a8285cd0eb474fc3: Status 404 returned error can't find the container with id 2b16295cbffeccee10081f9d1780d14fde5e25024faecb08a8285cd0eb474fc3
Jul 07 14:25:28.316911 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.316884    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8bc48c46-fqgxb"]
Jul 07 14:25:28.319521 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:25:28.319487    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6c478ce_57da_45ab_a504_087981088f4c.slice/crio-14a5ffad6d86db0e0fb3487b8e3cc92083521a2553bf97090a3f0893b1f6a25c WatchSource:0}: Error finding container 14a5ffad6d86db0e0fb3487b8e3cc92083521a2553bf97090a3f0893b1f6a25c: Status 404 returned error can't find the container with id 14a5ffad6d86db0e0fb3487b8e3cc92083521a2553bf97090a3f0893b1f6a25c
Jul 07 14:25:28.340633 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.340605    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp"]
Jul 07 14:25:28.343622 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:25:28.343584    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2d0e156_5b9d_42c3_96eb_5df0e2ef74d7.slice/crio-301a2f0e894f4ee54f548a78899f4366fcf78647e19d1479a6bab86b29dd8ff3 WatchSource:0}: Error finding container 301a2f0e894f4ee54f548a78899f4366fcf78647e19d1479a6bab86b29dd8ff3: Status 404 returned error can't find the container with id 301a2f0e894f4ee54f548a78899f4366fcf78647e19d1479a6bab86b29dd8ff3
Jul 07 14:25:28.678679 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.678653    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lzhnd"
Jul 07 14:25:28.730178 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.730131    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp" event={"ID":"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7","Type":"ContainerStarted","Data":"301a2f0e894f4ee54f548a78899f4366fcf78647e19d1479a6bab86b29dd8ff3"}
Jul 07 14:25:28.731469 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.731442    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8bc48c46-fqgxb" event={"ID":"d6c478ce-57da-45ab-a504-087981088f4c","Type":"ContainerStarted","Data":"14a5ffad6d86db0e0fb3487b8e3cc92083521a2553bf97090a3f0893b1f6a25c"}
Jul 07 14:25:28.732622 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:28.732574    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn" event={"ID":"f23d62c0-ab95-431c-9686-ae0de1c009fd","Type":"ContainerStarted","Data":"2b16295cbffeccee10081f9d1780d14fde5e25024faecb08a8285cd0eb474fc3"}
Jul 07 14:25:34.784861 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:34.784826    2567 patch_prober.go:28] interesting pod/image-registry-7754b6d44-2jjsn container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 14:25:34.785192 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:34.784895    2567 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7754b6d44-2jjsn" podUID="4e6b77cc-7d10-449a-ae8e-553340a879a1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 14:25:35.771233 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:35.771193    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp" event={"ID":"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7","Type":"ContainerStarted","Data":"856a521507a64d827804b68503e341e7088ea2e80fbf58a2dcd812e1b7364769"}
Jul 07 14:25:35.771233 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:35.771248    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp" event={"ID":"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7","Type":"ContainerStarted","Data":"971996a8bbbed968bd9e9ae0d5471083dbad1803d4332cddb87cddd63bc9f1df"}
Jul 07 14:25:35.771466 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:35.771268    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp" event={"ID":"c2d0e156-5b9d-42c3-96eb-5df0e2ef74d7","Type":"ContainerStarted","Data":"8dfa96e3176d2d6c06e7b5bcc126e0ffdb81ed6881b562dcf481e395e91db451"}
Jul 07 14:25:35.772677 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:35.772654    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8bc48c46-fqgxb" event={"ID":"d6c478ce-57da-45ab-a504-087981088f4c","Type":"ContainerStarted","Data":"cfeb88868219fb6fbd48c146bef636f96095e0092ad56a198d764c9787d6f9f7"}
Jul 07 14:25:35.774045 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:35.774025    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn" event={"ID":"f23d62c0-ab95-431c-9686-ae0de1c009fd","Type":"ContainerStarted","Data":"56700f06c0928426c8a484001391a9ecc0aef2cee3eab22132c8d81836ef1053"}
Jul 07 14:25:35.774234 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:35.774216    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn"
Jul 07 14:25:35.776092 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:35.776070    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn"
Jul 07 14:25:35.800718 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:35.800666    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-595788-h2xcp" podStartSLOduration=2.394235282 podStartE2EDuration="8.800649413s" totalImagesPullingTime="6.406414131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:35.798253291 +0000 UTC m=+91.004227420" watchObservedRunningTime="2026-07-07 14:25:35.800649413 +0000 UTC m=+91.006623542"
Jul 07 14:25:35.821672 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:35.821617    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8bc48c46-fqgxb" podStartSLOduration=2.407261382 podStartE2EDuration="8.821574946s" totalImagesPullingTime="6.414313564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:35.821154296 +0000 UTC m=+91.027128424" watchObservedRunningTime="2026-07-07 14:25:35.821574946 +0000 UTC m=+91.027549075"
Jul 07 14:25:37.667378 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:37.667349    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:25:37.707951 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:37.707905    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6795d8786b-vjxtn" podStartSLOduration=4.253002809 podStartE2EDuration="10.707890039s" totalImagesPullingTime="6.45488723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:35.84613162 +0000 UTC m=+91.052105748" watchObservedRunningTime="2026-07-07 14:25:37.707890039 +0000 UTC m=+92.913864168"
Jul 07 14:25:42.633057 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:42.633027    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-69stk"
Jul 07 14:25:42.957949 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:42.957911    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tpxvn"]
Jul 07 14:25:42.961716 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:42.961690    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:42.965910 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:42.965885    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 14:25:42.966624 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:42.966583    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 14:25:42.966958 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:42.966943    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 14:25:42.969073 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:42.969055    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p2mqk\""
Jul 07 14:25:42.969218 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:42.969118    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 14:25:43.081945 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.081912    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f0628b4-8713-45b5-ba34-c099777692f6-metrics-client-ca\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.081945 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.081950    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f0628b4-8713-45b5-ba34-c099777692f6-root\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.082184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.081982    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-wtmp\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.082184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.082102    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-textfile\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.082184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.082144    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.082318 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.082195    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.082318 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.082224    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f0628b4-8713-45b5-ba34-c099777692f6-sys\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.082318 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.082239    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-tls\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.082708 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.082666    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sgmh\" (UniqueName: \"kubernetes.io/projected/1f0628b4-8713-45b5-ba34-c099777692f6-kube-api-access-9sgmh\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.189537 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.189493    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-wtmp\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.189705 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.189572    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-textfile\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.189705 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.189627    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.189705 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.189666    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.189884 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.189694    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-wtmp\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.189884 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.189702    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f0628b4-8713-45b5-ba34-c099777692f6-sys\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.189884 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.189764    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-tls\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.189884 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.189856    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f0628b4-8713-45b5-ba34-c099777692f6-sys\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.189884 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:43.189880    2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 14:25:43.190105 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.189911    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sgmh\" (UniqueName: \"kubernetes.io/projected/1f0628b4-8713-45b5-ba34-c099777692f6-kube-api-access-9sgmh\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.190105 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:25:43.189939    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-tls podName:1f0628b4-8713-45b5-ba34-c099777692f6 nodeName:}" failed. No retries permitted until 2026-07-07 14:25:43.689919428 +0000 UTC m=+98.895893539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-tls") pod "node-exporter-tpxvn" (UID: "1f0628b4-8713-45b5-ba34-c099777692f6") : secret "node-exporter-tls" not found
Jul 07 14:25:43.190105 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.189995    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-textfile\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.190105 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.189999    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f0628b4-8713-45b5-ba34-c099777692f6-metrics-client-ca\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.190105 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.190050    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f0628b4-8713-45b5-ba34-c099777692f6-root\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.190354 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.190126    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f0628b4-8713-45b5-ba34-c099777692f6-root\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.190406 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.190347    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.190496 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.190465    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f0628b4-8713-45b5-ba34-c099777692f6-metrics-client-ca\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.192319 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.192295    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.200073 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.200044    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sgmh\" (UniqueName: \"kubernetes.io/projected/1f0628b4-8713-45b5-ba34-c099777692f6-kube-api-access-9sgmh\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.694038 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.693998    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-tls\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.696360 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.696340    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f0628b4-8713-45b5-ba34-c099777692f6-node-exporter-tls\") pod \"node-exporter-tpxvn\" (UID: \"1f0628b4-8713-45b5-ba34-c099777692f6\") " pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.874331 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:43.874299    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tpxvn"
Jul 07 14:25:43.885031 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:25:43.885002    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f0628b4_8713_45b5_ba34_c099777692f6.slice/crio-5995574b69352bf47314027b39e59c76fdce13d481454a994a6cea8607ab1383 WatchSource:0}: Error finding container 5995574b69352bf47314027b39e59c76fdce13d481454a994a6cea8607ab1383: Status 404 returned error can't find the container with id 5995574b69352bf47314027b39e59c76fdce13d481454a994a6cea8607ab1383
Jul 07 14:25:44.808256 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:44.808218    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tpxvn" event={"ID":"1f0628b4-8713-45b5-ba34-c099777692f6","Type":"ContainerStarted","Data":"5995574b69352bf47314027b39e59c76fdce13d481454a994a6cea8607ab1383"}
Jul 07 14:25:45.814475 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:45.814437    2567 generic.go:356] "Generic (PLEG): container finished" podID="1f0628b4-8713-45b5-ba34-c099777692f6" containerID="d7fcaf100d4e6c0fb8d5159f7c67d6cb3e19e118cfcec50c452738ea55e39e0f" exitCode=0
Jul 07 14:25:45.814892 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:45.814531    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tpxvn" event={"ID":"1f0628b4-8713-45b5-ba34-c099777692f6","Type":"ContainerDied","Data":"d7fcaf100d4e6c0fb8d5159f7c67d6cb3e19e118cfcec50c452738ea55e39e0f"}
Jul 07 14:25:46.820144 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:46.820105    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tpxvn" event={"ID":"1f0628b4-8713-45b5-ba34-c099777692f6","Type":"ContainerStarted","Data":"a24ec10b07fd0750e55c6a8973985653d4141b40e5129a8650390dd74bb5898b"}
Jul 07 14:25:46.820660 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:46.820199    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tpxvn" event={"ID":"1f0628b4-8713-45b5-ba34-c099777692f6","Type":"ContainerStarted","Data":"2a00b108253c92a16013ecd80fe7e43e3ca5dcc01f832d1beb6f7acd148765c1"}
Jul 07 14:25:46.851258 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:46.851205    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tpxvn" podStartSLOduration=3.615974362 podStartE2EDuration="4.851191836s" totalImagesPullingTime="1.162320559s" totalInitContainerRuntime="72.896915ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:25:46.848990132 +0000 UTC m=+102.054964259" watchObservedRunningTime="2026-07-07 14:25:46.851191836 +0000 UTC m=+102.057165966"
Jul 07 14:25:50.823990 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:25:50.823957    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7754b6d44-2jjsn"]
Jul 07 14:26:05.889864 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:05.889828    2567 generic.go:356] "Generic (PLEG): container finished" podID="f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2" containerID="f8a87a8961589350658490c0fa04c60a562ebbaf6bb71507a5e3b763beb8451d" exitCode=0
Jul 07 14:26:05.890361 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:05.889909    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf" event={"ID":"f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2","Type":"ContainerDied","Data":"f8a87a8961589350658490c0fa04c60a562ebbaf6bb71507a5e3b763beb8451d"}
Jul 07 14:26:05.890361 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:05.890324    2567 scope.go:117] "RemoveContainer" containerID="f8a87a8961589350658490c0fa04c60a562ebbaf6bb71507a5e3b763beb8451d"
Jul 07 14:26:06.895108 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:06.895072    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-7vdvf" event={"ID":"f6e8e5ee-73c0-407a-be5a-4dd9b9748fe2","Type":"ContainerStarted","Data":"87e2f66513c7fc24cd3350c7a5ff426df1ca7b0c344f8704cdecd51bc6de7ce4"}
Jul 07 14:26:15.172319 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:15.172276    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs\") pod \"network-metrics-daemon-dtm6b\" (UID: \"e2990272-3824-4e47-9c86-367e50e46bfc\") " pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:26:15.174720 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:15.174698    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2990272-3824-4e47-9c86-367e50e46bfc-metrics-certs\") pod \"network-metrics-daemon-dtm6b\" (UID: \"e2990272-3824-4e47-9c86-367e50e46bfc\") " pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:26:15.205498 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:15.205469    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p9bwj\""
Jul 07 14:26:15.213754 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:15.213731    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtm6b"
Jul 07 14:26:15.352495 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:15.352418    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dtm6b"]
Jul 07 14:26:15.355199 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:26:15.355174    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2990272_3824_4e47_9c86_367e50e46bfc.slice/crio-494201775ff9665f449cc9ac3805c3c43a2585b1c7a9e4255517f5e8731135af WatchSource:0}: Error finding container 494201775ff9665f449cc9ac3805c3c43a2585b1c7a9e4255517f5e8731135af: Status 404 returned error can't find the container with id 494201775ff9665f449cc9ac3805c3c43a2585b1c7a9e4255517f5e8731135af
Jul 07 14:26:15.844813 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:15.844747    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7754b6d44-2jjsn" podUID="4e6b77cc-7d10-449a-ae8e-553340a879a1" containerName="registry" containerID="cri-o://36afa612d0f0cb9134b5975538c553ab364de9d97b32a308d499b33b42bc2a18" gracePeriod=30
Jul 07 14:26:15.930302 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:15.930265    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtm6b" event={"ID":"e2990272-3824-4e47-9c86-367e50e46bfc","Type":"ContainerStarted","Data":"494201775ff9665f449cc9ac3805c3c43a2585b1c7a9e4255517f5e8731135af"}
Jul 07 14:26:16.086430 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.086407    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:26:16.177899 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.177862    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e6b77cc-7d10-449a-ae8e-553340a879a1-image-registry-private-configuration\") pod \"4e6b77cc-7d10-449a-ae8e-553340a879a1\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") "
Jul 07 14:26:16.178346 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.177914    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e6b77cc-7d10-449a-ae8e-553340a879a1-ca-trust-extracted\") pod \"4e6b77cc-7d10-449a-ae8e-553340a879a1\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") "
Jul 07 14:26:16.178346 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.177949    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rr5c6\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-kube-api-access-rr5c6\") pod \"4e6b77cc-7d10-449a-ae8e-553340a879a1\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") "
Jul 07 14:26:16.178346 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.177973    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls\") pod \"4e6b77cc-7d10-449a-ae8e-553340a879a1\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") "
Jul 07 14:26:16.178346 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.178016    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e6b77cc-7d10-449a-ae8e-553340a879a1-trusted-ca\") pod \"4e6b77cc-7d10-449a-ae8e-553340a879a1\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") "
Jul 07 14:26:16.178346 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.178047    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-certificates\") pod \"4e6b77cc-7d10-449a-ae8e-553340a879a1\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") "
Jul 07 14:26:16.178346 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.178076    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e6b77cc-7d10-449a-ae8e-553340a879a1-installation-pull-secrets\") pod \"4e6b77cc-7d10-449a-ae8e-553340a879a1\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") "
Jul 07 14:26:16.178346 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.178101    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-bound-sa-token\") pod \"4e6b77cc-7d10-449a-ae8e-553340a879a1\" (UID: \"4e6b77cc-7d10-449a-ae8e-553340a879a1\") "
Jul 07 14:26:16.179284 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.179058    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e6b77cc-7d10-449a-ae8e-553340a879a1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4e6b77cc-7d10-449a-ae8e-553340a879a1" (UID: "4e6b77cc-7d10-449a-ae8e-553340a879a1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:26:16.179284 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.179243    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4e6b77cc-7d10-449a-ae8e-553340a879a1" (UID: "4e6b77cc-7d10-449a-ae8e-553340a879a1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:26:16.182757 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.181447    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e6b77cc-7d10-449a-ae8e-553340a879a1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4e6b77cc-7d10-449a-ae8e-553340a879a1" (UID: "4e6b77cc-7d10-449a-ae8e-553340a879a1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:26:16.182757 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.181562    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-kube-api-access-rr5c6" (OuterVolumeSpecName: "kube-api-access-rr5c6") pod "4e6b77cc-7d10-449a-ae8e-553340a879a1" (UID: "4e6b77cc-7d10-449a-ae8e-553340a879a1"). InnerVolumeSpecName "kube-api-access-rr5c6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:26:16.182757 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.181661    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e6b77cc-7d10-449a-ae8e-553340a879a1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4e6b77cc-7d10-449a-ae8e-553340a879a1" (UID: "4e6b77cc-7d10-449a-ae8e-553340a879a1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:26:16.182757 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.181724    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4e6b77cc-7d10-449a-ae8e-553340a879a1" (UID: "4e6b77cc-7d10-449a-ae8e-553340a879a1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:26:16.182757 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.181907    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4e6b77cc-7d10-449a-ae8e-553340a879a1" (UID: "4e6b77cc-7d10-449a-ae8e-553340a879a1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:26:16.188555 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.188527    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e6b77cc-7d10-449a-ae8e-553340a879a1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4e6b77cc-7d10-449a-ae8e-553340a879a1" (UID: "4e6b77cc-7d10-449a-ae8e-553340a879a1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:26:16.278908 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.278874    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4e6b77cc-7d10-449a-ae8e-553340a879a1-image-registry-private-configuration\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:26:16.278908 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.278908    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4e6b77cc-7d10-449a-ae8e-553340a879a1-ca-trust-extracted\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:26:16.279104 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.278924    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rr5c6\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-kube-api-access-rr5c6\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:26:16.279104 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.278935    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:26:16.279104 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.278943    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4e6b77cc-7d10-449a-ae8e-553340a879a1-trusted-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:26:16.279104 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.278950    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4e6b77cc-7d10-449a-ae8e-553340a879a1-registry-certificates\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:26:16.279104 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.278958    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4e6b77cc-7d10-449a-ae8e-553340a879a1-installation-pull-secrets\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:26:16.279104 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.278966    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4e6b77cc-7d10-449a-ae8e-553340a879a1-bound-sa-token\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:26:16.935375 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.935336    2567 generic.go:356] "Generic (PLEG): container finished" podID="4e6b77cc-7d10-449a-ae8e-553340a879a1" containerID="36afa612d0f0cb9134b5975538c553ab364de9d97b32a308d499b33b42bc2a18" exitCode=0
Jul 07 14:26:16.935539 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.935381    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7754b6d44-2jjsn"
Jul 07 14:26:16.935539 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.935430    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7754b6d44-2jjsn" event={"ID":"4e6b77cc-7d10-449a-ae8e-553340a879a1","Type":"ContainerDied","Data":"36afa612d0f0cb9134b5975538c553ab364de9d97b32a308d499b33b42bc2a18"}
Jul 07 14:26:16.935539 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.935484    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7754b6d44-2jjsn" event={"ID":"4e6b77cc-7d10-449a-ae8e-553340a879a1","Type":"ContainerDied","Data":"b92a124c6397d9ded760387a24a771bba5afa636d94e2a8641505e04c3c3277c"}
Jul 07 14:26:16.935539 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.935510    2567 scope.go:117] "RemoveContainer" containerID="36afa612d0f0cb9134b5975538c553ab364de9d97b32a308d499b33b42bc2a18"
Jul 07 14:26:16.937448 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.937414    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtm6b" event={"ID":"e2990272-3824-4e47-9c86-367e50e46bfc","Type":"ContainerStarted","Data":"105b88f4f93937d4c98531fa5e54a69ef3cf6ab9afac5ba0da4215975af2d451"}
Jul 07 14:26:16.937552 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.937477    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtm6b" event={"ID":"e2990272-3824-4e47-9c86-367e50e46bfc","Type":"ContainerStarted","Data":"8cbde4fe9a9da72072451e81cc1d8335983d691bbfbda7b2bc27b9e9d1daba40"}
Jul 07 14:26:16.944524 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.944507    2567 scope.go:117] "RemoveContainer" containerID="36afa612d0f0cb9134b5975538c553ab364de9d97b32a308d499b33b42bc2a18"
Jul 07 14:26:16.944908 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:26:16.944884    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36afa612d0f0cb9134b5975538c553ab364de9d97b32a308d499b33b42bc2a18\": container with ID starting with 36afa612d0f0cb9134b5975538c553ab364de9d97b32a308d499b33b42bc2a18 not found: ID does not exist" containerID="36afa612d0f0cb9134b5975538c553ab364de9d97b32a308d499b33b42bc2a18"
Jul 07 14:26:16.945041 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.944918    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36afa612d0f0cb9134b5975538c553ab364de9d97b32a308d499b33b42bc2a18"} err="failed to get container status \"36afa612d0f0cb9134b5975538c553ab364de9d97b32a308d499b33b42bc2a18\": rpc error: code = NotFound desc = could not find container \"36afa612d0f0cb9134b5975538c553ab364de9d97b32a308d499b33b42bc2a18\": container with ID starting with 36afa612d0f0cb9134b5975538c553ab364de9d97b32a308d499b33b42bc2a18 not found: ID does not exist"
Jul 07 14:26:16.960844 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.960799    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dtm6b" podStartSLOduration=129.827047465 podStartE2EDuration="2m10.960786063s" totalImagesPullingTime="1.133738598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:26:16.959648487 +0000 UTC m=+132.165622616" watchObservedRunningTime="2026-07-07 14:26:16.960786063 +0000 UTC m=+132.166760191"
Jul 07 14:26:16.977810 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.977784    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7754b6d44-2jjsn"]
Jul 07 14:26:16.987982 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:16.987953    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7754b6d44-2jjsn"]
Jul 07 14:26:17.296041 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:17.295946    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e6b77cc-7d10-449a-ae8e-553340a879a1" path="/var/lib/kubelet/pods/4e6b77cc-7d10-449a-ae8e-553340a879a1/volumes"
Jul 07 14:26:19.952127 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:19.952093    2567 generic.go:356] "Generic (PLEG): container finished" podID="6ee660c9-2199-46ff-96b4-bf0e99a0cdfc" containerID="eeb99f475ac10f5e67227c74ac9e5b5eb35e806570c991ddbce7b2dbb6b7b7a6" exitCode=0
Jul 07 14:26:19.952472 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:19.952139    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv" event={"ID":"6ee660c9-2199-46ff-96b4-bf0e99a0cdfc","Type":"ContainerDied","Data":"eeb99f475ac10f5e67227c74ac9e5b5eb35e806570c991ddbce7b2dbb6b7b7a6"}
Jul 07 14:26:19.952472 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:19.952431    2567 scope.go:117] "RemoveContainer" containerID="eeb99f475ac10f5e67227c74ac9e5b5eb35e806570c991ddbce7b2dbb6b7b7a6"
Jul 07 14:26:20.959004 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:20.958964    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rx5vv" event={"ID":"6ee660c9-2199-46ff-96b4-bf0e99a0cdfc","Type":"ContainerStarted","Data":"50801e02d1e16149097cd612bff6d6ced4d2f206b863b7c23c279a29a385b041"}
Jul 07 14:26:30.997941 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:30.997904    2567 generic.go:356] "Generic (PLEG): container finished" podID="246e477f-d040-4356-a575-f78f652b6192" containerID="9477356016cf2d2bcf81f5fa575886eff6d5d3501671b9da2a78578bb2709ff1" exitCode=0
Jul 07 14:26:30.998348 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:30.997972    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-m4684" event={"ID":"246e477f-d040-4356-a575-f78f652b6192","Type":"ContainerDied","Data":"9477356016cf2d2bcf81f5fa575886eff6d5d3501671b9da2a78578bb2709ff1"}
Jul 07 14:26:30.998348 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:30.998306    2567 scope.go:117] "RemoveContainer" containerID="9477356016cf2d2bcf81f5fa575886eff6d5d3501671b9da2a78578bb2709ff1"
Jul 07 14:26:32.005509 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:26:32.005467    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-m4684" event={"ID":"246e477f-d040-4356-a575-f78f652b6192","Type":"ContainerStarted","Data":"3230cea1536bf5453709db1f99add6e813ecf41a62e4c31301365d4bf2dc8b46"}
Jul 07 14:29:05.227474 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:05.227431    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:29:05.229524 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:05.229500    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:29:05.239667 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:05.239638    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 14:29:44.746453 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.746424    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"]
Jul 07 14:29:44.748736 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.746730    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e6b77cc-7d10-449a-ae8e-553340a879a1" containerName="registry"
Jul 07 14:29:44.748736 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.746741    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e6b77cc-7d10-449a-ae8e-553340a879a1" containerName="registry"
Jul 07 14:29:44.748736 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.746794    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e6b77cc-7d10-449a-ae8e-553340a879a1" containerName="registry"
Jul 07 14:29:44.749689 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.749665    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:44.752443 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.752425    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 14:29:44.752538 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.752440    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-v7xjz\""
Jul 07 14:29:44.752828 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.752814    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 14:29:44.753179 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.753163    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 14:29:44.753247 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.753220    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 14:29:44.763188 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.763164    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"]
Jul 07 14:29:44.834629 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.834576    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/490ce88c-25d5-4b0c-8036-7341ddf0b1c5-manifests\") pod \"opendatahub-operator-controller-manager-6f546bc4-7hrb8\" (UID: \"490ce88c-25d5-4b0c-8036-7341ddf0b1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:44.834805 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.834641    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/490ce88c-25d5-4b0c-8036-7341ddf0b1c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f546bc4-7hrb8\" (UID: \"490ce88c-25d5-4b0c-8036-7341ddf0b1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:44.834805 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.834718    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc6v5\" (UniqueName: \"kubernetes.io/projected/490ce88c-25d5-4b0c-8036-7341ddf0b1c5-kube-api-access-bc6v5\") pod \"opendatahub-operator-controller-manager-6f546bc4-7hrb8\" (UID: \"490ce88c-25d5-4b0c-8036-7341ddf0b1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:44.834805 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.834780    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/490ce88c-25d5-4b0c-8036-7341ddf0b1c5-tmp\") pod \"opendatahub-operator-controller-manager-6f546bc4-7hrb8\" (UID: \"490ce88c-25d5-4b0c-8036-7341ddf0b1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:44.834958 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.834805    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/490ce88c-25d5-4b0c-8036-7341ddf0b1c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f546bc4-7hrb8\" (UID: \"490ce88c-25d5-4b0c-8036-7341ddf0b1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:44.935422 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.935390    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/490ce88c-25d5-4b0c-8036-7341ddf0b1c5-tmp\") pod \"opendatahub-operator-controller-manager-6f546bc4-7hrb8\" (UID: \"490ce88c-25d5-4b0c-8036-7341ddf0b1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:44.935422 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.935424    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/490ce88c-25d5-4b0c-8036-7341ddf0b1c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f546bc4-7hrb8\" (UID: \"490ce88c-25d5-4b0c-8036-7341ddf0b1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:44.935678 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.935561    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/490ce88c-25d5-4b0c-8036-7341ddf0b1c5-manifests\") pod \"opendatahub-operator-controller-manager-6f546bc4-7hrb8\" (UID: \"490ce88c-25d5-4b0c-8036-7341ddf0b1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:44.935736 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.935699    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/490ce88c-25d5-4b0c-8036-7341ddf0b1c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f546bc4-7hrb8\" (UID: \"490ce88c-25d5-4b0c-8036-7341ddf0b1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:44.935791 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.935774    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc6v5\" (UniqueName: \"kubernetes.io/projected/490ce88c-25d5-4b0c-8036-7341ddf0b1c5-kube-api-access-bc6v5\") pod \"opendatahub-operator-controller-manager-6f546bc4-7hrb8\" (UID: \"490ce88c-25d5-4b0c-8036-7341ddf0b1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:44.936012 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.935988    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/490ce88c-25d5-4b0c-8036-7341ddf0b1c5-manifests\") pod \"opendatahub-operator-controller-manager-6f546bc4-7hrb8\" (UID: \"490ce88c-25d5-4b0c-8036-7341ddf0b1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:44.937983 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.937956    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/490ce88c-25d5-4b0c-8036-7341ddf0b1c5-tmp\") pod \"opendatahub-operator-controller-manager-6f546bc4-7hrb8\" (UID: \"490ce88c-25d5-4b0c-8036-7341ddf0b1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:44.938069 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.938061    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/490ce88c-25d5-4b0c-8036-7341ddf0b1c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f546bc4-7hrb8\" (UID: \"490ce88c-25d5-4b0c-8036-7341ddf0b1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:44.938107 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.938087    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/490ce88c-25d5-4b0c-8036-7341ddf0b1c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f546bc4-7hrb8\" (UID: \"490ce88c-25d5-4b0c-8036-7341ddf0b1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:44.950291 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:44.950262    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc6v5\" (UniqueName: \"kubernetes.io/projected/490ce88c-25d5-4b0c-8036-7341ddf0b1c5-kube-api-access-bc6v5\") pod \"opendatahub-operator-controller-manager-6f546bc4-7hrb8\" (UID: \"490ce88c-25d5-4b0c-8036-7341ddf0b1c5\") " pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:45.060477 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:45.060389    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:45.199520 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:45.199483    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"]
Jul 07 14:29:45.203417 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:29:45.203390    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490ce88c_25d5_4b0c_8036_7341ddf0b1c5.slice/crio-1b43107f2e8d6790b7030d9f2c22317bc45feea5208d701dca6f4a47267eb2d6 WatchSource:0}: Error finding container 1b43107f2e8d6790b7030d9f2c22317bc45feea5208d701dca6f4a47267eb2d6: Status 404 returned error can't find the container with id 1b43107f2e8d6790b7030d9f2c22317bc45feea5208d701dca6f4a47267eb2d6
Jul 07 14:29:45.205065 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:45.205047    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:29:45.725128 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:45.725092    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8" event={"ID":"490ce88c-25d5-4b0c-8036-7341ddf0b1c5","Type":"ContainerStarted","Data":"1b43107f2e8d6790b7030d9f2c22317bc45feea5208d701dca6f4a47267eb2d6"}
Jul 07 14:29:48.739572 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:48.739528    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8" event={"ID":"490ce88c-25d5-4b0c-8036-7341ddf0b1c5","Type":"ContainerStarted","Data":"1b20bd5ebe6547105ce072995577b53cb364db1797238f4b6f590f183daf4803"}
Jul 07 14:29:49.746147 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:49.746103    2567 generic.go:356] "Generic (PLEG): container finished" podID="490ce88c-25d5-4b0c-8036-7341ddf0b1c5" containerID="1b20bd5ebe6547105ce072995577b53cb364db1797238f4b6f590f183daf4803" exitCode=0
Jul 07 14:29:49.746663 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:49.746194    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8" event={"ID":"490ce88c-25d5-4b0c-8036-7341ddf0b1c5","Type":"ContainerDied","Data":"1b20bd5ebe6547105ce072995577b53cb364db1797238f4b6f590f183daf4803"}
Jul 07 14:29:50.752667 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:50.752633    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8" event={"ID":"490ce88c-25d5-4b0c-8036-7341ddf0b1c5","Type":"ContainerStarted","Data":"d45b5922e5693fe4ccc7d76f753d68fbbfd03f2f57ac2792e587d7f1fddb6a82"}
Jul 07 14:29:50.753068 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:50.752719    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:29:50.779253 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:29:50.779200    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8" podStartSLOduration=2.21803752 podStartE2EDuration="6.779178864s" totalImagesPullingTime="3.488459461s" totalInitContainerRuntime="1.072681883s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:29:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:29:50.777761719 +0000 UTC m=+345.983735847" watchObservedRunningTime="2026-07-07 14:29:50.779178864 +0000 UTC m=+345.985152995"
Jul 07 14:30:01.759964 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:01.759883    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f546bc4-7hrb8"
Jul 07 14:30:05.389697 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:05.389644    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9rchv"]
Jul 07 14:30:05.398520 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:05.398491    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9rchv"
Jul 07 14:30:05.402040 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:05.402014    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 07 14:30:05.402266 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:05.402110    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pck28\""
Jul 07 14:30:05.410824 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:05.410797    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9rchv"]
Jul 07 14:30:05.502546 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:05.502509    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsfgr\" (UniqueName: \"kubernetes.io/projected/f87872ae-8a93-48c2-b65a-1620cadde5e2-kube-api-access-wsfgr\") pod \"odh-model-controller-7998c67dc4-9rchv\" (UID: \"f87872ae-8a93-48c2-b65a-1620cadde5e2\") " pod="opendatahub/odh-model-controller-7998c67dc4-9rchv"
Jul 07 14:30:05.502764 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:05.502563    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f87872ae-8a93-48c2-b65a-1620cadde5e2-cert\") pod \"odh-model-controller-7998c67dc4-9rchv\" (UID: \"f87872ae-8a93-48c2-b65a-1620cadde5e2\") " pod="opendatahub/odh-model-controller-7998c67dc4-9rchv"
Jul 07 14:30:05.603145 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:05.603097    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsfgr\" (UniqueName: \"kubernetes.io/projected/f87872ae-8a93-48c2-b65a-1620cadde5e2-kube-api-access-wsfgr\") pod \"odh-model-controller-7998c67dc4-9rchv\" (UID: \"f87872ae-8a93-48c2-b65a-1620cadde5e2\") " pod="opendatahub/odh-model-controller-7998c67dc4-9rchv"
Jul 07 14:30:05.603334 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:05.603165    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f87872ae-8a93-48c2-b65a-1620cadde5e2-cert\") pod \"odh-model-controller-7998c67dc4-9rchv\" (UID: \"f87872ae-8a93-48c2-b65a-1620cadde5e2\") " pod="opendatahub/odh-model-controller-7998c67dc4-9rchv"
Jul 07 14:30:05.605936 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:05.605905    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f87872ae-8a93-48c2-b65a-1620cadde5e2-cert\") pod \"odh-model-controller-7998c67dc4-9rchv\" (UID: \"f87872ae-8a93-48c2-b65a-1620cadde5e2\") " pod="opendatahub/odh-model-controller-7998c67dc4-9rchv"
Jul 07 14:30:05.613779 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:05.613745    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsfgr\" (UniqueName: \"kubernetes.io/projected/f87872ae-8a93-48c2-b65a-1620cadde5e2-kube-api-access-wsfgr\") pod \"odh-model-controller-7998c67dc4-9rchv\" (UID: \"f87872ae-8a93-48c2-b65a-1620cadde5e2\") " pod="opendatahub/odh-model-controller-7998c67dc4-9rchv"
Jul 07 14:30:05.711878 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:05.711842    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9rchv"
Jul 07 14:30:05.872328 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:05.872285    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9rchv"]
Jul 07 14:30:05.875442 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:30:05.875413    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf87872ae_8a93_48c2_b65a_1620cadde5e2.slice/crio-f4479185a9712dace4a6057b5b17b1ca83cdaff92a495109a6143c1ceb03a0a2 WatchSource:0}: Error finding container f4479185a9712dace4a6057b5b17b1ca83cdaff92a495109a6143c1ceb03a0a2: Status 404 returned error can't find the container with id f4479185a9712dace4a6057b5b17b1ca83cdaff92a495109a6143c1ceb03a0a2
Jul 07 14:30:06.063641 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:06.063532    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jv86q"]
Jul 07 14:30:06.067882 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:06.067859    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jv86q"
Jul 07 14:30:06.072023 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:06.072003    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 14:30:06.072127 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:06.072042    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-wnpjq\""
Jul 07 14:30:06.079414 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:06.079388    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jv86q"]
Jul 07 14:30:06.107035 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:06.106996    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m545\" (UniqueName: \"kubernetes.io/projected/c4653351-bbcb-4253-9a9d-31cf77dd7663-kube-api-access-2m545\") pod \"model-serving-api-54d89bd5fc-jv86q\" (UID: \"c4653351-bbcb-4253-9a9d-31cf77dd7663\") " pod="opendatahub/model-serving-api-54d89bd5fc-jv86q"
Jul 07 14:30:06.107035 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:06.107039    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4653351-bbcb-4253-9a9d-31cf77dd7663-tls-certs\") pod \"model-serving-api-54d89bd5fc-jv86q\" (UID: \"c4653351-bbcb-4253-9a9d-31cf77dd7663\") " pod="opendatahub/model-serving-api-54d89bd5fc-jv86q"
Jul 07 14:30:06.207670 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:06.207618    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m545\" (UniqueName: \"kubernetes.io/projected/c4653351-bbcb-4253-9a9d-31cf77dd7663-kube-api-access-2m545\") pod \"model-serving-api-54d89bd5fc-jv86q\" (UID: \"c4653351-bbcb-4253-9a9d-31cf77dd7663\") " pod="opendatahub/model-serving-api-54d89bd5fc-jv86q"
Jul 07 14:30:06.207874 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:06.207700    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4653351-bbcb-4253-9a9d-31cf77dd7663-tls-certs\") pod \"model-serving-api-54d89bd5fc-jv86q\" (UID: \"c4653351-bbcb-4253-9a9d-31cf77dd7663\") " pod="opendatahub/model-serving-api-54d89bd5fc-jv86q"
Jul 07 14:30:06.210425 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:06.210401    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4653351-bbcb-4253-9a9d-31cf77dd7663-tls-certs\") pod \"model-serving-api-54d89bd5fc-jv86q\" (UID: \"c4653351-bbcb-4253-9a9d-31cf77dd7663\") " pod="opendatahub/model-serving-api-54d89bd5fc-jv86q"
Jul 07 14:30:06.220384 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:06.220357    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m545\" (UniqueName: \"kubernetes.io/projected/c4653351-bbcb-4253-9a9d-31cf77dd7663-kube-api-access-2m545\") pod \"model-serving-api-54d89bd5fc-jv86q\" (UID: \"c4653351-bbcb-4253-9a9d-31cf77dd7663\") " pod="opendatahub/model-serving-api-54d89bd5fc-jv86q"
Jul 07 14:30:06.379458 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:06.379349    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jv86q"
Jul 07 14:30:06.527236 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:06.527158    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jv86q"]
Jul 07 14:30:06.530184 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:30:06.530157    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4653351_bbcb_4253_9a9d_31cf77dd7663.slice/crio-a6ce41dfbe07e0a1d2800ef885beac68ab127a6fdf9322016198adc271d03740 WatchSource:0}: Error finding container a6ce41dfbe07e0a1d2800ef885beac68ab127a6fdf9322016198adc271d03740: Status 404 returned error can't find the container with id a6ce41dfbe07e0a1d2800ef885beac68ab127a6fdf9322016198adc271d03740
Jul 07 14:30:06.823976 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:06.823936    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9rchv" event={"ID":"f87872ae-8a93-48c2-b65a-1620cadde5e2","Type":"ContainerStarted","Data":"f4479185a9712dace4a6057b5b17b1ca83cdaff92a495109a6143c1ceb03a0a2"}
Jul 07 14:30:06.825667 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:06.825624    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jv86q" event={"ID":"c4653351-bbcb-4253-9a9d-31cf77dd7663","Type":"ContainerStarted","Data":"a6ce41dfbe07e0a1d2800ef885beac68ab127a6fdf9322016198adc271d03740"}
Jul 07 14:30:09.844901 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:09.844794    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jv86q" event={"ID":"c4653351-bbcb-4253-9a9d-31cf77dd7663","Type":"ContainerStarted","Data":"18796d4ef00811c79250f7f8700cfa3ae41e3b11a3cf93c0eda15eae93d52cc7"}
Jul 07 14:30:09.844901 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:09.844894    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-jv86q"
Jul 07 14:30:09.846688 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:09.846662    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9rchv" event={"ID":"f87872ae-8a93-48c2-b65a-1620cadde5e2","Type":"ContainerStarted","Data":"04096577d8c7ac4c8f484edfe13887162c4c05fa6b85de78fe3fe0463d4fdd8e"}
Jul 07 14:30:09.846806 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:09.846793    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9rchv"
Jul 07 14:30:09.865136 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:09.865085    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-jv86q" podStartSLOduration=0.865306091 podStartE2EDuration="3.865067782s" totalImagesPullingTime="2.999761691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:09.864431394 +0000 UTC m=+365.070405525" watchObservedRunningTime="2026-07-07 14:30:09.865067782 +0000 UTC m=+365.071041921"
Jul 07 14:30:09.893094 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:09.893044    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9rchv" podStartSLOduration=1.2741187090000001 podStartE2EDuration="4.893024414s" totalImagesPullingTime="3.618905705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:09.891157989 +0000 UTC m=+365.097132119" watchObservedRunningTime="2026-07-07 14:30:09.893024414 +0000 UTC m=+365.098998543"
Jul 07 14:30:10.538785 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:10.538753    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8"]
Jul 07 14:30:10.542256 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:10.542228    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8"
Jul 07 14:30:10.544729 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:10.544703    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 14:30:10.544859 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:10.544825    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 14:30:10.556759 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:10.556735    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8"]
Jul 07 14:30:10.645801 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:10.645763    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6-tmp\") pod \"kube-auth-proxy-5f67c6995-qjcf8\" (UID: \"fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6\") " pod="openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8"
Jul 07 14:30:10.646002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:10.645848    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z762\" (UniqueName: \"kubernetes.io/projected/fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6-kube-api-access-5z762\") pod \"kube-auth-proxy-5f67c6995-qjcf8\" (UID: \"fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6\") " pod="openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8"
Jul 07 14:30:10.646002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:10.645897    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6-tls-certs\") pod \"kube-auth-proxy-5f67c6995-qjcf8\" (UID: \"fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6\") " pod="openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8"
Jul 07 14:30:10.746784 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:10.746744    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6-tmp\") pod \"kube-auth-proxy-5f67c6995-qjcf8\" (UID: \"fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6\") " pod="openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8"
Jul 07 14:30:10.746958 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:10.746817    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z762\" (UniqueName: \"kubernetes.io/projected/fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6-kube-api-access-5z762\") pod \"kube-auth-proxy-5f67c6995-qjcf8\" (UID: \"fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6\") " pod="openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8"
Jul 07 14:30:10.746958 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:10.746864    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6-tls-certs\") pod \"kube-auth-proxy-5f67c6995-qjcf8\" (UID: \"fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6\") " pod="openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8"
Jul 07 14:30:10.749330 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:10.749290    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6-tmp\") pod \"kube-auth-proxy-5f67c6995-qjcf8\" (UID: \"fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6\") " pod="openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8"
Jul 07 14:30:10.749647 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:10.749623    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6-tls-certs\") pod \"kube-auth-proxy-5f67c6995-qjcf8\" (UID: \"fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6\") " pod="openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8"
Jul 07 14:30:10.757315 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:10.757286    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z762\" (UniqueName: \"kubernetes.io/projected/fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6-kube-api-access-5z762\") pod \"kube-auth-proxy-5f67c6995-qjcf8\" (UID: \"fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6\") " pod="openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8"
Jul 07 14:30:10.853158 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:10.853079    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8"
Jul 07 14:30:10.995472 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:10.995447    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8"]
Jul 07 14:30:10.998259 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:30:10.998229    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe615e35_169e_4fcb_8b1f_9ca2c8bdc3a6.slice/crio-1723d9e192075344095fa0776837af7ff642edd299e48d4ff634813ca32fc3dc WatchSource:0}: Error finding container 1723d9e192075344095fa0776837af7ff642edd299e48d4ff634813ca32fc3dc: Status 404 returned error can't find the container with id 1723d9e192075344095fa0776837af7ff642edd299e48d4ff634813ca32fc3dc
Jul 07 14:30:11.822573 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:11.822539    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-z654z"]
Jul 07 14:30:11.826758 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:11.826738    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:11.829546 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:11.829522    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cq6w4\""
Jul 07 14:30:11.829785 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:11.829526    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 14:30:11.829785 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:11.829572    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 14:30:11.829952 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:11.829580    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 14:30:11.829952 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:11.829607    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 14:30:11.838979 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:11.838958    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-z654z"]
Jul 07 14:30:11.858536 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:11.858489    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8" event={"ID":"fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6","Type":"ContainerStarted","Data":"1723d9e192075344095fa0776837af7ff642edd299e48d4ff634813ca32fc3dc"}
Jul 07 14:30:11.958166 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:11.958131    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:11.958352 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:11.958185    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-local-certs\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:11.958352 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:11.958219    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:11.958352 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:11.958248    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq69k\" (UniqueName: \"kubernetes.io/projected/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-kube-api-access-lq69k\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:11.958519 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:11.958390    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-token\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:11.958519 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:11.958433    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-cacerts\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:11.958519 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:11.958510    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:12.059372 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.059336    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-token\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:12.059565 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.059394    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-cacerts\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:12.059565 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.059451    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:12.059565 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.059499    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:12.059565 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.059544    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-local-certs\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:12.059827 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.059574    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:12.059827 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.059633    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq69k\" (UniqueName: \"kubernetes.io/projected/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-kube-api-access-lq69k\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:12.060569 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.060545    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:12.062521 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.062491    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:12.062660 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.062557    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:12.063229 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.063206    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-local-certs\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:12.063318 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.063293    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-cacerts\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:12.070999 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.070975    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-token\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:12.071393 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.071367    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq69k\" (UniqueName: \"kubernetes.io/projected/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-kube-api-access-lq69k\") pod \"istiod-openshift-gateway-7574459656-z654z\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:12.138026 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.137941    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:12.302762 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.302575    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-z654z"]
Jul 07 14:30:12.304853 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:30:12.304826    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bbc8e90_5e8d_4f8f_99e6_98cc31141226.slice/crio-f1fae2cd8986c7567702b57ec0e314c67379a9daea09e0337a679a422d8b143b WatchSource:0}: Error finding container f1fae2cd8986c7567702b57ec0e314c67379a9daea09e0337a679a422d8b143b: Status 404 returned error can't find the container with id f1fae2cd8986c7567702b57ec0e314c67379a9daea09e0337a679a422d8b143b
Jul 07 14:30:12.863331 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:12.863299    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z" event={"ID":"3bbc8e90-5e8d-4f8f-99e6-98cc31141226","Type":"ContainerStarted","Data":"f1fae2cd8986c7567702b57ec0e314c67379a9daea09e0337a679a422d8b143b"}
Jul 07 14:30:15.406189 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:15.406158    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:30:15.406453 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:15.406232    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:30:15.882076 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:15.881975    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8" event={"ID":"fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6","Type":"ContainerStarted","Data":"a5fb17e5d917f5e921d6e18fd642ce0b5d44929bc3153daec6b916b7c04eccef"}
Jul 07 14:30:15.883531 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:15.883508    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z" event={"ID":"3bbc8e90-5e8d-4f8f-99e6-98cc31141226","Type":"ContainerStarted","Data":"25aee367b91a0613a5927755f183623c526311fe76ce2e8b2b1d55b476330783"}
Jul 07 14:30:15.883670 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:15.883633    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:15.906485 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:15.906428    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f67c6995-qjcf8" podStartSLOduration=1.503479086 podStartE2EDuration="5.906412863s" totalImagesPullingTime="4.402933777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:15.905024462 +0000 UTC m=+371.110998591" watchObservedRunningTime="2026-07-07 14:30:15.906412863 +0000 UTC m=+371.112387031"
Jul 07 14:30:15.936283 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:15.936230    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z" podStartSLOduration=1.837280161 podStartE2EDuration="4.936211073s" totalImagesPullingTime="3.098930912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:15.935775915 +0000 UTC m=+371.141750050" watchObservedRunningTime="2026-07-07 14:30:15.936211073 +0000 UTC m=+371.142185202"
Jul 07 14:30:16.890152 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:16.890120    2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-z654z container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 14:30:16.890510 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:16.890176    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z" podUID="3bbc8e90-5e8d-4f8f-99e6-98cc31141226" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 14:30:17.224242 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.224201    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qggrw"]
Jul 07 14:30:17.227652 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.227631    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qggrw"
Jul 07 14:30:17.248187 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.248160    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 14:30:17.249151 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.249126    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-fjvvf\""
Jul 07 14:30:17.251184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.251163    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4hlgb"]
Jul 07 14:30:17.254328 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.254312    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4hlgb"
Jul 07 14:30:17.258492 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.258129    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qggrw"]
Jul 07 14:30:17.260474 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.260453    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 07 14:30:17.260615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.260480    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-m8j9s\""
Jul 07 14:30:17.267553 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.267532    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4hlgb"]
Jul 07 14:30:17.306634 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.306603    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp6kl\" (UniqueName: \"kubernetes.io/projected/62869e62-4787-495c-bf1f-904935df387c-kube-api-access-kp6kl\") pod \"llmisvc-controller-manager-777c6bd7d5-4hlgb\" (UID: \"62869e62-4787-495c-bf1f-904935df387c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4hlgb"
Jul 07 14:30:17.306789 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.306663    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05ad9a6a-6f93-423f-9260-e456ce15339c-cert\") pod \"kserve-controller-manager-d6f4b65b8-qggrw\" (UID: \"05ad9a6a-6f93-423f-9260-e456ce15339c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qggrw"
Jul 07 14:30:17.306789 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.306729    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62869e62-4787-495c-bf1f-904935df387c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4hlgb\" (UID: \"62869e62-4787-495c-bf1f-904935df387c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4hlgb"
Jul 07 14:30:17.306868 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.306822    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkgr4\" (UniqueName: \"kubernetes.io/projected/05ad9a6a-6f93-423f-9260-e456ce15339c-kube-api-access-fkgr4\") pod \"kserve-controller-manager-d6f4b65b8-qggrw\" (UID: \"05ad9a6a-6f93-423f-9260-e456ce15339c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qggrw"
Jul 07 14:30:17.407455 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.407419    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkgr4\" (UniqueName: \"kubernetes.io/projected/05ad9a6a-6f93-423f-9260-e456ce15339c-kube-api-access-fkgr4\") pod \"kserve-controller-manager-d6f4b65b8-qggrw\" (UID: \"05ad9a6a-6f93-423f-9260-e456ce15339c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qggrw"
Jul 07 14:30:17.407682 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.407467    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp6kl\" (UniqueName: \"kubernetes.io/projected/62869e62-4787-495c-bf1f-904935df387c-kube-api-access-kp6kl\") pod \"llmisvc-controller-manager-777c6bd7d5-4hlgb\" (UID: \"62869e62-4787-495c-bf1f-904935df387c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4hlgb"
Jul 07 14:30:17.407682 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.407491    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05ad9a6a-6f93-423f-9260-e456ce15339c-cert\") pod \"kserve-controller-manager-d6f4b65b8-qggrw\" (UID: \"05ad9a6a-6f93-423f-9260-e456ce15339c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qggrw"
Jul 07 14:30:17.407682 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.407526    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62869e62-4787-495c-bf1f-904935df387c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4hlgb\" (UID: \"62869e62-4787-495c-bf1f-904935df387c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4hlgb"
Jul 07 14:30:17.407856 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:30:17.407685    2567 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 07 14:30:17.407856 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:30:17.407761    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05ad9a6a-6f93-423f-9260-e456ce15339c-cert podName:05ad9a6a-6f93-423f-9260-e456ce15339c nodeName:}" failed. No retries permitted until 2026-07-07 14:30:17.907741149 +0000 UTC m=+373.113715261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/05ad9a6a-6f93-423f-9260-e456ce15339c-cert") pod "kserve-controller-manager-d6f4b65b8-qggrw" (UID: "05ad9a6a-6f93-423f-9260-e456ce15339c") : secret "kserve-webhook-server-cert" not found
Jul 07 14:30:17.410196 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.410169    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62869e62-4787-495c-bf1f-904935df387c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4hlgb\" (UID: \"62869e62-4787-495c-bf1f-904935df387c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4hlgb"
Jul 07 14:30:17.418184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.418158    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkgr4\" (UniqueName: \"kubernetes.io/projected/05ad9a6a-6f93-423f-9260-e456ce15339c-kube-api-access-fkgr4\") pod \"kserve-controller-manager-d6f4b65b8-qggrw\" (UID: \"05ad9a6a-6f93-423f-9260-e456ce15339c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qggrw"
Jul 07 14:30:17.418517 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.418494    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp6kl\" (UniqueName: \"kubernetes.io/projected/62869e62-4787-495c-bf1f-904935df387c-kube-api-access-kp6kl\") pod \"llmisvc-controller-manager-777c6bd7d5-4hlgb\" (UID: \"62869e62-4787-495c-bf1f-904935df387c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4hlgb"
Jul 07 14:30:17.567848 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.567750    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4hlgb"
Jul 07 14:30:17.725402 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.725374    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4hlgb"]
Jul 07 14:30:17.727713 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:30:17.727687    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod62869e62_4787_495c_bf1f_904935df387c.slice/crio-02baee582451a83a4b4d236a8fbf9723d30996d0b8580a49085fd586a2f863f6 WatchSource:0}: Error finding container 02baee582451a83a4b4d236a8fbf9723d30996d0b8580a49085fd586a2f863f6: Status 404 returned error can't find the container with id 02baee582451a83a4b4d236a8fbf9723d30996d0b8580a49085fd586a2f863f6
Jul 07 14:30:17.893820 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.893725    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4hlgb" event={"ID":"62869e62-4787-495c-bf1f-904935df387c","Type":"ContainerStarted","Data":"02baee582451a83a4b4d236a8fbf9723d30996d0b8580a49085fd586a2f863f6"}
Jul 07 14:30:17.912136 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.912110    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05ad9a6a-6f93-423f-9260-e456ce15339c-cert\") pod \"kserve-controller-manager-d6f4b65b8-qggrw\" (UID: \"05ad9a6a-6f93-423f-9260-e456ce15339c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qggrw"
Jul 07 14:30:17.914516 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:17.914489    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/05ad9a6a-6f93-423f-9260-e456ce15339c-cert\") pod \"kserve-controller-manager-d6f4b65b8-qggrw\" (UID: \"05ad9a6a-6f93-423f-9260-e456ce15339c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qggrw"
Jul 07 14:30:18.138167 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:18.138132    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qggrw"
Jul 07 14:30:18.291535 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:18.291500    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qggrw"]
Jul 07 14:30:18.294318 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:30:18.294285    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ad9a6a_6f93_423f_9260_e456ce15339c.slice/crio-7e27d012d0235d5a671d5412fd7e9712b78812773d0207d0a2158c206f4ed3b8 WatchSource:0}: Error finding container 7e27d012d0235d5a671d5412fd7e9712b78812773d0207d0a2158c206f4ed3b8: Status 404 returned error can't find the container with id 7e27d012d0235d5a671d5412fd7e9712b78812773d0207d0a2158c206f4ed3b8
Jul 07 14:30:18.900172 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:18.900126    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qggrw" event={"ID":"05ad9a6a-6f93-423f-9260-e456ce15339c","Type":"ContainerStarted","Data":"7e27d012d0235d5a671d5412fd7e9712b78812773d0207d0a2158c206f4ed3b8"}
Jul 07 14:30:19.128500 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.128469    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-z654z"]
Jul 07 14:30:19.129779 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.128708    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z" podUID="3bbc8e90-5e8d-4f8f-99e6-98cc31141226" containerName="discovery" containerID="cri-o://25aee367b91a0613a5927755f183623c526311fe76ce2e8b2b1d55b476330783" gracePeriod=30
Jul 07 14:30:19.130534 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.130479    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:19.397676 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.397653    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:19.526184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.525770    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-csr-dns-cert\") pod \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") "
Jul 07 14:30:19.526184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.525822    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-csr-ca-configmap\") pod \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") "
Jul 07 14:30:19.526184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.525885    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq69k\" (UniqueName: \"kubernetes.io/projected/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-kube-api-access-lq69k\") pod \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") "
Jul 07 14:30:19.526184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.525919    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-local-certs\") pod \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") "
Jul 07 14:30:19.526184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.525965    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-kubeconfig\") pod \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") "
Jul 07 14:30:19.526184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.525980    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-token\") pod \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") "
Jul 07 14:30:19.526184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.526010    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-cacerts\") pod \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\" (UID: \"3bbc8e90-5e8d-4f8f-99e6-98cc31141226\") "
Jul 07 14:30:19.526676 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.526375    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "3bbc8e90-5e8d-4f8f-99e6-98cc31141226" (UID: "3bbc8e90-5e8d-4f8f-99e6-98cc31141226"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:30:19.526883 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.526858    2567 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-csr-ca-configmap\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:30:19.530409 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.530368    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-cacerts" (OuterVolumeSpecName: "cacerts") pod "3bbc8e90-5e8d-4f8f-99e6-98cc31141226" (UID: "3bbc8e90-5e8d-4f8f-99e6-98cc31141226"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:30:19.530893 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.530863    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "3bbc8e90-5e8d-4f8f-99e6-98cc31141226" (UID: "3bbc8e90-5e8d-4f8f-99e6-98cc31141226"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:30:19.531049 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.530992    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-kube-api-access-lq69k" (OuterVolumeSpecName: "kube-api-access-lq69k") pod "3bbc8e90-5e8d-4f8f-99e6-98cc31141226" (UID: "3bbc8e90-5e8d-4f8f-99e6-98cc31141226"). InnerVolumeSpecName "kube-api-access-lq69k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:30:19.531227 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.531193    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-token" (OuterVolumeSpecName: "istio-token") pod "3bbc8e90-5e8d-4f8f-99e6-98cc31141226" (UID: "3bbc8e90-5e8d-4f8f-99e6-98cc31141226"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:30:19.531292 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.531232    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-local-certs" (OuterVolumeSpecName: "local-certs") pod "3bbc8e90-5e8d-4f8f-99e6-98cc31141226" (UID: "3bbc8e90-5e8d-4f8f-99e6-98cc31141226"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:30:19.531731 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.531704    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "3bbc8e90-5e8d-4f8f-99e6-98cc31141226" (UID: "3bbc8e90-5e8d-4f8f-99e6-98cc31141226"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:30:19.627303 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.627269    2567 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-csr-dns-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:30:19.627303 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.627302    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq69k\" (UniqueName: \"kubernetes.io/projected/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-kube-api-access-lq69k\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:30:19.627513 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.627313    2567 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-local-certs\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:30:19.627513 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.627323    2567 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-kubeconfig\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:30:19.627513 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.627331    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-istio-token\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:30:19.627513 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.627338    2567 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3bbc8e90-5e8d-4f8f-99e6-98cc31141226-cacerts\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:30:19.906633 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.906571    2567 generic.go:356] "Generic (PLEG): container finished" podID="3bbc8e90-5e8d-4f8f-99e6-98cc31141226" containerID="25aee367b91a0613a5927755f183623c526311fe76ce2e8b2b1d55b476330783" exitCode=0
Jul 07 14:30:19.906633 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.906642    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z"
Jul 07 14:30:19.907185 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.906667    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z" event={"ID":"3bbc8e90-5e8d-4f8f-99e6-98cc31141226","Type":"ContainerDied","Data":"25aee367b91a0613a5927755f183623c526311fe76ce2e8b2b1d55b476330783"}
Jul 07 14:30:19.907185 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.906716    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-z654z" event={"ID":"3bbc8e90-5e8d-4f8f-99e6-98cc31141226","Type":"ContainerDied","Data":"f1fae2cd8986c7567702b57ec0e314c67379a9daea09e0337a679a422d8b143b"}
Jul 07 14:30:19.907185 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.906742    2567 scope.go:117] "RemoveContainer" containerID="25aee367b91a0613a5927755f183623c526311fe76ce2e8b2b1d55b476330783"
Jul 07 14:30:19.918320 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.918300    2567 scope.go:117] "RemoveContainer" containerID="25aee367b91a0613a5927755f183623c526311fe76ce2e8b2b1d55b476330783"
Jul 07 14:30:19.918633 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:30:19.918609    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25aee367b91a0613a5927755f183623c526311fe76ce2e8b2b1d55b476330783\": container with ID starting with 25aee367b91a0613a5927755f183623c526311fe76ce2e8b2b1d55b476330783 not found: ID does not exist" containerID="25aee367b91a0613a5927755f183623c526311fe76ce2e8b2b1d55b476330783"
Jul 07 14:30:19.918714 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.918642    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25aee367b91a0613a5927755f183623c526311fe76ce2e8b2b1d55b476330783"} err="failed to get container status \"25aee367b91a0613a5927755f183623c526311fe76ce2e8b2b1d55b476330783\": rpc error: code = NotFound desc = could not find container \"25aee367b91a0613a5927755f183623c526311fe76ce2e8b2b1d55b476330783\": container with ID starting with 25aee367b91a0613a5927755f183623c526311fe76ce2e8b2b1d55b476330783 not found: ID does not exist"
Jul 07 14:30:19.965996 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:19.965952    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-z654z"]
Jul 07 14:30:20.004388 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:20.004352    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-z654z"]
Jul 07 14:30:20.853115 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:20.853072    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9rchv"
Jul 07 14:30:20.856294 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:20.856036    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-jv86q"
Jul 07 14:30:21.298356 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:21.298316    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bbc8e90-5e8d-4f8f-99e6-98cc31141226" path="/var/lib/kubelet/pods/3bbc8e90-5e8d-4f8f-99e6-98cc31141226/volumes"
Jul 07 14:30:21.920767 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:21.920728    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4hlgb" event={"ID":"62869e62-4787-495c-bf1f-904935df387c","Type":"ContainerStarted","Data":"4bf0fe19303dbfc013f99b50ce60bbd20103bc80d3459d284b5a6d7a9de57683"}
Jul 07 14:30:21.920952 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:21.920857    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4hlgb"
Jul 07 14:30:21.922439 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:21.922414    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qggrw" event={"ID":"05ad9a6a-6f93-423f-9260-e456ce15339c","Type":"ContainerStarted","Data":"6f86652d4e276e5cca7aec1da8f1abe686006712c586ec4f06123803a179e103"}
Jul 07 14:30:21.922582 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:21.922506    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qggrw"
Jul 07 14:30:21.949994 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:21.949929    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4hlgb" podStartSLOduration=0.930212156 podStartE2EDuration="4.949909304s" totalImagesPullingTime="4.019697148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:21.949511889 +0000 UTC m=+377.155486020" watchObservedRunningTime="2026-07-07 14:30:21.949909304 +0000 UTC m=+377.155883433"
Jul 07 14:30:21.979492 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:21.979439    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qggrw" podStartSLOduration=1.5330896950000001 podStartE2EDuration="4.979420932s" totalImagesPullingTime="3.446331237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:21.977786022 +0000 UTC m=+377.183760152" watchObservedRunningTime="2026-07-07 14:30:21.979420932 +0000 UTC m=+377.185395061"
Jul 07 14:30:52.929038 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:52.928997    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4hlgb"
Jul 07 14:30:52.932191 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:30:52.932172    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qggrw"
Jul 07 14:31:06.341098 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.341062    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x2sp7"]
Jul 07 14:31:06.341501 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.341398    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bbc8e90-5e8d-4f8f-99e6-98cc31141226" containerName="discovery"
Jul 07 14:31:06.341501 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.341409    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bbc8e90-5e8d-4f8f-99e6-98cc31141226" containerName="discovery"
Jul 07 14:31:06.341501 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.341476    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bbc8e90-5e8d-4f8f-99e6-98cc31141226" containerName="discovery"
Jul 07 14:31:06.345697 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.345680    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x2sp7"
Jul 07 14:31:06.348390 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.348365    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-ll7pf\""
Jul 07 14:31:06.348525 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.348446    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 14:31:06.349703 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.349679    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 14:31:06.354445 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.354422    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x2sp7"]
Jul 07 14:31:06.398724 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.398694    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc7st\" (UniqueName: \"kubernetes.io/projected/bb5dcfb3-167f-42d7-af3e-62ac3f29b99b-kube-api-access-fc7st\") pod \"kuadrant-operator-catalog-x2sp7\" (UID: \"bb5dcfb3-167f-42d7-af3e-62ac3f29b99b\") " pod="kuadrant-system/kuadrant-operator-catalog-x2sp7"
Jul 07 14:31:06.499318 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.499289    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc7st\" (UniqueName: \"kubernetes.io/projected/bb5dcfb3-167f-42d7-af3e-62ac3f29b99b-kube-api-access-fc7st\") pod \"kuadrant-operator-catalog-x2sp7\" (UID: \"bb5dcfb3-167f-42d7-af3e-62ac3f29b99b\") " pod="kuadrant-system/kuadrant-operator-catalog-x2sp7"
Jul 07 14:31:06.508775 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.508749    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc7st\" (UniqueName: \"kubernetes.io/projected/bb5dcfb3-167f-42d7-af3e-62ac3f29b99b-kube-api-access-fc7st\") pod \"kuadrant-operator-catalog-x2sp7\" (UID: \"bb5dcfb3-167f-42d7-af3e-62ac3f29b99b\") " pod="kuadrant-system/kuadrant-operator-catalog-x2sp7"
Jul 07 14:31:06.658483 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.658447    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x2sp7"
Jul 07 14:31:06.699694 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.699662    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x2sp7"]
Jul 07 14:31:06.794165 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.794142    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x2sp7"]
Jul 07 14:31:06.796777 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:31:06.796749    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5dcfb3_167f_42d7_af3e_62ac3f29b99b.slice/crio-21d62447a1923583426b292f1c0501386735d4c8f087f6a91773427ad14e3ec6 WatchSource:0}: Error finding container 21d62447a1923583426b292f1c0501386735d4c8f087f6a91773427ad14e3ec6: Status 404 returned error can't find the container with id 21d62447a1923583426b292f1c0501386735d4c8f087f6a91773427ad14e3ec6
Jul 07 14:31:06.909497 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.909419    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gq5vw"]
Jul 07 14:31:06.913783 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.913765    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gq5vw"
Jul 07 14:31:06.921175 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:06.920905    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gq5vw"]
Jul 07 14:31:07.003410 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:07.003379    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs2tw\" (UniqueName: \"kubernetes.io/projected/e88c0219-8d24-451f-934d-0323169f6718-kube-api-access-gs2tw\") pod \"kuadrant-operator-catalog-gq5vw\" (UID: \"e88c0219-8d24-451f-934d-0323169f6718\") " pod="kuadrant-system/kuadrant-operator-catalog-gq5vw"
Jul 07 14:31:07.104000 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:07.103956    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs2tw\" (UniqueName: \"kubernetes.io/projected/e88c0219-8d24-451f-934d-0323169f6718-kube-api-access-gs2tw\") pod \"kuadrant-operator-catalog-gq5vw\" (UID: \"e88c0219-8d24-451f-934d-0323169f6718\") " pod="kuadrant-system/kuadrant-operator-catalog-gq5vw"
Jul 07 14:31:07.114898 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:07.114865    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs2tw\" (UniqueName: \"kubernetes.io/projected/e88c0219-8d24-451f-934d-0323169f6718-kube-api-access-gs2tw\") pod \"kuadrant-operator-catalog-gq5vw\" (UID: \"e88c0219-8d24-451f-934d-0323169f6718\") " pod="kuadrant-system/kuadrant-operator-catalog-gq5vw"
Jul 07 14:31:07.129242 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:07.129202    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x2sp7" event={"ID":"bb5dcfb3-167f-42d7-af3e-62ac3f29b99b","Type":"ContainerStarted","Data":"21d62447a1923583426b292f1c0501386735d4c8f087f6a91773427ad14e3ec6"}
Jul 07 14:31:07.223757 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:07.223674    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gq5vw"
Jul 07 14:31:07.375418 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:07.375327    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gq5vw"]
Jul 07 14:31:07.408763 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:31:07.408723    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88c0219_8d24_451f_934d_0323169f6718.slice/crio-7ea553fdc30a33e48d50a112a810ed3c16b293fba842aba49e1a62259b1c3a67 WatchSource:0}: Error finding container 7ea553fdc30a33e48d50a112a810ed3c16b293fba842aba49e1a62259b1c3a67: Status 404 returned error can't find the container with id 7ea553fdc30a33e48d50a112a810ed3c16b293fba842aba49e1a62259b1c3a67
Jul 07 14:31:08.135828 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:08.135798    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gq5vw" event={"ID":"e88c0219-8d24-451f-934d-0323169f6718","Type":"ContainerStarted","Data":"7ea553fdc30a33e48d50a112a810ed3c16b293fba842aba49e1a62259b1c3a67"}
Jul 07 14:31:10.147030 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:10.146985    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x2sp7" event={"ID":"bb5dcfb3-167f-42d7-af3e-62ac3f29b99b","Type":"ContainerStarted","Data":"f55d9b5823b5e79c68f53a85e0f219fa2da1b8551da3d652762305ff0305201c"}
Jul 07 14:31:10.147498 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:10.147032    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-x2sp7" podUID="bb5dcfb3-167f-42d7-af3e-62ac3f29b99b" containerName="registry-server" containerID="cri-o://f55d9b5823b5e79c68f53a85e0f219fa2da1b8551da3d652762305ff0305201c" gracePeriod=2
Jul 07 14:31:10.148703 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:10.148682    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gq5vw" event={"ID":"e88c0219-8d24-451f-934d-0323169f6718","Type":"ContainerStarted","Data":"b255703a8f9d0c9d4c016811de176522002110c6fddf1d42b38cfea23a02f5c0"}
Jul 07 14:31:10.172552 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:10.172496    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-x2sp7" podStartSLOduration=1.821411769 podStartE2EDuration="4.172474969s" totalImagesPullingTime="2.3510632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:10.169401519 +0000 UTC m=+425.375375647" watchObservedRunningTime="2026-07-07 14:31:10.172474969 +0000 UTC m=+425.378449098"
Jul 07 14:31:10.212540 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:10.212482    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gq5vw" podStartSLOduration=2.470099122 podStartE2EDuration="4.212466525s" totalImagesPullingTime="1.742367403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:10.210848485 +0000 UTC m=+425.416822613" watchObservedRunningTime="2026-07-07 14:31:10.212466525 +0000 UTC m=+425.418440712"
Jul 07 14:31:10.395570 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:10.395545    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x2sp7"
Jul 07 14:31:10.435469 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:10.435374    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc7st\" (UniqueName: \"kubernetes.io/projected/bb5dcfb3-167f-42d7-af3e-62ac3f29b99b-kube-api-access-fc7st\") pod \"bb5dcfb3-167f-42d7-af3e-62ac3f29b99b\" (UID: \"bb5dcfb3-167f-42d7-af3e-62ac3f29b99b\") "
Jul 07 14:31:10.437755 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:10.437725    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb5dcfb3-167f-42d7-af3e-62ac3f29b99b-kube-api-access-fc7st" (OuterVolumeSpecName: "kube-api-access-fc7st") pod "bb5dcfb3-167f-42d7-af3e-62ac3f29b99b" (UID: "bb5dcfb3-167f-42d7-af3e-62ac3f29b99b"). InnerVolumeSpecName "kube-api-access-fc7st". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:31:10.536259 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:10.536226    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc7st\" (UniqueName: \"kubernetes.io/projected/bb5dcfb3-167f-42d7-af3e-62ac3f29b99b-kube-api-access-fc7st\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:31:11.154532 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:11.154495    2567 generic.go:356] "Generic (PLEG): container finished" podID="bb5dcfb3-167f-42d7-af3e-62ac3f29b99b" containerID="f55d9b5823b5e79c68f53a85e0f219fa2da1b8551da3d652762305ff0305201c" exitCode=0
Jul 07 14:31:11.155098 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:11.154562    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x2sp7"
Jul 07 14:31:11.155098 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:11.154584    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x2sp7" event={"ID":"bb5dcfb3-167f-42d7-af3e-62ac3f29b99b","Type":"ContainerDied","Data":"f55d9b5823b5e79c68f53a85e0f219fa2da1b8551da3d652762305ff0305201c"}
Jul 07 14:31:11.155098 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:11.154675    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x2sp7" event={"ID":"bb5dcfb3-167f-42d7-af3e-62ac3f29b99b","Type":"ContainerDied","Data":"21d62447a1923583426b292f1c0501386735d4c8f087f6a91773427ad14e3ec6"}
Jul 07 14:31:11.155098 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:11.154695    2567 scope.go:117] "RemoveContainer" containerID="f55d9b5823b5e79c68f53a85e0f219fa2da1b8551da3d652762305ff0305201c"
Jul 07 14:31:11.164180 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:11.164160    2567 scope.go:117] "RemoveContainer" containerID="f55d9b5823b5e79c68f53a85e0f219fa2da1b8551da3d652762305ff0305201c"
Jul 07 14:31:11.164474 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:31:11.164447    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f55d9b5823b5e79c68f53a85e0f219fa2da1b8551da3d652762305ff0305201c\": container with ID starting with f55d9b5823b5e79c68f53a85e0f219fa2da1b8551da3d652762305ff0305201c not found: ID does not exist" containerID="f55d9b5823b5e79c68f53a85e0f219fa2da1b8551da3d652762305ff0305201c"
Jul 07 14:31:11.164520 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:11.164484    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f55d9b5823b5e79c68f53a85e0f219fa2da1b8551da3d652762305ff0305201c"} err="failed to get container status \"f55d9b5823b5e79c68f53a85e0f219fa2da1b8551da3d652762305ff0305201c\": rpc error: code = NotFound desc = could not find container \"f55d9b5823b5e79c68f53a85e0f219fa2da1b8551da3d652762305ff0305201c\": container with ID starting with f55d9b5823b5e79c68f53a85e0f219fa2da1b8551da3d652762305ff0305201c not found: ID does not exist"
Jul 07 14:31:11.179312 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:11.179286    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x2sp7"]
Jul 07 14:31:11.184944 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:11.184917    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x2sp7"]
Jul 07 14:31:11.296608 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:11.296559    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb5dcfb3-167f-42d7-af3e-62ac3f29b99b" path="/var/lib/kubelet/pods/bb5dcfb3-167f-42d7-af3e-62ac3f29b99b/volumes"
Jul 07 14:31:17.223992 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:17.223959    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-gq5vw"
Jul 07 14:31:17.224500 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:17.224008    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-gq5vw"
Jul 07 14:31:17.246714 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:17.246687    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-gq5vw"
Jul 07 14:31:18.209532 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:18.209501    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-gq5vw"
Jul 07 14:31:37.733843 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:37.733806    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-g9d88"]
Jul 07 14:31:37.734320 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:37.734192    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb5dcfb3-167f-42d7-af3e-62ac3f29b99b" containerName="registry-server"
Jul 07 14:31:37.734320 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:37.734204    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb5dcfb3-167f-42d7-af3e-62ac3f29b99b" containerName="registry-server"
Jul 07 14:31:37.734320 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:37.734286    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb5dcfb3-167f-42d7-af3e-62ac3f29b99b" containerName="registry-server"
Jul 07 14:31:37.737332 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:37.737314    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g9d88"
Jul 07 14:31:37.741877 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:37.741853    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 14:31:37.743931 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:37.743760    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-k57c9\""
Jul 07 14:31:37.753030 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:37.753001    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-g9d88"]
Jul 07 14:31:37.858988 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:37.858945    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjpwc\" (UniqueName: \"kubernetes.io/projected/22c5ec46-b098-4a03-b15a-dccbb2e70633-kube-api-access-wjpwc\") pod \"dns-operator-controller-manager-864dd78c4c-g9d88\" (UID: \"22c5ec46-b098-4a03-b15a-dccbb2e70633\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g9d88"
Jul 07 14:31:37.960257 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:37.960222    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjpwc\" (UniqueName: \"kubernetes.io/projected/22c5ec46-b098-4a03-b15a-dccbb2e70633-kube-api-access-wjpwc\") pod \"dns-operator-controller-manager-864dd78c4c-g9d88\" (UID: \"22c5ec46-b098-4a03-b15a-dccbb2e70633\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g9d88"
Jul 07 14:31:37.973136 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:37.973103    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjpwc\" (UniqueName: \"kubernetes.io/projected/22c5ec46-b098-4a03-b15a-dccbb2e70633-kube-api-access-wjpwc\") pod \"dns-operator-controller-manager-864dd78c4c-g9d88\" (UID: \"22c5ec46-b098-4a03-b15a-dccbb2e70633\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g9d88"
Jul 07 14:31:38.048582 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:38.048492    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g9d88"
Jul 07 14:31:38.199781 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:38.199754    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-g9d88"]
Jul 07 14:31:38.203109 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:31:38.203075    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22c5ec46_b098_4a03_b15a_dccbb2e70633.slice/crio-deb687d414b37e06eb9f487c762019448cdf95e20d37b45d25e2141ce5dc5bbb WatchSource:0}: Error finding container deb687d414b37e06eb9f487c762019448cdf95e20d37b45d25e2141ce5dc5bbb: Status 404 returned error can't find the container with id deb687d414b37e06eb9f487c762019448cdf95e20d37b45d25e2141ce5dc5bbb
Jul 07 14:31:38.277316 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:38.277279    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g9d88" event={"ID":"22c5ec46-b098-4a03-b15a-dccbb2e70633","Type":"ContainerStarted","Data":"deb687d414b37e06eb9f487c762019448cdf95e20d37b45d25e2141ce5dc5bbb"}
Jul 07 14:31:41.170480 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:41.170436    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"]
Jul 07 14:31:41.176419 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:41.176398    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"
Jul 07 14:31:41.179449 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:41.179426    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-4q66z\""
Jul 07 14:31:41.190146 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:41.190127    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"]
Jul 07 14:31:41.285859 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:41.285828    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2x49\" (UniqueName: \"kubernetes.io/projected/0be04051-dee3-4d38-bf2d-c3904f13a7c4-kube-api-access-g2x49\") pod \"limitador-operator-controller-manager-859d7b78bd-rhgcs\" (UID: \"0be04051-dee3-4d38-bf2d-c3904f13a7c4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"
Jul 07 14:31:41.299265 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:41.299237    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g9d88" event={"ID":"22c5ec46-b098-4a03-b15a-dccbb2e70633","Type":"ContainerStarted","Data":"43a157a789d3530642f8cbc471bc91465a76ace156455caf59b5ec515dceb912"}
Jul 07 14:31:41.299421 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:41.299339    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g9d88"
Jul 07 14:31:41.326209 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:41.326153    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g9d88" podStartSLOduration=2.160556939 podStartE2EDuration="4.326135362s" totalImagesPullingTime="2.165578423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:41.324185657 +0000 UTC m=+456.530159810" watchObservedRunningTime="2026-07-07 14:31:41.326135362 +0000 UTC m=+456.532109491"
Jul 07 14:31:41.387290 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:41.387248    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2x49\" (UniqueName: \"kubernetes.io/projected/0be04051-dee3-4d38-bf2d-c3904f13a7c4-kube-api-access-g2x49\") pod \"limitador-operator-controller-manager-859d7b78bd-rhgcs\" (UID: \"0be04051-dee3-4d38-bf2d-c3904f13a7c4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"
Jul 07 14:31:41.398970 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:41.398935    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2x49\" (UniqueName: \"kubernetes.io/projected/0be04051-dee3-4d38-bf2d-c3904f13a7c4-kube-api-access-g2x49\") pod \"limitador-operator-controller-manager-859d7b78bd-rhgcs\" (UID: \"0be04051-dee3-4d38-bf2d-c3904f13a7c4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"
Jul 07 14:31:41.487941 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:41.487846    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"
Jul 07 14:31:41.631786 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:41.631700    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"]
Jul 07 14:31:41.634540 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:31:41.634475    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be04051_dee3_4d38_bf2d_c3904f13a7c4.slice/crio-5d88427e3bc0d464017fc61b91b8cd52b6d9f8b9323abfbcd0f7b3d52e9b3f8c WatchSource:0}: Error finding container 5d88427e3bc0d464017fc61b91b8cd52b6d9f8b9323abfbcd0f7b3d52e9b3f8c: Status 404 returned error can't find the container with id 5d88427e3bc0d464017fc61b91b8cd52b6d9f8b9323abfbcd0f7b3d52e9b3f8c
Jul 07 14:31:42.306060 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:42.306018    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs" event={"ID":"0be04051-dee3-4d38-bf2d-c3904f13a7c4","Type":"ContainerStarted","Data":"5d88427e3bc0d464017fc61b91b8cd52b6d9f8b9323abfbcd0f7b3d52e9b3f8c"}
Jul 07 14:31:44.316712 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:44.316674    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs" event={"ID":"0be04051-dee3-4d38-bf2d-c3904f13a7c4","Type":"ContainerStarted","Data":"cee0cf39f1c73c9662b3594cc24f4eb62a2b88fdde6997a8c4987e97d82a685f"}
Jul 07 14:31:44.317196 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:44.316815    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"
Jul 07 14:31:46.163931 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:46.163879    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs" podStartSLOduration=3.446030187 podStartE2EDuration="5.163860157s" totalImagesPullingTime="1.71782997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:44.339386152 +0000 UTC m=+459.545360281" watchObservedRunningTime="2026-07-07 14:31:46.163860157 +0000 UTC m=+461.369834286"
Jul 07 14:31:46.164764 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:46.164747    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"]
Jul 07 14:31:46.168175 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:46.168160    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:31:46.171531 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:46.171510    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jbwxs\""
Jul 07 14:31:46.181504 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:46.181474    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"]
Jul 07 14:31:46.329803 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:46.329764    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9dbb8f1e-4aee-4596-ac68-0b99f32d41c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4hcvn\" (UID: \"9dbb8f1e-4aee-4596-ac68-0b99f32d41c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:31:46.329985 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:46.329881    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k92zm\" (UniqueName: \"kubernetes.io/projected/9dbb8f1e-4aee-4596-ac68-0b99f32d41c7-kube-api-access-k92zm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4hcvn\" (UID: \"9dbb8f1e-4aee-4596-ac68-0b99f32d41c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:31:46.430608 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:46.430507    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9dbb8f1e-4aee-4596-ac68-0b99f32d41c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4hcvn\" (UID: \"9dbb8f1e-4aee-4596-ac68-0b99f32d41c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:31:46.431190 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:46.430821    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k92zm\" (UniqueName: \"kubernetes.io/projected/9dbb8f1e-4aee-4596-ac68-0b99f32d41c7-kube-api-access-k92zm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4hcvn\" (UID: \"9dbb8f1e-4aee-4596-ac68-0b99f32d41c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:31:46.431190 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:46.431004    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9dbb8f1e-4aee-4596-ac68-0b99f32d41c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4hcvn\" (UID: \"9dbb8f1e-4aee-4596-ac68-0b99f32d41c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:31:46.444816 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:46.444791    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k92zm\" (UniqueName: \"kubernetes.io/projected/9dbb8f1e-4aee-4596-ac68-0b99f32d41c7-kube-api-access-k92zm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4hcvn\" (UID: \"9dbb8f1e-4aee-4596-ac68-0b99f32d41c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:31:46.478857 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:46.478826    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:31:46.625642 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:46.625498    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"]
Jul 07 14:31:46.628147 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:31:46.628115    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dbb8f1e_4aee_4596_ac68_0b99f32d41c7.slice/crio-70cd679e786ba3602f289b89871dc3575afb223f91af41039f5ae1775454f437 WatchSource:0}: Error finding container 70cd679e786ba3602f289b89871dc3575afb223f91af41039f5ae1775454f437: Status 404 returned error can't find the container with id 70cd679e786ba3602f289b89871dc3575afb223f91af41039f5ae1775454f437
Jul 07 14:31:47.331244 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:47.331210    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn" event={"ID":"9dbb8f1e-4aee-4596-ac68-0b99f32d41c7","Type":"ContainerStarted","Data":"70cd679e786ba3602f289b89871dc3575afb223f91af41039f5ae1775454f437"}
Jul 07 14:31:49.391514 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:49.391479    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hmwst"]
Jul 07 14:31:49.394921 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:49.394898    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmwst"
Jul 07 14:31:49.398078 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:49.398048    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rsj4t\""
Jul 07 14:31:49.410218 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:49.410195    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hmwst"]
Jul 07 14:31:49.560904 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:49.560863    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cd86\" (UniqueName: \"kubernetes.io/projected/f59eea95-96d6-4240-a114-6a8086095b57-kube-api-access-5cd86\") pod \"authorino-operator-75cc8d5cb7-hmwst\" (UID: \"f59eea95-96d6-4240-a114-6a8086095b57\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmwst"
Jul 07 14:31:49.661871 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:49.661787    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cd86\" (UniqueName: \"kubernetes.io/projected/f59eea95-96d6-4240-a114-6a8086095b57-kube-api-access-5cd86\") pod \"authorino-operator-75cc8d5cb7-hmwst\" (UID: \"f59eea95-96d6-4240-a114-6a8086095b57\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmwst"
Jul 07 14:31:49.674372 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:49.674342    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cd86\" (UniqueName: \"kubernetes.io/projected/f59eea95-96d6-4240-a114-6a8086095b57-kube-api-access-5cd86\") pod \"authorino-operator-75cc8d5cb7-hmwst\" (UID: \"f59eea95-96d6-4240-a114-6a8086095b57\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmwst"
Jul 07 14:31:49.705222 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:49.705185    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmwst"
Jul 07 14:31:49.852724 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:49.852698    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hmwst"]
Jul 07 14:31:49.854701 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:31:49.854670    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf59eea95_96d6_4240_a114_6a8086095b57.slice/crio-532a71c1e00746d80e2a482e2b0f4872b3b9eea518bafbb6b5846f00109ceec3 WatchSource:0}: Error finding container 532a71c1e00746d80e2a482e2b0f4872b3b9eea518bafbb6b5846f00109ceec3: Status 404 returned error can't find the container with id 532a71c1e00746d80e2a482e2b0f4872b3b9eea518bafbb6b5846f00109ceec3
Jul 07 14:31:50.348466 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:50.348432    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmwst" event={"ID":"f59eea95-96d6-4240-a114-6a8086095b57","Type":"ContainerStarted","Data":"532a71c1e00746d80e2a482e2b0f4872b3b9eea518bafbb6b5846f00109ceec3"}
Jul 07 14:31:52.309457 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:52.309200    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g9d88"
Jul 07 14:31:53.367754 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:53.367714    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmwst" event={"ID":"f59eea95-96d6-4240-a114-6a8086095b57","Type":"ContainerStarted","Data":"c3bc3bfc01b6ab23a8985fa869580214059cc4a7d64fea180f715ced329ca18f"}
Jul 07 14:31:53.368164 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:53.367850    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmwst"
Jul 07 14:31:53.393013 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:53.392956    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmwst" podStartSLOduration=1.7988586450000001 podStartE2EDuration="4.392939684s" totalImagesPullingTime="2.594081039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:53.390645202 +0000 UTC m=+468.596619332" watchObservedRunningTime="2026-07-07 14:31:53.392939684 +0000 UTC m=+468.598913813"
Jul 07 14:31:54.374082 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:54.374041    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn" event={"ID":"9dbb8f1e-4aee-4596-ac68-0b99f32d41c7","Type":"ContainerStarted","Data":"98a77f47ff5419e4ec1c413b8f9fc30cbc8205937dca60a468c066dfe285897b"}
Jul 07 14:31:54.374528 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:54.374107    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:31:54.404350 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:54.404304    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn" podStartSLOduration=1.271735744 podStartE2EDuration="8.404289098s" totalImagesPullingTime="7.132553354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:54.402520142 +0000 UTC m=+469.608494271" watchObservedRunningTime="2026-07-07 14:31:54.404289098 +0000 UTC m=+469.610263226"
Jul 07 14:31:55.323260 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:31:55.323220    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"
Jul 07 14:32:04.377377 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:04.377348    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hmwst"
Jul 07 14:32:05.383187 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:05.383158    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:32:07.336524 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.336493    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"]
Jul 07 14:32:07.336979 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.336699    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn" podUID="9dbb8f1e-4aee-4596-ac68-0b99f32d41c7" containerName="manager" containerID="cri-o://98a77f47ff5419e4ec1c413b8f9fc30cbc8205937dca60a468c066dfe285897b" gracePeriod=2
Jul 07 14:32:07.343421 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.343390    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"]
Jul 07 14:32:07.361196 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.361163    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"]
Jul 07 14:32:07.361686 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.361620    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs" podUID="0be04051-dee3-4d38-bf2d-c3904f13a7c4" containerName="manager" containerID="cri-o://cee0cf39f1c73c9662b3594cc24f4eb62a2b88fdde6997a8c4987e97d82a685f" gracePeriod=2
Jul 07 14:32:07.375614 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.375334    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"]
Jul 07 14:32:07.375855 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.375835    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dbb8f1e-4aee-4596-ac68-0b99f32d41c7" containerName="manager"
Jul 07 14:32:07.375921 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.375859    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dbb8f1e-4aee-4596-ac68-0b99f32d41c7" containerName="manager"
Jul 07 14:32:07.375979 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.375967    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dbb8f1e-4aee-4596-ac68-0b99f32d41c7" containerName="manager"
Jul 07 14:32:07.379174 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.379146    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"]
Jul 07 14:32:07.379322 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.379296    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"
Jul 07 14:32:07.381084 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:07.381024    2567 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0be04051-dee3-4d38-bf2d-c3904f13a7c4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-rhgcs\": pods \"limitador-operator-controller-manager-859d7b78bd-rhgcs\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"
Jul 07 14:32:07.383298 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:07.383267    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4hcvn\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" podUID="9dbb8f1e-4aee-4596-ac68-0b99f32d41c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:32:07.385275 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:07.385243    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4hcvn\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" podUID="9dbb8f1e-4aee-4596-ac68-0b99f32d41c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:32:07.387478 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:07.387452    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rhgcs\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" podUID="0be04051-dee3-4d38-bf2d-c3904f13a7c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"
Jul 07 14:32:07.392377 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.392343    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-klhxb"]
Jul 07 14:32:07.392836 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.392805    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0be04051-dee3-4d38-bf2d-c3904f13a7c4" containerName="manager"
Jul 07 14:32:07.392836 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.392831    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0be04051-dee3-4d38-bf2d-c3904f13a7c4" containerName="manager"
Jul 07 14:32:07.392977 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.392927    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0be04051-dee3-4d38-bf2d-c3904f13a7c4" containerName="manager"
Jul 07 14:32:07.395832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.395813    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-klhxb"
Jul 07 14:32:07.405430 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.405399    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq55b\" (UniqueName: \"kubernetes.io/projected/1afd78ee-e98c-49fe-a196-6d0df10e5998-kube-api-access-bq55b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-psfb4\" (UID: \"1afd78ee-e98c-49fe-a196-6d0df10e5998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"
Jul 07 14:32:07.405610 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.405556    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1afd78ee-e98c-49fe-a196-6d0df10e5998-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-psfb4\" (UID: \"1afd78ee-e98c-49fe-a196-6d0df10e5998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"
Jul 07 14:32:07.414554 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.414527    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"]
Jul 07 14:32:07.432226 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.432191    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-klhxb"]
Jul 07 14:32:07.449820 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:07.449775    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rhgcs\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" podUID="0be04051-dee3-4d38-bf2d-c3904f13a7c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"
Jul 07 14:32:07.452242 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:07.452198    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4hcvn\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" podUID="9dbb8f1e-4aee-4596-ac68-0b99f32d41c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:32:07.506384 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.506303    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq55b\" (UniqueName: \"kubernetes.io/projected/1afd78ee-e98c-49fe-a196-6d0df10e5998-kube-api-access-bq55b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-psfb4\" (UID: \"1afd78ee-e98c-49fe-a196-6d0df10e5998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"
Jul 07 14:32:07.506575 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.506511    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27hhh\" (UniqueName: \"kubernetes.io/projected/c325f1d6-139e-4191-b3c7-375bb76fa1ec-kube-api-access-27hhh\") pod \"limitador-operator-controller-manager-859d7b78bd-klhxb\" (UID: \"c325f1d6-139e-4191-b3c7-375bb76fa1ec\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-klhxb"
Jul 07 14:32:07.506672 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.506618    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1afd78ee-e98c-49fe-a196-6d0df10e5998-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-psfb4\" (UID: \"1afd78ee-e98c-49fe-a196-6d0df10e5998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"
Jul 07 14:32:07.507036 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.507016    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1afd78ee-e98c-49fe-a196-6d0df10e5998-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-psfb4\" (UID: \"1afd78ee-e98c-49fe-a196-6d0df10e5998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"
Jul 07 14:32:07.531766 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.531734    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq55b\" (UniqueName: \"kubernetes.io/projected/1afd78ee-e98c-49fe-a196-6d0df10e5998-kube-api-access-bq55b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-psfb4\" (UID: \"1afd78ee-e98c-49fe-a196-6d0df10e5998\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"
Jul 07 14:32:07.608029 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.607934    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27hhh\" (UniqueName: \"kubernetes.io/projected/c325f1d6-139e-4191-b3c7-375bb76fa1ec-kube-api-access-27hhh\") pod \"limitador-operator-controller-manager-859d7b78bd-klhxb\" (UID: \"c325f1d6-139e-4191-b3c7-375bb76fa1ec\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-klhxb"
Jul 07 14:32:07.618957 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.618920    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27hhh\" (UniqueName: \"kubernetes.io/projected/c325f1d6-139e-4191-b3c7-375bb76fa1ec-kube-api-access-27hhh\") pod \"limitador-operator-controller-manager-859d7b78bd-klhxb\" (UID: \"c325f1d6-139e-4191-b3c7-375bb76fa1ec\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-klhxb"
Jul 07 14:32:07.635864 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.635836    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:32:07.638285 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:07.638259    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rhgcs\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" podUID="0be04051-dee3-4d38-bf2d-c3904f13a7c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"
Jul 07 14:32:07.638484 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.638469    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"
Jul 07 14:32:07.640438 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:07.640418    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4hcvn\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" podUID="9dbb8f1e-4aee-4596-ac68-0b99f32d41c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:32:07.642540 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:07.642522    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4hcvn\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" podUID="9dbb8f1e-4aee-4596-ac68-0b99f32d41c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:32:07.644445 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:07.644417    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rhgcs\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" podUID="0be04051-dee3-4d38-bf2d-c3904f13a7c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"
Jul 07 14:32:07.708480 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.708447    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9dbb8f1e-4aee-4596-ac68-0b99f32d41c7-extensions-socket-volume\") pod \"9dbb8f1e-4aee-4596-ac68-0b99f32d41c7\" (UID: \"9dbb8f1e-4aee-4596-ac68-0b99f32d41c7\") "
Jul 07 14:32:07.708480 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.708480    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k92zm\" (UniqueName: \"kubernetes.io/projected/9dbb8f1e-4aee-4596-ac68-0b99f32d41c7-kube-api-access-k92zm\") pod \"9dbb8f1e-4aee-4596-ac68-0b99f32d41c7\" (UID: \"9dbb8f1e-4aee-4596-ac68-0b99f32d41c7\") "
Jul 07 14:32:07.708733 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.708513    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2x49\" (UniqueName: \"kubernetes.io/projected/0be04051-dee3-4d38-bf2d-c3904f13a7c4-kube-api-access-g2x49\") pod \"0be04051-dee3-4d38-bf2d-c3904f13a7c4\" (UID: \"0be04051-dee3-4d38-bf2d-c3904f13a7c4\") "
Jul 07 14:32:07.708942 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.708919    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dbb8f1e-4aee-4596-ac68-0b99f32d41c7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9dbb8f1e-4aee-4596-ac68-0b99f32d41c7" (UID: "9dbb8f1e-4aee-4596-ac68-0b99f32d41c7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:32:07.710843 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.710815    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dbb8f1e-4aee-4596-ac68-0b99f32d41c7-kube-api-access-k92zm" (OuterVolumeSpecName: "kube-api-access-k92zm") pod "9dbb8f1e-4aee-4596-ac68-0b99f32d41c7" (UID: "9dbb8f1e-4aee-4596-ac68-0b99f32d41c7"). InnerVolumeSpecName "kube-api-access-k92zm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:32:07.710953 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.710815    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0be04051-dee3-4d38-bf2d-c3904f13a7c4-kube-api-access-g2x49" (OuterVolumeSpecName: "kube-api-access-g2x49") pod "0be04051-dee3-4d38-bf2d-c3904f13a7c4" (UID: "0be04051-dee3-4d38-bf2d-c3904f13a7c4"). InnerVolumeSpecName "kube-api-access-g2x49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:32:07.765074 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.765018    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"
Jul 07 14:32:07.771184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.771159    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-klhxb"
Jul 07 14:32:07.809350 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.809286    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9dbb8f1e-4aee-4596-ac68-0b99f32d41c7-extensions-socket-volume\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:32:07.809350 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.809317    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k92zm\" (UniqueName: \"kubernetes.io/projected/9dbb8f1e-4aee-4596-ac68-0b99f32d41c7-kube-api-access-k92zm\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:32:07.809350 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.809327    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2x49\" (UniqueName: \"kubernetes.io/projected/0be04051-dee3-4d38-bf2d-c3904f13a7c4-kube-api-access-g2x49\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:32:07.921918 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.921892    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"]
Jul 07 14:32:07.925549 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:32:07.925514    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1afd78ee_e98c_49fe_a196_6d0df10e5998.slice/crio-fda3f374c6b941691fb8760163bf7fa906489ebb8af586055fb93a25076de156 WatchSource:0}: Error finding container fda3f374c6b941691fb8760163bf7fa906489ebb8af586055fb93a25076de156: Status 404 returned error can't find the container with id fda3f374c6b941691fb8760163bf7fa906489ebb8af586055fb93a25076de156
Jul 07 14:32:07.937629 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:07.937607    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-klhxb"]
Jul 07 14:32:07.940177 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:32:07.940152    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc325f1d6_139e_4191_b3c7_375bb76fa1ec.slice/crio-68dd39dd63ee7c7095079560f83909701e2e612b2b43a187c126b68f22ba18b0 WatchSource:0}: Error finding container 68dd39dd63ee7c7095079560f83909701e2e612b2b43a187c126b68f22ba18b0: Status 404 returned error can't find the container with id 68dd39dd63ee7c7095079560f83909701e2e612b2b43a187c126b68f22ba18b0
Jul 07 14:32:08.441249 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.441216    2567 generic.go:356] "Generic (PLEG): container finished" podID="0be04051-dee3-4d38-bf2d-c3904f13a7c4" containerID="cee0cf39f1c73c9662b3594cc24f4eb62a2b88fdde6997a8c4987e97d82a685f" exitCode=0
Jul 07 14:32:08.441719 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.441264    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"
Jul 07 14:32:08.441719 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.441318    2567 scope.go:117] "RemoveContainer" containerID="cee0cf39f1c73c9662b3594cc24f4eb62a2b88fdde6997a8c4987e97d82a685f"
Jul 07 14:32:08.443284 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.443083    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-klhxb" event={"ID":"c325f1d6-139e-4191-b3c7-375bb76fa1ec","Type":"ContainerStarted","Data":"734a31e1adf59750216402232e7d942c6eb9e243b12da643bf6fb07b266a4a21"}
Jul 07 14:32:08.443284 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.443139    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-klhxb"
Jul 07 14:32:08.443284 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.443163    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-klhxb" event={"ID":"c325f1d6-139e-4191-b3c7-375bb76fa1ec","Type":"ContainerStarted","Data":"68dd39dd63ee7c7095079560f83909701e2e612b2b43a187c126b68f22ba18b0"}
Jul 07 14:32:08.444967 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.444941    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4" event={"ID":"1afd78ee-e98c-49fe-a196-6d0df10e5998","Type":"ContainerStarted","Data":"e7b6a9fa9c4d69894ebd774422d25db22d78a919954cc32b2f4bd54bbf1c25c3"}
Jul 07 14:32:08.445076 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.444991    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4" event={"ID":"1afd78ee-e98c-49fe-a196-6d0df10e5998","Type":"ContainerStarted","Data":"fda3f374c6b941691fb8760163bf7fa906489ebb8af586055fb93a25076de156"}
Jul 07 14:32:08.445076 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.445049    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"
Jul 07 14:32:08.446515 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.446494    2567 generic.go:356] "Generic (PLEG): container finished" podID="9dbb8f1e-4aee-4596-ac68-0b99f32d41c7" containerID="98a77f47ff5419e4ec1c413b8f9fc30cbc8205937dca60a468c066dfe285897b" exitCode=0
Jul 07 14:32:08.446628 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.446540    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:32:08.450180 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:08.450002    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rhgcs\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" podUID="0be04051-dee3-4d38-bf2d-c3904f13a7c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"
Jul 07 14:32:08.451726 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.451710    2567 scope.go:117] "RemoveContainer" containerID="cee0cf39f1c73c9662b3594cc24f4eb62a2b88fdde6997a8c4987e97d82a685f"
Jul 07 14:32:08.452034 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:08.452010    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cee0cf39f1c73c9662b3594cc24f4eb62a2b88fdde6997a8c4987e97d82a685f\": container with ID starting with cee0cf39f1c73c9662b3594cc24f4eb62a2b88fdde6997a8c4987e97d82a685f not found: ID does not exist" containerID="cee0cf39f1c73c9662b3594cc24f4eb62a2b88fdde6997a8c4987e97d82a685f"
Jul 07 14:32:08.452112 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.452045    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee0cf39f1c73c9662b3594cc24f4eb62a2b88fdde6997a8c4987e97d82a685f"} err="failed to get container status \"cee0cf39f1c73c9662b3594cc24f4eb62a2b88fdde6997a8c4987e97d82a685f\": rpc error: code = NotFound desc = could not find container \"cee0cf39f1c73c9662b3594cc24f4eb62a2b88fdde6997a8c4987e97d82a685f\": container with ID starting with cee0cf39f1c73c9662b3594cc24f4eb62a2b88fdde6997a8c4987e97d82a685f not found: ID does not exist"
Jul 07 14:32:08.452112 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.452071    2567 scope.go:117] "RemoveContainer" containerID="98a77f47ff5419e4ec1c413b8f9fc30cbc8205937dca60a468c066dfe285897b"
Jul 07 14:32:08.460066 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:08.460042    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4hcvn\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" podUID="9dbb8f1e-4aee-4596-ac68-0b99f32d41c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:32:08.460998 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.460982    2567 scope.go:117] "RemoveContainer" containerID="98a77f47ff5419e4ec1c413b8f9fc30cbc8205937dca60a468c066dfe285897b"
Jul 07 14:32:08.461277 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:08.461259    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98a77f47ff5419e4ec1c413b8f9fc30cbc8205937dca60a468c066dfe285897b\": container with ID starting with 98a77f47ff5419e4ec1c413b8f9fc30cbc8205937dca60a468c066dfe285897b not found: ID does not exist" containerID="98a77f47ff5419e4ec1c413b8f9fc30cbc8205937dca60a468c066dfe285897b"
Jul 07 14:32:08.461311 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.461285    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a77f47ff5419e4ec1c413b8f9fc30cbc8205937dca60a468c066dfe285897b"} err="failed to get container status \"98a77f47ff5419e4ec1c413b8f9fc30cbc8205937dca60a468c066dfe285897b\": rpc error: code = NotFound desc = could not find container \"98a77f47ff5419e4ec1c413b8f9fc30cbc8205937dca60a468c066dfe285897b\": container with ID starting with 98a77f47ff5419e4ec1c413b8f9fc30cbc8205937dca60a468c066dfe285897b not found: ID does not exist"
Jul 07 14:32:08.501056 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.500995    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-klhxb" podStartSLOduration=1.5009727210000001 podStartE2EDuration="1.500972721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:32:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:32:08.498870801 +0000 UTC m=+483.704844932" watchObservedRunningTime="2026-07-07 14:32:08.500972721 +0000 UTC m=+483.706946852"
Jul 07 14:32:08.506003 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:08.505971    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rhgcs\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" podUID="0be04051-dee3-4d38-bf2d-c3904f13a7c4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rhgcs"
Jul 07 14:32:08.542796 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:08.542742    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4" podStartSLOduration=1.542722209 podStartE2EDuration="1.542722209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:32:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:32:08.541216454 +0000 UTC m=+483.747190584" watchObservedRunningTime="2026-07-07 14:32:08.542722209 +0000 UTC m=+483.748696405"
Jul 07 14:32:08.543530 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:08.543498    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4hcvn\" is forbidden: User \"system:node:ip-10-0-139-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-48.ec2.internal' and this object" podUID="9dbb8f1e-4aee-4596-ac68-0b99f32d41c7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4hcvn"
Jul 07 14:32:09.296302 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:09.296268    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0be04051-dee3-4d38-bf2d-c3904f13a7c4" path="/var/lib/kubelet/pods/0be04051-dee3-4d38-bf2d-c3904f13a7c4/volumes"
Jul 07 14:32:09.296635 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:09.296622    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dbb8f1e-4aee-4596-ac68-0b99f32d41c7" path="/var/lib/kubelet/pods/9dbb8f1e-4aee-4596-ac68-0b99f32d41c7/volumes"
Jul 07 14:32:19.454998 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:19.454965    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-klhxb"
Jul 07 14:32:19.455500 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:19.455132    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"
Jul 07 14:32:38.870208 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:38.870171    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"]
Jul 07 14:32:38.870645 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:38.870377    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4" podUID="1afd78ee-e98c-49fe-a196-6d0df10e5998" containerName="manager" containerID="cri-o://e7b6a9fa9c4d69894ebd774422d25db22d78a919954cc32b2f4bd54bbf1c25c3" gracePeriod=10
Jul 07 14:32:39.119265 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.119237    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"]
Jul 07 14:32:39.122838 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.122781    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"
Jul 07 14:32:39.127491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.127469    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"
Jul 07 14:32:39.135163 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.135138    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"]
Jul 07 14:32:39.272895 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.272858    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq55b\" (UniqueName: \"kubernetes.io/projected/1afd78ee-e98c-49fe-a196-6d0df10e5998-kube-api-access-bq55b\") pod \"1afd78ee-e98c-49fe-a196-6d0df10e5998\" (UID: \"1afd78ee-e98c-49fe-a196-6d0df10e5998\") "
Jul 07 14:32:39.272895 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.272898    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1afd78ee-e98c-49fe-a196-6d0df10e5998-extensions-socket-volume\") pod \"1afd78ee-e98c-49fe-a196-6d0df10e5998\" (UID: \"1afd78ee-e98c-49fe-a196-6d0df10e5998\") "
Jul 07 14:32:39.273098 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.273072    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qkmb\" (UniqueName: \"kubernetes.io/projected/80cc7974-3ddc-4279-80e7-c1d724843c50-kube-api-access-4qkmb\") pod \"kuadrant-operator-controller-manager-86878c769f-tkhql\" (UID: \"80cc7974-3ddc-4279-80e7-c1d724843c50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"
Jul 07 14:32:39.273134 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.273124    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80cc7974-3ddc-4279-80e7-c1d724843c50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tkhql\" (UID: \"80cc7974-3ddc-4279-80e7-c1d724843c50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"
Jul 07 14:32:39.273342 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.273320    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1afd78ee-e98c-49fe-a196-6d0df10e5998-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1afd78ee-e98c-49fe-a196-6d0df10e5998" (UID: "1afd78ee-e98c-49fe-a196-6d0df10e5998"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:32:39.275095 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.275072    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1afd78ee-e98c-49fe-a196-6d0df10e5998-kube-api-access-bq55b" (OuterVolumeSpecName: "kube-api-access-bq55b") pod "1afd78ee-e98c-49fe-a196-6d0df10e5998" (UID: "1afd78ee-e98c-49fe-a196-6d0df10e5998"). InnerVolumeSpecName "kube-api-access-bq55b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:32:39.374287 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.374192    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qkmb\" (UniqueName: \"kubernetes.io/projected/80cc7974-3ddc-4279-80e7-c1d724843c50-kube-api-access-4qkmb\") pod \"kuadrant-operator-controller-manager-86878c769f-tkhql\" (UID: \"80cc7974-3ddc-4279-80e7-c1d724843c50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"
Jul 07 14:32:39.374287 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.374245    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80cc7974-3ddc-4279-80e7-c1d724843c50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tkhql\" (UID: \"80cc7974-3ddc-4279-80e7-c1d724843c50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"
Jul 07 14:32:39.374538 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.374345    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq55b\" (UniqueName: \"kubernetes.io/projected/1afd78ee-e98c-49fe-a196-6d0df10e5998-kube-api-access-bq55b\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:32:39.374538 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.374360    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1afd78ee-e98c-49fe-a196-6d0df10e5998-extensions-socket-volume\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:32:39.374757 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.374732    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80cc7974-3ddc-4279-80e7-c1d724843c50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tkhql\" (UID: \"80cc7974-3ddc-4279-80e7-c1d724843c50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"
Jul 07 14:32:39.388002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.387973    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qkmb\" (UniqueName: \"kubernetes.io/projected/80cc7974-3ddc-4279-80e7-c1d724843c50-kube-api-access-4qkmb\") pod \"kuadrant-operator-controller-manager-86878c769f-tkhql\" (UID: \"80cc7974-3ddc-4279-80e7-c1d724843c50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"
Jul 07 14:32:39.434029 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.433987    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"
Jul 07 14:32:39.578141 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.578107    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"]
Jul 07 14:32:39.582128 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:32:39.582102    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80cc7974_3ddc_4279_80e7_c1d724843c50.slice/crio-c944b17fca1296c815079e3ac4e0ac8c0ef28027112cfe219dcae27a01e87be3 WatchSource:0}: Error finding container c944b17fca1296c815079e3ac4e0ac8c0ef28027112cfe219dcae27a01e87be3: Status 404 returned error can't find the container with id c944b17fca1296c815079e3ac4e0ac8c0ef28027112cfe219dcae27a01e87be3
Jul 07 14:32:39.615228 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.615195    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql" event={"ID":"80cc7974-3ddc-4279-80e7-c1d724843c50","Type":"ContainerStarted","Data":"c944b17fca1296c815079e3ac4e0ac8c0ef28027112cfe219dcae27a01e87be3"}
Jul 07 14:32:39.616540 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.616518    2567 generic.go:356] "Generic (PLEG): container finished" podID="1afd78ee-e98c-49fe-a196-6d0df10e5998" containerID="e7b6a9fa9c4d69894ebd774422d25db22d78a919954cc32b2f4bd54bbf1c25c3" exitCode=0
Jul 07 14:32:39.616660 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.616579    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"
Jul 07 14:32:39.616660 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.616617    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4" event={"ID":"1afd78ee-e98c-49fe-a196-6d0df10e5998","Type":"ContainerDied","Data":"e7b6a9fa9c4d69894ebd774422d25db22d78a919954cc32b2f4bd54bbf1c25c3"}
Jul 07 14:32:39.616747 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.616666    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4" event={"ID":"1afd78ee-e98c-49fe-a196-6d0df10e5998","Type":"ContainerDied","Data":"fda3f374c6b941691fb8760163bf7fa906489ebb8af586055fb93a25076de156"}
Jul 07 14:32:39.616747 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.616690    2567 scope.go:117] "RemoveContainer" containerID="e7b6a9fa9c4d69894ebd774422d25db22d78a919954cc32b2f4bd54bbf1c25c3"
Jul 07 14:32:39.627122 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.627104    2567 scope.go:117] "RemoveContainer" containerID="e7b6a9fa9c4d69894ebd774422d25db22d78a919954cc32b2f4bd54bbf1c25c3"
Jul 07 14:32:39.627402 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:32:39.627378    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7b6a9fa9c4d69894ebd774422d25db22d78a919954cc32b2f4bd54bbf1c25c3\": container with ID starting with e7b6a9fa9c4d69894ebd774422d25db22d78a919954cc32b2f4bd54bbf1c25c3 not found: ID does not exist" containerID="e7b6a9fa9c4d69894ebd774422d25db22d78a919954cc32b2f4bd54bbf1c25c3"
Jul 07 14:32:39.627479 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.627416    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7b6a9fa9c4d69894ebd774422d25db22d78a919954cc32b2f4bd54bbf1c25c3"} err="failed to get container status \"e7b6a9fa9c4d69894ebd774422d25db22d78a919954cc32b2f4bd54bbf1c25c3\": rpc error: code = NotFound desc = could not find container \"e7b6a9fa9c4d69894ebd774422d25db22d78a919954cc32b2f4bd54bbf1c25c3\": container with ID starting with e7b6a9fa9c4d69894ebd774422d25db22d78a919954cc32b2f4bd54bbf1c25c3 not found: ID does not exist"
Jul 07 14:32:39.643434 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.643411    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"]
Jul 07 14:32:39.649819 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:39.649797    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-psfb4"]
Jul 07 14:32:40.623486 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:40.623455    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql" event={"ID":"80cc7974-3ddc-4279-80e7-c1d724843c50","Type":"ContainerStarted","Data":"40b35fb21928ea4e0f4d12c175359d6ffaf5e6141afce719637600ecffb7d794"}
Jul 07 14:32:40.623941 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:40.623528    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"
Jul 07 14:32:40.647865 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:40.647810    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql" podStartSLOduration=1.647795256 podStartE2EDuration="1.647795256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:32:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:32:40.644844404 +0000 UTC m=+515.850818545" watchObservedRunningTime="2026-07-07 14:32:40.647795256 +0000 UTC m=+515.853769384"
Jul 07 14:32:41.301928 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:41.301890    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1afd78ee-e98c-49fe-a196-6d0df10e5998" path="/var/lib/kubelet/pods/1afd78ee-e98c-49fe-a196-6d0df10e5998/volumes"
Jul 07 14:32:51.631883 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:51.631848    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"
Jul 07 14:32:58.478162 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.478043    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:32:58.478664 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.478457    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1afd78ee-e98c-49fe-a196-6d0df10e5998" containerName="manager"
Jul 07 14:32:58.478664 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.478476    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1afd78ee-e98c-49fe-a196-6d0df10e5998" containerName="manager"
Jul 07 14:32:58.478664 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.478578    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1afd78ee-e98c-49fe-a196-6d0df10e5998" containerName="manager"
Jul 07 14:32:58.481536 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.481518    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-drhvz"
Jul 07 14:32:58.484658 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.484637    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 14:32:58.485250 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.485229    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4x5zn\""
Jul 07 14:32:58.492750 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.492723    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:32:58.534424 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.534387    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:32:58.637324 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.637285    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjhcf\" (UniqueName: \"kubernetes.io/projected/d2c6668c-2d32-494c-9304-03d0b2ea7b5e-kube-api-access-fjhcf\") pod \"limitador-limitador-54d6d988d5-drhvz\" (UID: \"d2c6668c-2d32-494c-9304-03d0b2ea7b5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-drhvz"
Jul 07 14:32:58.637512 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.637350    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d2c6668c-2d32-494c-9304-03d0b2ea7b5e-config-file\") pod \"limitador-limitador-54d6d988d5-drhvz\" (UID: \"d2c6668c-2d32-494c-9304-03d0b2ea7b5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-drhvz"
Jul 07 14:32:58.738137 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.738033    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d2c6668c-2d32-494c-9304-03d0b2ea7b5e-config-file\") pod \"limitador-limitador-54d6d988d5-drhvz\" (UID: \"d2c6668c-2d32-494c-9304-03d0b2ea7b5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-drhvz"
Jul 07 14:32:58.738137 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.738130    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjhcf\" (UniqueName: \"kubernetes.io/projected/d2c6668c-2d32-494c-9304-03d0b2ea7b5e-kube-api-access-fjhcf\") pod \"limitador-limitador-54d6d988d5-drhvz\" (UID: \"d2c6668c-2d32-494c-9304-03d0b2ea7b5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-drhvz"
Jul 07 14:32:58.738739 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.738711    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d2c6668c-2d32-494c-9304-03d0b2ea7b5e-config-file\") pod \"limitador-limitador-54d6d988d5-drhvz\" (UID: \"d2c6668c-2d32-494c-9304-03d0b2ea7b5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-drhvz"
Jul 07 14:32:58.748832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.748807    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjhcf\" (UniqueName: \"kubernetes.io/projected/d2c6668c-2d32-494c-9304-03d0b2ea7b5e-kube-api-access-fjhcf\") pod \"limitador-limitador-54d6d988d5-drhvz\" (UID: \"d2c6668c-2d32-494c-9304-03d0b2ea7b5e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-drhvz"
Jul 07 14:32:58.793601 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.793562    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-drhvz"
Jul 07 14:32:58.945432 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:58.945402    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:32:58.947752 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:32:58.947711    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c6668c_2d32_494c_9304_03d0b2ea7b5e.slice/crio-ba2c955c106d35b1fc8b5e01b7a38f61aeeecf90ccd6293e3b724e5ccb45298c WatchSource:0}: Error finding container ba2c955c106d35b1fc8b5e01b7a38f61aeeecf90ccd6293e3b724e5ccb45298c: Status 404 returned error can't find the container with id ba2c955c106d35b1fc8b5e01b7a38f61aeeecf90ccd6293e3b724e5ccb45298c
Jul 07 14:32:59.722160 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:32:59.722126    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-drhvz" event={"ID":"d2c6668c-2d32-494c-9304-03d0b2ea7b5e","Type":"ContainerStarted","Data":"ba2c955c106d35b1fc8b5e01b7a38f61aeeecf90ccd6293e3b724e5ccb45298c"}
Jul 07 14:33:01.735869 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:33:01.735834    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-drhvz" event={"ID":"d2c6668c-2d32-494c-9304-03d0b2ea7b5e","Type":"ContainerStarted","Data":"1f1c226fcf5d0b8e0d5a90d2e94e082deb4cc03332018dce29ad930d6dc5dd61"}
Jul 07 14:33:01.736269 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:33:01.735926    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-drhvz"
Jul 07 14:33:01.757285 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:33:01.757230    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-drhvz" podStartSLOduration=1.343409139 podStartE2EDuration="3.757211398s" totalImagesPullingTime="2.413802259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:33:01.755319645 +0000 UTC m=+536.961293798" watchObservedRunningTime="2026-07-07 14:33:01.757211398 +0000 UTC m=+536.963185569"
Jul 07 14:33:12.742940 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:33:12.742907    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-drhvz"
Jul 07 14:34:05.265707 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:34:05.265677    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:34:05.266201 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:34:05.265759    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:34:09.285914 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:34:09.285880    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:34:32.260779 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:34:32.260699    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:34:45.058781 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:34:45.058744    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:34:51.057501 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:34:51.057463    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:35:11.571353 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:35:11.571320    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:35:18.873204 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:35:18.873158    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:35:27.369124 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:35:27.369081    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:37:03.162717 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:37:03.162678    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:37:13.770414 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:37:13.770372    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:37:24.761038 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:37:24.761003    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:37:33.361778 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:37:33.361682    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:37:44.361394 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:37:44.361349    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:38:10.559865 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:38:10.559820    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:38:24.881967 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:38:24.881930    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:39:00.065725 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:39:00.065626    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:39:05.295021 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:39:05.294985    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:39:05.296088 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:39:05.296069    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:39:10.158927 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:39:10.158889    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:39:18.762669 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:39:18.762627    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:39:27.563672 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:39:27.563638    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:39:38.457578 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:39:38.457542    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:39:47.269466 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:39:47.269428    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:39:59.059530 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:39:59.059488    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:40:08.770207 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:40:08.770170    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:40:31.164501 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:40:31.164410    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:40:41.052921 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:40:41.052879    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:41:03.662095 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:41:03.662056    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:41:14.258179 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:41:14.258139    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:41:30.562251 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:41:30.562213    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:41:41.663781 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:41:41.663747    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:41:50.955173 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:41:50.955134    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:41:59.673288 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:41:59.673203    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:42:08.774058 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:08.774023    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:42:36.535283 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:36.535243    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"]
Jul 07 14:42:36.535832 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:36.535470    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql" podUID="80cc7974-3ddc-4279-80e7-c1d724843c50" containerName="manager" containerID="cri-o://40b35fb21928ea4e0f4d12c175359d6ffaf5e6141afce719637600ecffb7d794" gracePeriod=10
Jul 07 14:42:38.522275 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:38.522185    2567 generic.go:356] "Generic (PLEG): container finished" podID="80cc7974-3ddc-4279-80e7-c1d724843c50" containerID="40b35fb21928ea4e0f4d12c175359d6ffaf5e6141afce719637600ecffb7d794" exitCode=0
Jul 07 14:42:38.522275 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:38.522240    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql" event={"ID":"80cc7974-3ddc-4279-80e7-c1d724843c50","Type":"ContainerDied","Data":"40b35fb21928ea4e0f4d12c175359d6ffaf5e6141afce719637600ecffb7d794"}
Jul 07 14:42:38.948931 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:38.948907    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"
Jul 07 14:42:39.066153 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:39.066063    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qkmb\" (UniqueName: \"kubernetes.io/projected/80cc7974-3ddc-4279-80e7-c1d724843c50-kube-api-access-4qkmb\") pod \"80cc7974-3ddc-4279-80e7-c1d724843c50\" (UID: \"80cc7974-3ddc-4279-80e7-c1d724843c50\") "
Jul 07 14:42:39.066153 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:39.066111    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80cc7974-3ddc-4279-80e7-c1d724843c50-extensions-socket-volume\") pod \"80cc7974-3ddc-4279-80e7-c1d724843c50\" (UID: \"80cc7974-3ddc-4279-80e7-c1d724843c50\") "
Jul 07 14:42:39.066486 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:39.066460    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80cc7974-3ddc-4279-80e7-c1d724843c50-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "80cc7974-3ddc-4279-80e7-c1d724843c50" (UID: "80cc7974-3ddc-4279-80e7-c1d724843c50"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:42:39.068303 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:39.068280    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80cc7974-3ddc-4279-80e7-c1d724843c50-kube-api-access-4qkmb" (OuterVolumeSpecName: "kube-api-access-4qkmb") pod "80cc7974-3ddc-4279-80e7-c1d724843c50" (UID: "80cc7974-3ddc-4279-80e7-c1d724843c50"). InnerVolumeSpecName "kube-api-access-4qkmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:42:39.167641 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:39.167610    2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80cc7974-3ddc-4279-80e7-c1d724843c50-extensions-socket-volume\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:42:39.167641 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:39.167636    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qkmb\" (UniqueName: \"kubernetes.io/projected/80cc7974-3ddc-4279-80e7-c1d724843c50-kube-api-access-4qkmb\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:42:39.527823 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:39.527793    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"
Jul 07 14:42:39.527823 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:39.527797    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql" event={"ID":"80cc7974-3ddc-4279-80e7-c1d724843c50","Type":"ContainerDied","Data":"c944b17fca1296c815079e3ac4e0ac8c0ef28027112cfe219dcae27a01e87be3"}
Jul 07 14:42:39.528366 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:39.527869    2567 scope.go:117] "RemoveContainer" containerID="40b35fb21928ea4e0f4d12c175359d6ffaf5e6141afce719637600ecffb7d794"
Jul 07 14:42:39.587109 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:39.586958    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"]
Jul 07 14:42:39.595757 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:39.595733    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tkhql"]
Jul 07 14:42:41.296372 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:42:41.296338    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80cc7974-3ddc-4279-80e7-c1d724843c50" path="/var/lib/kubelet/pods/80cc7974-3ddc-4279-80e7-c1d724843c50/volumes"
Jul 07 14:43:37.670995 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:37.670955    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdpgc"]
Jul 07 14:43:37.671405 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:37.671313    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80cc7974-3ddc-4279-80e7-c1d724843c50" containerName="manager"
Jul 07 14:43:37.671405 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:37.671324    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="80cc7974-3ddc-4279-80e7-c1d724843c50" containerName="manager"
Jul 07 14:43:37.671405 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:37.671393    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="80cc7974-3ddc-4279-80e7-c1d724843c50" containerName="manager"
Jul 07 14:43:37.674413 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:37.674396    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdpgc"
Jul 07 14:43:37.677024 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:37.676997    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jbwxs\""
Jul 07 14:43:37.686093 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:37.686068    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdpgc"]
Jul 07 14:43:37.763296 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:37.763254    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlvzz\" (UniqueName: \"kubernetes.io/projected/2ea57ae0-5122-4176-9088-46de388c0c63-kube-api-access-zlvzz\") pod \"kuadrant-operator-controller-manager-86878c769f-vdpgc\" (UID: \"2ea57ae0-5122-4176-9088-46de388c0c63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdpgc"
Jul 07 14:43:37.763459 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:37.763309    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ea57ae0-5122-4176-9088-46de388c0c63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vdpgc\" (UID: \"2ea57ae0-5122-4176-9088-46de388c0c63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdpgc"
Jul 07 14:43:37.864471 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:37.864437    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ea57ae0-5122-4176-9088-46de388c0c63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vdpgc\" (UID: \"2ea57ae0-5122-4176-9088-46de388c0c63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdpgc"
Jul 07 14:43:37.864710 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:37.864507    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlvzz\" (UniqueName: \"kubernetes.io/projected/2ea57ae0-5122-4176-9088-46de388c0c63-kube-api-access-zlvzz\") pod \"kuadrant-operator-controller-manager-86878c769f-vdpgc\" (UID: \"2ea57ae0-5122-4176-9088-46de388c0c63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdpgc"
Jul 07 14:43:37.864908 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:37.864883    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ea57ae0-5122-4176-9088-46de388c0c63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vdpgc\" (UID: \"2ea57ae0-5122-4176-9088-46de388c0c63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdpgc"
Jul 07 14:43:37.880944 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:37.880912    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlvzz\" (UniqueName: \"kubernetes.io/projected/2ea57ae0-5122-4176-9088-46de388c0c63-kube-api-access-zlvzz\") pod \"kuadrant-operator-controller-manager-86878c769f-vdpgc\" (UID: \"2ea57ae0-5122-4176-9088-46de388c0c63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdpgc"
Jul 07 14:43:37.984888 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:37.984793    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdpgc"
Jul 07 14:43:38.128328 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:38.128298    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdpgc"]
Jul 07 14:43:38.131907 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:43:38.131880    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ea57ae0_5122_4176_9088_46de388c0c63.slice/crio-45c09557afb25be08e73b97f0a11f522078eb4aebfb27b253adc0e1c5bb629b5 WatchSource:0}: Error finding container 45c09557afb25be08e73b97f0a11f522078eb4aebfb27b253adc0e1c5bb629b5: Status 404 returned error can't find the container with id 45c09557afb25be08e73b97f0a11f522078eb4aebfb27b253adc0e1c5bb629b5
Jul 07 14:43:38.808550 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:38.808520    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdpgc" event={"ID":"2ea57ae0-5122-4176-9088-46de388c0c63","Type":"ContainerStarted","Data":"028d3c2850f8321fcd90bafb480609f8eb633fc30a967e64c659b71e97ef66b7"}
Jul 07 14:43:38.809049 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:38.808577    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdpgc" event={"ID":"2ea57ae0-5122-4176-9088-46de388c0c63","Type":"ContainerStarted","Data":"45c09557afb25be08e73b97f0a11f522078eb4aebfb27b253adc0e1c5bb629b5"}
Jul 07 14:43:38.809049 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:38.808645    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdpgc"
Jul 07 14:43:38.832817 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:38.832766    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdpgc" podStartSLOduration=1.832745816 podStartE2EDuration="1.832745816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:43:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:43:38.832258777 +0000 UTC m=+1174.038232908" watchObservedRunningTime="2026-07-07 14:43:38.832745816 +0000 UTC m=+1174.038719947"
Jul 07 14:43:49.815837 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:49.815803    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdpgc"
Jul 07 14:43:58.399200 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:43:58.399162    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:44:05.325100 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:44:05.325067    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:44:05.327396 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:44:05.327370    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:44:09.171553 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:44:09.171513    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:44:17.599345 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:44:17.599308    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:44:28.669941 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:44:28.669900    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:44:37.865349 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:44:37.865317    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:44:49.661979 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:44:49.661941    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:44:58.870026 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:44:58.869949    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:45:00.153092 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:00.150417    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723925-prwqb"]
Jul 07 14:45:00.155404 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:00.155310    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723925-prwqb"
Jul 07 14:45:00.158300 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:00.158268    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cx6pw\""
Jul 07 14:45:00.160526 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:00.160500    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723925-prwqb"]
Jul 07 14:45:00.234792 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:00.234757    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwqdr\" (UniqueName: \"kubernetes.io/projected/dbbd0031-301d-44a7-a368-0e652eb72165-kube-api-access-fwqdr\") pod \"maas-api-key-cleanup-29723925-prwqb\" (UID: \"dbbd0031-301d-44a7-a368-0e652eb72165\") " pod="opendatahub/maas-api-key-cleanup-29723925-prwqb"
Jul 07 14:45:00.335928 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:00.335893    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwqdr\" (UniqueName: \"kubernetes.io/projected/dbbd0031-301d-44a7-a368-0e652eb72165-kube-api-access-fwqdr\") pod \"maas-api-key-cleanup-29723925-prwqb\" (UID: \"dbbd0031-301d-44a7-a368-0e652eb72165\") " pod="opendatahub/maas-api-key-cleanup-29723925-prwqb"
Jul 07 14:45:00.345905 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:00.345881    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwqdr\" (UniqueName: \"kubernetes.io/projected/dbbd0031-301d-44a7-a368-0e652eb72165-kube-api-access-fwqdr\") pod \"maas-api-key-cleanup-29723925-prwqb\" (UID: \"dbbd0031-301d-44a7-a368-0e652eb72165\") " pod="opendatahub/maas-api-key-cleanup-29723925-prwqb"
Jul 07 14:45:00.467639 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:00.467520    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723925-prwqb"
Jul 07 14:45:00.605257 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:00.605219    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723925-prwqb"]
Jul 07 14:45:00.608031 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:45:00.608001    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbbd0031_301d_44a7_a368_0e652eb72165.slice/crio-7fc1caddbef6c00b19ed1311b2cc35ab930ee20c46a5746cf061242804ae6206 WatchSource:0}: Error finding container 7fc1caddbef6c00b19ed1311b2cc35ab930ee20c46a5746cf061242804ae6206: Status 404 returned error can't find the container with id 7fc1caddbef6c00b19ed1311b2cc35ab930ee20c46a5746cf061242804ae6206
Jul 07 14:45:00.609933 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:00.609917    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:45:01.198867 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:01.198827    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723925-prwqb" event={"ID":"dbbd0031-301d-44a7-a368-0e652eb72165","Type":"ContainerStarted","Data":"7fc1caddbef6c00b19ed1311b2cc35ab930ee20c46a5746cf061242804ae6206"}
Jul 07 14:45:03.211933 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:03.211889    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723925-prwqb" event={"ID":"dbbd0031-301d-44a7-a368-0e652eb72165","Type":"ContainerStarted","Data":"a62240c42a3ef0d3ded0c7b9021cb1c2167301ffad080e08a433c91c70a02a97"}
Jul 07 14:45:03.230575 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:03.230520    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29723925-prwqb" podStartSLOduration=1.167134188 podStartE2EDuration="3.230500125s" totalImagesPullingTime="2.063365937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:45:03.228501619 +0000 UTC m=+1258.434475752" watchObservedRunningTime="2026-07-07 14:45:03.230500125 +0000 UTC m=+1258.436474255"
Jul 07 14:45:04.217649 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:04.217614    2567 generic.go:356] "Generic (PLEG): container finished" podID="dbbd0031-301d-44a7-a368-0e652eb72165" containerID="a62240c42a3ef0d3ded0c7b9021cb1c2167301ffad080e08a433c91c70a02a97" exitCode=0
Jul 07 14:45:04.218103 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:04.217707    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723925-prwqb" event={"ID":"dbbd0031-301d-44a7-a368-0e652eb72165","Type":"ContainerDied","Data":"a62240c42a3ef0d3ded0c7b9021cb1c2167301ffad080e08a433c91c70a02a97"}
Jul 07 14:45:05.362158 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:05.362124    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723925-prwqb"
Jul 07 14:45:05.487178 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:05.487089    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwqdr\" (UniqueName: \"kubernetes.io/projected/dbbd0031-301d-44a7-a368-0e652eb72165-kube-api-access-fwqdr\") pod \"dbbd0031-301d-44a7-a368-0e652eb72165\" (UID: \"dbbd0031-301d-44a7-a368-0e652eb72165\") "
Jul 07 14:45:05.489396 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:05.489368    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbbd0031-301d-44a7-a368-0e652eb72165-kube-api-access-fwqdr" (OuterVolumeSpecName: "kube-api-access-fwqdr") pod "dbbd0031-301d-44a7-a368-0e652eb72165" (UID: "dbbd0031-301d-44a7-a368-0e652eb72165"). InnerVolumeSpecName "kube-api-access-fwqdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:45:05.588624 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:05.588539    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwqdr\" (UniqueName: \"kubernetes.io/projected/dbbd0031-301d-44a7-a368-0e652eb72165-kube-api-access-fwqdr\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:45:06.228106 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:06.228074    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723925-prwqb"
Jul 07 14:45:06.228106 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:06.228093    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723925-prwqb" event={"ID":"dbbd0031-301d-44a7-a368-0e652eb72165","Type":"ContainerDied","Data":"7fc1caddbef6c00b19ed1311b2cc35ab930ee20c46a5746cf061242804ae6206"}
Jul 07 14:45:06.228326 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:06.228137    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7fc1caddbef6c00b19ed1311b2cc35ab930ee20c46a5746cf061242804ae6206"
Jul 07 14:45:09.967986 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:09.967954    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:45:18.857845 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:18.857808    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:45:26.360554 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:26.360504    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:45:35.060951 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:35.060914    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:45:41.558526 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:45:41.558493    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:46:03.759710 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:46:03.759674    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:46:12.669260 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:46:12.669225    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:46:23.897936 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:46:23.897891    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:46:34.868735 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:46:34.868650    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:46:43.565784 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:46:43.565748    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:46:55.357793 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:46:55.357754    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:47:04.370607 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:47:04.370554    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:47:13.357650 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:47:13.357605    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:47:23.275481 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:47:23.275436    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:47:31.966202 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:47:31.966170    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:47:40.766314 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:47:40.766283    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:47:54.162367 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:47:54.162330    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:48:03.072359 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:48:03.072253    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:48:14.685685 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:48:14.685638    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:48:26.867373 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:48:26.867333    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:48:37.875413 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:48:37.875375    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:48:45.793471 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:48:45.793434    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:48:58.625652 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:48:58.625615    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:49:05.354929 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:05.354897    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:49:05.358937 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:05.358911    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:49:10.169492 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:10.169452    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:49:22.987821 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:22.987785    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:49:35.768435 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:35.768349    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:49:44.678020 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:44.677986    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:49:53.063185 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:53.063150    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:49:57.058063 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.058029    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"]
Jul 07 14:49:57.058491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.058397    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbbd0031-301d-44a7-a368-0e652eb72165" containerName="cleanup"
Jul 07 14:49:57.058491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.058408    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbbd0031-301d-44a7-a368-0e652eb72165" containerName="cleanup"
Jul 07 14:49:57.058491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.058460    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbbd0031-301d-44a7-a368-0e652eb72165" containerName="cleanup"
Jul 07 14:49:57.061540 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.061521    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"
Jul 07 14:49:57.065262 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.065242    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-66ff89b8-serving-cert\""
Jul 07 14:49:57.065495 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.065477    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cx6pw\""
Jul 07 14:49:57.080181 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.080156    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"]
Jul 07 14:49:57.154490 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.154453    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a13874c0-1b46-4d63-a1b4-635987b2f1c5-maas-api-tls\") pod \"maas-api-e2e-ait-66ff89b8-589df996b7-l75fc\" (UID: \"a13874c0-1b46-4d63-a1b4-635987b2f1c5\") " pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"
Jul 07 14:49:57.154706 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.154563    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98bh9\" (UniqueName: \"kubernetes.io/projected/a13874c0-1b46-4d63-a1b4-635987b2f1c5-kube-api-access-98bh9\") pod \"maas-api-e2e-ait-66ff89b8-589df996b7-l75fc\" (UID: \"a13874c0-1b46-4d63-a1b4-635987b2f1c5\") " pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"
Jul 07 14:49:57.154706 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.154631    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a13874c0-1b46-4d63-a1b4-635987b2f1c5-openshift-service-ca\") pod \"maas-api-e2e-ait-66ff89b8-589df996b7-l75fc\" (UID: \"a13874c0-1b46-4d63-a1b4-635987b2f1c5\") " pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"
Jul 07 14:49:57.255343 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.255312    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98bh9\" (UniqueName: \"kubernetes.io/projected/a13874c0-1b46-4d63-a1b4-635987b2f1c5-kube-api-access-98bh9\") pod \"maas-api-e2e-ait-66ff89b8-589df996b7-l75fc\" (UID: \"a13874c0-1b46-4d63-a1b4-635987b2f1c5\") " pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"
Jul 07 14:49:57.255531 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.255361    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a13874c0-1b46-4d63-a1b4-635987b2f1c5-openshift-service-ca\") pod \"maas-api-e2e-ait-66ff89b8-589df996b7-l75fc\" (UID: \"a13874c0-1b46-4d63-a1b4-635987b2f1c5\") " pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"
Jul 07 14:49:57.255531 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.255403    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a13874c0-1b46-4d63-a1b4-635987b2f1c5-maas-api-tls\") pod \"maas-api-e2e-ait-66ff89b8-589df996b7-l75fc\" (UID: \"a13874c0-1b46-4d63-a1b4-635987b2f1c5\") " pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"
Jul 07 14:49:57.256031 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.256010    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a13874c0-1b46-4d63-a1b4-635987b2f1c5-openshift-service-ca\") pod \"maas-api-e2e-ait-66ff89b8-589df996b7-l75fc\" (UID: \"a13874c0-1b46-4d63-a1b4-635987b2f1c5\") " pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"
Jul 07 14:49:57.257913 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.257884    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a13874c0-1b46-4d63-a1b4-635987b2f1c5-maas-api-tls\") pod \"maas-api-e2e-ait-66ff89b8-589df996b7-l75fc\" (UID: \"a13874c0-1b46-4d63-a1b4-635987b2f1c5\") " pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"
Jul 07 14:49:57.281517 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.281488    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98bh9\" (UniqueName: \"kubernetes.io/projected/a13874c0-1b46-4d63-a1b4-635987b2f1c5-kube-api-access-98bh9\") pod \"maas-api-e2e-ait-66ff89b8-589df996b7-l75fc\" (UID: \"a13874c0-1b46-4d63-a1b4-635987b2f1c5\") " pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"
Jul 07 14:49:57.372732 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.372637    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"
Jul 07 14:49:57.519039 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.519007    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"]
Jul 07 14:49:57.520550 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:49:57.520525    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13874c0_1b46_4d63_a1b4_635987b2f1c5.slice/crio-2e19c2d305f911874aed1e45a58a15b630cdabb6f8c0b8e88e28d58781d1455d WatchSource:0}: Error finding container 2e19c2d305f911874aed1e45a58a15b630cdabb6f8c0b8e88e28d58781d1455d: Status 404 returned error can't find the container with id 2e19c2d305f911874aed1e45a58a15b630cdabb6f8c0b8e88e28d58781d1455d
Jul 07 14:49:57.640493 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:49:57.640411    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc" event={"ID":"a13874c0-1b46-4d63-a1b4-635987b2f1c5","Type":"ContainerStarted","Data":"2e19c2d305f911874aed1e45a58a15b630cdabb6f8c0b8e88e28d58781d1455d"}
Jul 07 14:50:00.659422 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:00.659388    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc" event={"ID":"a13874c0-1b46-4d63-a1b4-635987b2f1c5","Type":"ContainerStarted","Data":"a2e5cc072227b860a33a76cc7cc00a14ccf3c460dd8cf9cd92d2ed543a9622dc"}
Jul 07 14:50:00.659833 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:00.659486    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"
Jul 07 14:50:00.680421 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:00.680364    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc" podStartSLOduration=1.361838568 podStartE2EDuration="3.680348782s" totalImagesPullingTime="2.318510214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:49:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:50:00.679793973 +0000 UTC m=+1555.885768101" watchObservedRunningTime="2026-07-07 14:50:00.680348782 +0000 UTC m=+1555.886322910"
Jul 07 14:50:00.856898 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:00.856867    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:50:02.620192 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:02.620157    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"]
Jul 07 14:50:02.669528 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:02.669482    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc" podUID="a13874c0-1b46-4d63-a1b4-635987b2f1c5" containerName="maas-api" containerID="cri-o://a2e5cc072227b860a33a76cc7cc00a14ccf3c460dd8cf9cd92d2ed543a9622dc" gracePeriod=30
Jul 07 14:50:02.914038 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:02.914014    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"
Jul 07 14:50:03.005844 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.005812    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a13874c0-1b46-4d63-a1b4-635987b2f1c5-maas-api-tls\") pod \"a13874c0-1b46-4d63-a1b4-635987b2f1c5\" (UID: \"a13874c0-1b46-4d63-a1b4-635987b2f1c5\") "
Jul 07 14:50:03.006021 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.005911    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98bh9\" (UniqueName: \"kubernetes.io/projected/a13874c0-1b46-4d63-a1b4-635987b2f1c5-kube-api-access-98bh9\") pod \"a13874c0-1b46-4d63-a1b4-635987b2f1c5\" (UID: \"a13874c0-1b46-4d63-a1b4-635987b2f1c5\") "
Jul 07 14:50:03.006021 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.005938    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a13874c0-1b46-4d63-a1b4-635987b2f1c5-openshift-service-ca\") pod \"a13874c0-1b46-4d63-a1b4-635987b2f1c5\" (UID: \"a13874c0-1b46-4d63-a1b4-635987b2f1c5\") "
Jul 07 14:50:03.006458 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.006420    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a13874c0-1b46-4d63-a1b4-635987b2f1c5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a13874c0-1b46-4d63-a1b4-635987b2f1c5" (UID: "a13874c0-1b46-4d63-a1b4-635987b2f1c5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:50:03.008234 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.008208    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a13874c0-1b46-4d63-a1b4-635987b2f1c5-kube-api-access-98bh9" (OuterVolumeSpecName: "kube-api-access-98bh9") pod "a13874c0-1b46-4d63-a1b4-635987b2f1c5" (UID: "a13874c0-1b46-4d63-a1b4-635987b2f1c5"). InnerVolumeSpecName "kube-api-access-98bh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:50:03.008640 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.008620    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a13874c0-1b46-4d63-a1b4-635987b2f1c5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a13874c0-1b46-4d63-a1b4-635987b2f1c5" (UID: "a13874c0-1b46-4d63-a1b4-635987b2f1c5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:50:03.107436 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.107395    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a13874c0-1b46-4d63-a1b4-635987b2f1c5-maas-api-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:03.107436 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.107430    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98bh9\" (UniqueName: \"kubernetes.io/projected/a13874c0-1b46-4d63-a1b4-635987b2f1c5-kube-api-access-98bh9\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:03.107436 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.107440    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a13874c0-1b46-4d63-a1b4-635987b2f1c5-openshift-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:03.675687 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.675650    2567 generic.go:356] "Generic (PLEG): container finished" podID="a13874c0-1b46-4d63-a1b4-635987b2f1c5" containerID="a2e5cc072227b860a33a76cc7cc00a14ccf3c460dd8cf9cd92d2ed543a9622dc" exitCode=0
Jul 07 14:50:03.676131 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.675701    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"
Jul 07 14:50:03.676131 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.675739    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc" event={"ID":"a13874c0-1b46-4d63-a1b4-635987b2f1c5","Type":"ContainerDied","Data":"a2e5cc072227b860a33a76cc7cc00a14ccf3c460dd8cf9cd92d2ed543a9622dc"}
Jul 07 14:50:03.676131 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.675791    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc" event={"ID":"a13874c0-1b46-4d63-a1b4-635987b2f1c5","Type":"ContainerDied","Data":"2e19c2d305f911874aed1e45a58a15b630cdabb6f8c0b8e88e28d58781d1455d"}
Jul 07 14:50:03.676131 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.675819    2567 scope.go:117] "RemoveContainer" containerID="a2e5cc072227b860a33a76cc7cc00a14ccf3c460dd8cf9cd92d2ed543a9622dc"
Jul 07 14:50:03.684734 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.684708    2567 scope.go:117] "RemoveContainer" containerID="a2e5cc072227b860a33a76cc7cc00a14ccf3c460dd8cf9cd92d2ed543a9622dc"
Jul 07 14:50:03.685024 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:50:03.685000    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2e5cc072227b860a33a76cc7cc00a14ccf3c460dd8cf9cd92d2ed543a9622dc\": container with ID starting with a2e5cc072227b860a33a76cc7cc00a14ccf3c460dd8cf9cd92d2ed543a9622dc not found: ID does not exist" containerID="a2e5cc072227b860a33a76cc7cc00a14ccf3c460dd8cf9cd92d2ed543a9622dc"
Jul 07 14:50:03.685071 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.685035    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2e5cc072227b860a33a76cc7cc00a14ccf3c460dd8cf9cd92d2ed543a9622dc"} err="failed to get container status \"a2e5cc072227b860a33a76cc7cc00a14ccf3c460dd8cf9cd92d2ed543a9622dc\": rpc error: code = NotFound desc = could not find container \"a2e5cc072227b860a33a76cc7cc00a14ccf3c460dd8cf9cd92d2ed543a9622dc\": container with ID starting with a2e5cc072227b860a33a76cc7cc00a14ccf3c460dd8cf9cd92d2ed543a9622dc not found: ID does not exist"
Jul 07 14:50:03.701347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.701314    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"]
Jul 07 14:50:03.706951 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:03.706925    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-66ff89b8-589df996b7-l75fc"]
Jul 07 14:50:05.296436 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:05.296399    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a13874c0-1b46-4d63-a1b4-635987b2f1c5" path="/var/lib/kubelet/pods/a13874c0-1b46-4d63-a1b4-635987b2f1c5/volumes"
Jul 07 14:50:08.785199 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.785162    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"]
Jul 07 14:50:08.785833 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.785816    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a13874c0-1b46-4d63-a1b4-635987b2f1c5" containerName="maas-api"
Jul 07 14:50:08.785910 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.785836    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a13874c0-1b46-4d63-a1b4-635987b2f1c5" containerName="maas-api"
Jul 07 14:50:08.785946 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.785930    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a13874c0-1b46-4d63-a1b4-635987b2f1c5" containerName="maas-api"
Jul 07 14:50:08.790690 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.790663    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.793484 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.793460    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 14:50:08.793696 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.793536    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-35cb0e48-openshift-default-dockercfg-d66n6\""
Jul 07 14:50:08.804977 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.804944    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"]
Jul 07 14:50:08.858285 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.858240    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-podinfo\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.858474 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.858315    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-workload-socket\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.858474 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.858357    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-workload-certs\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.858474 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.858382    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-envoy\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.858474 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.858415    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-token\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.858474 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.858455    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-data\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.858474 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.858472    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-credential-socket\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.858737 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.858492    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be6003f1-dad8-4864-8ac5-ea129ad65459-istiod-ca-cert\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.858737 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.858510    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jss47\" (UniqueName: \"kubernetes.io/projected/be6003f1-dad8-4864-8ac5-ea129ad65459-kube-api-access-jss47\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.958954 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.958911    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-data\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.958954 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.958958    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-credential-socket\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.959216 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.958976    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be6003f1-dad8-4864-8ac5-ea129ad65459-istiod-ca-cert\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.959216 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.958999    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jss47\" (UniqueName: \"kubernetes.io/projected/be6003f1-dad8-4864-8ac5-ea129ad65459-kube-api-access-jss47\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.959216 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.959026    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-podinfo\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.959216 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.959068    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-workload-socket\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.959216 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.959115    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-workload-certs\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.959216 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.959153    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-envoy\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.959216 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.959185    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-token\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.959571 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.959518    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-workload-certs\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.959667 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.959562    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-workload-socket\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.959667 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.959643    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-data\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.959782 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.959756    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-credential-socket\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.959849 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.959830    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be6003f1-dad8-4864-8ac5-ea129ad65459-istiod-ca-cert\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.961644 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.961621    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-envoy\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.961783 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.961766    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-podinfo\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.970272 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.970249    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jss47\" (UniqueName: \"kubernetes.io/projected/be6003f1-dad8-4864-8ac5-ea129ad65459-kube-api-access-jss47\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:08.973651 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:08.973633    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-token\") pod \"e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") " pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:09.105314 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:09.105222    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:09.257929 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:09.257904    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"]
Jul 07 14:50:09.260488 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:50:09.260463    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe6003f1_dad8_4864_8ac5_ea129ad65459.slice/crio-9dbfd833cedf086cd173ab79374ba580ab555894ecaeb8be52e162604557ca6d WatchSource:0}: Error finding container 9dbfd833cedf086cd173ab79374ba580ab555894ecaeb8be52e162604557ca6d: Status 404 returned error can't find the container with id 9dbfd833cedf086cd173ab79374ba580ab555894ecaeb8be52e162604557ca6d
Jul 07 14:50:09.262421 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:09.262405    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:50:09.707350 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:09.707313    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2" event={"ID":"be6003f1-dad8-4864-8ac5-ea129ad65459","Type":"ContainerStarted","Data":"9dbfd833cedf086cd173ab79374ba580ab555894ecaeb8be52e162604557ca6d"}
Jul 07 14:50:10.077705 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:10.077584    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"]
Jul 07 14:50:10.083001 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:10.082959    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"
Jul 07 14:50:10.085710 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:10.085687    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-35cb0e48-serving-cert\""
Jul 07 14:50:10.085710 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:10.085703    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cx6pw\""
Jul 07 14:50:10.092609 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:10.092521    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"]
Jul 07 14:50:10.170525 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:10.170492    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwlwg\" (UniqueName: \"kubernetes.io/projected/4a81444e-b979-4695-8086-5163c4a359d6-kube-api-access-nwlwg\") pod \"maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6\" (UID: \"4a81444e-b979-4695-8086-5163c4a359d6\") " pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"
Jul 07 14:50:10.170742 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:10.170665    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a81444e-b979-4695-8086-5163c4a359d6-maas-api-tls\") pod \"maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6\" (UID: \"4a81444e-b979-4695-8086-5163c4a359d6\") " pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"
Jul 07 14:50:10.170742 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:10.170720    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a81444e-b979-4695-8086-5163c4a359d6-openshift-service-ca\") pod \"maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6\" (UID: \"4a81444e-b979-4695-8086-5163c4a359d6\") " pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"
Jul 07 14:50:10.271325 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:10.271285    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwlwg\" (UniqueName: \"kubernetes.io/projected/4a81444e-b979-4695-8086-5163c4a359d6-kube-api-access-nwlwg\") pod \"maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6\" (UID: \"4a81444e-b979-4695-8086-5163c4a359d6\") " pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"
Jul 07 14:50:10.271514 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:10.271398    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a81444e-b979-4695-8086-5163c4a359d6-maas-api-tls\") pod \"maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6\" (UID: \"4a81444e-b979-4695-8086-5163c4a359d6\") " pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"
Jul 07 14:50:10.271514 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:10.271429    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a81444e-b979-4695-8086-5163c4a359d6-openshift-service-ca\") pod \"maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6\" (UID: \"4a81444e-b979-4695-8086-5163c4a359d6\") " pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"
Jul 07 14:50:10.271656 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:50:10.271526    2567 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-35cb0e48-serving-cert: secret "maas-api-e2e-ait-35cb0e48-serving-cert" not found
Jul 07 14:50:10.271656 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:50:10.271615    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a81444e-b979-4695-8086-5163c4a359d6-maas-api-tls podName:4a81444e-b979-4695-8086-5163c4a359d6 nodeName:}" failed. No retries permitted until 2026-07-07 14:50:10.771570821 +0000 UTC m=+1565.977544928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4a81444e-b979-4695-8086-5163c4a359d6-maas-api-tls") pod "maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6" (UID: "4a81444e-b979-4695-8086-5163c4a359d6") : secret "maas-api-e2e-ait-35cb0e48-serving-cert" not found
Jul 07 14:50:10.272428 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:10.272405    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a81444e-b979-4695-8086-5163c4a359d6-openshift-service-ca\") pod \"maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6\" (UID: \"4a81444e-b979-4695-8086-5163c4a359d6\") " pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"
Jul 07 14:50:10.284430 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:10.284394    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwlwg\" (UniqueName: \"kubernetes.io/projected/4a81444e-b979-4695-8086-5163c4a359d6-kube-api-access-nwlwg\") pod \"maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6\" (UID: \"4a81444e-b979-4695-8086-5163c4a359d6\") " pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"
Jul 07 14:50:10.776834 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:10.776793    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a81444e-b979-4695-8086-5163c4a359d6-maas-api-tls\") pod \"maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6\" (UID: \"4a81444e-b979-4695-8086-5163c4a359d6\") " pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"
Jul 07 14:50:10.785276 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:10.785244    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a81444e-b979-4695-8086-5163c4a359d6-maas-api-tls\") pod \"maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6\" (UID: \"4a81444e-b979-4695-8086-5163c4a359d6\") " pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"
Jul 07 14:50:11.001011 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:11.000966    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"
Jul 07 14:50:11.156785 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:11.156754    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"]
Jul 07 14:50:11.158714 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:50:11.158682    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a81444e_b979_4695_8086_5163c4a359d6.slice/crio-066edc1eb450daee64c964c8fa0dfa3235ffdd3c2beab94dd860e7c35ac40cc5 WatchSource:0}: Error finding container 066edc1eb450daee64c964c8fa0dfa3235ffdd3c2beab94dd860e7c35ac40cc5: Status 404 returned error can't find the container with id 066edc1eb450daee64c964c8fa0dfa3235ffdd3c2beab94dd860e7c35ac40cc5
Jul 07 14:50:11.720316 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:11.720213    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6" event={"ID":"4a81444e-b979-4695-8086-5163c4a359d6","Type":"ContainerStarted","Data":"066edc1eb450daee64c964c8fa0dfa3235ffdd3c2beab94dd860e7c35ac40cc5"}
Jul 07 14:50:11.862986 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:11.862951    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:50:12.726212 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:12.726172    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6" event={"ID":"4a81444e-b979-4695-8086-5163c4a359d6","Type":"ContainerStarted","Data":"995d1e0f739e8067d514850f843df522c0d297a2c0a0938c270cc94461817af8"}
Jul 07 14:50:12.726636 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:12.726242    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"
Jul 07 14:50:12.738918 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:12.738890    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:50:12.738995 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:12.738956    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:50:12.738995 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:12.738984    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:50:12.748553 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:12.748510    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6" podStartSLOduration=2.264478795 podStartE2EDuration="2.748493946s" totalImagesPullingTime="484.015151ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:50:12.74675836 +0000 UTC m=+1567.952732491" watchObservedRunningTime="2026-07-07 14:50:12.748493946 +0000 UTC m=+1567.954468074"
Jul 07 14:50:13.732139 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:13.732105    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2" event={"ID":"be6003f1-dad8-4864-8ac5-ea129ad65459","Type":"ContainerStarted","Data":"37d875d20a9f39c90104156ace95b9f4e84fec6bfc1b0b8842564e9d266ea6fa"}
Jul 07 14:50:13.756118 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:13.756069    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2" podStartSLOduration=2.279960778 podStartE2EDuration="5.756052836s" totalImagesPullingTime="3.476092058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:50:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:50:13.754992148 +0000 UTC m=+1568.960966291" watchObservedRunningTime="2026-07-07 14:50:13.756052836 +0000 UTC m=+1568.962026943"
Jul 07 14:50:14.106139 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:14.106048    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:14.111515 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:14.111490    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:14.737281 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:14.737254    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:14.738121 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:14.738101    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:15.603784 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:15.603741    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"]
Jul 07 14:50:15.603958 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:15.603931    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6" podUID="4a81444e-b979-4695-8086-5163c4a359d6" containerName="maas-api" containerID="cri-o://995d1e0f739e8067d514850f843df522c0d297a2c0a0938c270cc94461817af8" gracePeriod=30
Jul 07 14:50:15.742800 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:15.742763    2567 generic.go:356] "Generic (PLEG): container finished" podID="4a81444e-b979-4695-8086-5163c4a359d6" containerID="995d1e0f739e8067d514850f843df522c0d297a2c0a0938c270cc94461817af8" exitCode=0
Jul 07 14:50:15.743146 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:15.742831    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6" event={"ID":"4a81444e-b979-4695-8086-5163c4a359d6","Type":"ContainerDied","Data":"995d1e0f739e8067d514850f843df522c0d297a2c0a0938c270cc94461817af8"}
Jul 07 14:50:15.853557 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:15.853531    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"
Jul 07 14:50:15.927978 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:15.927945    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a81444e-b979-4695-8086-5163c4a359d6-openshift-service-ca\") pod \"4a81444e-b979-4695-8086-5163c4a359d6\" (UID: \"4a81444e-b979-4695-8086-5163c4a359d6\") "
Jul 07 14:50:15.928146 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:15.928009    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a81444e-b979-4695-8086-5163c4a359d6-maas-api-tls\") pod \"4a81444e-b979-4695-8086-5163c4a359d6\" (UID: \"4a81444e-b979-4695-8086-5163c4a359d6\") "
Jul 07 14:50:15.928146 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:15.928052    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwlwg\" (UniqueName: \"kubernetes.io/projected/4a81444e-b979-4695-8086-5163c4a359d6-kube-api-access-nwlwg\") pod \"4a81444e-b979-4695-8086-5163c4a359d6\" (UID: \"4a81444e-b979-4695-8086-5163c4a359d6\") "
Jul 07 14:50:15.928373 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:15.928353    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a81444e-b979-4695-8086-5163c4a359d6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4a81444e-b979-4695-8086-5163c4a359d6" (UID: "4a81444e-b979-4695-8086-5163c4a359d6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:50:15.930213 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:15.930185    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a81444e-b979-4695-8086-5163c4a359d6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4a81444e-b979-4695-8086-5163c4a359d6" (UID: "4a81444e-b979-4695-8086-5163c4a359d6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:50:15.930332 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:15.930287    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a81444e-b979-4695-8086-5163c4a359d6-kube-api-access-nwlwg" (OuterVolumeSpecName: "kube-api-access-nwlwg") pod "4a81444e-b979-4695-8086-5163c4a359d6" (UID: "4a81444e-b979-4695-8086-5163c4a359d6"). InnerVolumeSpecName "kube-api-access-nwlwg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:50:16.028739 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:16.028709    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a81444e-b979-4695-8086-5163c4a359d6-openshift-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:16.028739 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:16.028736    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a81444e-b979-4695-8086-5163c4a359d6-maas-api-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:16.028739 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:16.028747    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwlwg\" (UniqueName: \"kubernetes.io/projected/4a81444e-b979-4695-8086-5163c4a359d6-kube-api-access-nwlwg\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:16.749131 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:16.749098    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"
Jul 07 14:50:16.749561 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:16.749134    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6" event={"ID":"4a81444e-b979-4695-8086-5163c4a359d6","Type":"ContainerDied","Data":"066edc1eb450daee64c964c8fa0dfa3235ffdd3c2beab94dd860e7c35ac40cc5"}
Jul 07 14:50:16.749561 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:16.749217    2567 scope.go:117] "RemoveContainer" containerID="995d1e0f739e8067d514850f843df522c0d297a2c0a0938c270cc94461817af8"
Jul 07 14:50:16.776144 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:16.776119    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"]
Jul 07 14:50:16.784552 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:16.784526    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-35cb0e48-79755fd578-tvfb6"]
Jul 07 14:50:17.296142 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:17.296108    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a81444e-b979-4695-8086-5163c4a359d6" path="/var/lib/kubelet/pods/4a81444e-b979-4695-8086-5163c4a359d6/volumes"
Jul 07 14:50:21.321291 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:21.321250    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"]
Jul 07 14:50:21.321811 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:21.321472    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2" podUID="be6003f1-dad8-4864-8ac5-ea129ad65459" containerName="istio-proxy" containerID="cri-o://37d875d20a9f39c90104156ace95b9f4e84fec6bfc1b0b8842564e9d266ea6fa" gracePeriod=30
Jul 07 14:50:26.583228 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.583162    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:26.714486 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.714454    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-workload-socket\") pod \"be6003f1-dad8-4864-8ac5-ea129ad65459\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") "
Jul 07 14:50:26.714700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.714509    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-workload-certs\") pod \"be6003f1-dad8-4864-8ac5-ea129ad65459\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") "
Jul 07 14:50:26.714700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.714529    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-data\") pod \"be6003f1-dad8-4864-8ac5-ea129ad65459\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") "
Jul 07 14:50:26.714700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.714550    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be6003f1-dad8-4864-8ac5-ea129ad65459-istiod-ca-cert\") pod \"be6003f1-dad8-4864-8ac5-ea129ad65459\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") "
Jul 07 14:50:26.714700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.714576    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-podinfo\") pod \"be6003f1-dad8-4864-8ac5-ea129ad65459\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") "
Jul 07 14:50:26.714700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.714626    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-token\") pod \"be6003f1-dad8-4864-8ac5-ea129ad65459\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") "
Jul 07 14:50:26.714700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.714670    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jss47\" (UniqueName: \"kubernetes.io/projected/be6003f1-dad8-4864-8ac5-ea129ad65459-kube-api-access-jss47\") pod \"be6003f1-dad8-4864-8ac5-ea129ad65459\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") "
Jul 07 14:50:26.714700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.714704    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-envoy\") pod \"be6003f1-dad8-4864-8ac5-ea129ad65459\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") "
Jul 07 14:50:26.715063 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.714735    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-credential-socket\") pod \"be6003f1-dad8-4864-8ac5-ea129ad65459\" (UID: \"be6003f1-dad8-4864-8ac5-ea129ad65459\") "
Jul 07 14:50:26.715063 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.714783    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "be6003f1-dad8-4864-8ac5-ea129ad65459" (UID: "be6003f1-dad8-4864-8ac5-ea129ad65459"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:50:26.715063 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.714867    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "be6003f1-dad8-4864-8ac5-ea129ad65459" (UID: "be6003f1-dad8-4864-8ac5-ea129ad65459"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:50:26.715063 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.714949    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-data" (OuterVolumeSpecName: "istio-data") pod "be6003f1-dad8-4864-8ac5-ea129ad65459" (UID: "be6003f1-dad8-4864-8ac5-ea129ad65459"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:50:26.715063 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.715056    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-workload-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:26.715323 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.715075    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-workload-certs\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:26.715323 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.715077    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "be6003f1-dad8-4864-8ac5-ea129ad65459" (UID: "be6003f1-dad8-4864-8ac5-ea129ad65459"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:50:26.715323 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.715090    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-data\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:26.715323 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.715099    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be6003f1-dad8-4864-8ac5-ea129ad65459-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "be6003f1-dad8-4864-8ac5-ea129ad65459" (UID: "be6003f1-dad8-4864-8ac5-ea129ad65459"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:50:26.717051 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.717014    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "be6003f1-dad8-4864-8ac5-ea129ad65459" (UID: "be6003f1-dad8-4864-8ac5-ea129ad65459"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:50:26.717051 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.717030    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be6003f1-dad8-4864-8ac5-ea129ad65459-kube-api-access-jss47" (OuterVolumeSpecName: "kube-api-access-jss47") pod "be6003f1-dad8-4864-8ac5-ea129ad65459" (UID: "be6003f1-dad8-4864-8ac5-ea129ad65459"). InnerVolumeSpecName "kube-api-access-jss47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:50:26.717200 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.717049    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-token" (OuterVolumeSpecName: "istio-token") pod "be6003f1-dad8-4864-8ac5-ea129ad65459" (UID: "be6003f1-dad8-4864-8ac5-ea129ad65459"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:50:26.717200 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.717069    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "be6003f1-dad8-4864-8ac5-ea129ad65459" (UID: "be6003f1-dad8-4864-8ac5-ea129ad65459"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:50:26.800268 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.800225    2567 generic.go:356] "Generic (PLEG): container finished" podID="be6003f1-dad8-4864-8ac5-ea129ad65459" containerID="37d875d20a9f39c90104156ace95b9f4e84fec6bfc1b0b8842564e9d266ea6fa" exitCode=0
Jul 07 14:50:26.800462 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.800289    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"
Jul 07 14:50:26.800462 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.800314    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2" event={"ID":"be6003f1-dad8-4864-8ac5-ea129ad65459","Type":"ContainerDied","Data":"37d875d20a9f39c90104156ace95b9f4e84fec6bfc1b0b8842564e9d266ea6fa"}
Jul 07 14:50:26.800462 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.800370    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2" event={"ID":"be6003f1-dad8-4864-8ac5-ea129ad65459","Type":"ContainerDied","Data":"9dbfd833cedf086cd173ab79374ba580ab555894ecaeb8be52e162604557ca6d"}
Jul 07 14:50:26.800462 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.800393    2567 scope.go:117] "RemoveContainer" containerID="37d875d20a9f39c90104156ace95b9f4e84fec6bfc1b0b8842564e9d266ea6fa"
Jul 07 14:50:26.810181 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.810163    2567 scope.go:117] "RemoveContainer" containerID="37d875d20a9f39c90104156ace95b9f4e84fec6bfc1b0b8842564e9d266ea6fa"
Jul 07 14:50:26.810446 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:50:26.810428    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37d875d20a9f39c90104156ace95b9f4e84fec6bfc1b0b8842564e9d266ea6fa\": container with ID starting with 37d875d20a9f39c90104156ace95b9f4e84fec6bfc1b0b8842564e9d266ea6fa not found: ID does not exist" containerID="37d875d20a9f39c90104156ace95b9f4e84fec6bfc1b0b8842564e9d266ea6fa"
Jul 07 14:50:26.810501 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.810453    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37d875d20a9f39c90104156ace95b9f4e84fec6bfc1b0b8842564e9d266ea6fa"} err="failed to get container status \"37d875d20a9f39c90104156ace95b9f4e84fec6bfc1b0b8842564e9d266ea6fa\": rpc error: code = NotFound desc = could not find container \"37d875d20a9f39c90104156ace95b9f4e84fec6bfc1b0b8842564e9d266ea6fa\": container with ID starting with 37d875d20a9f39c90104156ace95b9f4e84fec6bfc1b0b8842564e9d266ea6fa not found: ID does not exist"
Jul 07 14:50:26.815886 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.815849    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be6003f1-dad8-4864-8ac5-ea129ad65459-istiod-ca-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:26.815886 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.815885    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-podinfo\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:26.816021 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.815901    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-token\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:26.816021 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.815914    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jss47\" (UniqueName: \"kubernetes.io/projected/be6003f1-dad8-4864-8ac5-ea129ad65459-kube-api-access-jss47\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:26.816021 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.815929    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-istio-envoy\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:26.816021 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.815941    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be6003f1-dad8-4864-8ac5-ea129ad65459-credential-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:26.831759 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.831740    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"]
Jul 07 14:50:26.834845 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:26.834796    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-35cb0e48-openshift-default-64475f47ff-p9ks2"]
Jul 07 14:50:27.296875 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:27.296832    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be6003f1-dad8-4864-8ac5-ea129ad65459" path="/var/lib/kubelet/pods/be6003f1-dad8-4864-8ac5-ea129ad65459/volumes"
Jul 07 14:50:30.357338 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.357303    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"]
Jul 07 14:50:30.357892 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.357871    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be6003f1-dad8-4864-8ac5-ea129ad65459" containerName="istio-proxy"
Jul 07 14:50:30.357969 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.357894    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="be6003f1-dad8-4864-8ac5-ea129ad65459" containerName="istio-proxy"
Jul 07 14:50:30.357969 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.357911    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a81444e-b979-4695-8086-5163c4a359d6" containerName="maas-api"
Jul 07 14:50:30.357969 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.357919    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a81444e-b979-4695-8086-5163c4a359d6" containerName="maas-api"
Jul 07 14:50:30.358118 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.358021    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="be6003f1-dad8-4864-8ac5-ea129ad65459" containerName="istio-proxy"
Jul 07 14:50:30.358118 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.358036    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a81444e-b979-4695-8086-5163c4a359d6" containerName="maas-api"
Jul 07 14:50:30.366255 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.366231    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"
Jul 07 14:50:30.370236 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.370211    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-a7cc6597-serving-cert\""
Jul 07 14:50:30.373499 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.373477    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cx6pw\""
Jul 07 14:50:30.382186 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.382162    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"]
Jul 07 14:50:30.447010 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.446965    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89eb89f0-999e-410c-9af5-2ec60c90243a-maas-api-tls\") pod \"maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc\" (UID: \"89eb89f0-999e-410c-9af5-2ec60c90243a\") " pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"
Jul 07 14:50:30.447233 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.447048    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89eb89f0-999e-410c-9af5-2ec60c90243a-openshift-service-ca\") pod \"maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc\" (UID: \"89eb89f0-999e-410c-9af5-2ec60c90243a\") " pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"
Jul 07 14:50:30.447233 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.447124    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcgcd\" (UniqueName: \"kubernetes.io/projected/89eb89f0-999e-410c-9af5-2ec60c90243a-kube-api-access-rcgcd\") pod \"maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc\" (UID: \"89eb89f0-999e-410c-9af5-2ec60c90243a\") " pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"
Jul 07 14:50:30.548198 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.548169    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89eb89f0-999e-410c-9af5-2ec60c90243a-maas-api-tls\") pod \"maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc\" (UID: \"89eb89f0-999e-410c-9af5-2ec60c90243a\") " pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"
Jul 07 14:50:30.548354 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.548221    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89eb89f0-999e-410c-9af5-2ec60c90243a-openshift-service-ca\") pod \"maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc\" (UID: \"89eb89f0-999e-410c-9af5-2ec60c90243a\") " pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"
Jul 07 14:50:30.548354 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.548262    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcgcd\" (UniqueName: \"kubernetes.io/projected/89eb89f0-999e-410c-9af5-2ec60c90243a-kube-api-access-rcgcd\") pod \"maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc\" (UID: \"89eb89f0-999e-410c-9af5-2ec60c90243a\") " pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"
Jul 07 14:50:30.548908 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.548890    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89eb89f0-999e-410c-9af5-2ec60c90243a-openshift-service-ca\") pod \"maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc\" (UID: \"89eb89f0-999e-410c-9af5-2ec60c90243a\") " pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"
Jul 07 14:50:30.550803 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.550783    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89eb89f0-999e-410c-9af5-2ec60c90243a-maas-api-tls\") pod \"maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc\" (UID: \"89eb89f0-999e-410c-9af5-2ec60c90243a\") " pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"
Jul 07 14:50:30.560852 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.560829    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcgcd\" (UniqueName: \"kubernetes.io/projected/89eb89f0-999e-410c-9af5-2ec60c90243a-kube-api-access-rcgcd\") pod \"maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc\" (UID: \"89eb89f0-999e-410c-9af5-2ec60c90243a\") " pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"
Jul 07 14:50:30.676509 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.676473    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"
Jul 07 14:50:30.826657 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:30.826626    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"]
Jul 07 14:50:30.827295 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:50:30.827268    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89eb89f0_999e_410c_9af5_2ec60c90243a.slice/crio-5d9c6e9ac6e381ff1e00fb404842450f30ca2c43c4b71b3ca95331770f070e9f WatchSource:0}: Error finding container 5d9c6e9ac6e381ff1e00fb404842450f30ca2c43c4b71b3ca95331770f070e9f: Status 404 returned error can't find the container with id 5d9c6e9ac6e381ff1e00fb404842450f30ca2c43c4b71b3ca95331770f070e9f
Jul 07 14:50:31.828174 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:31.828136    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc" event={"ID":"89eb89f0-999e-410c-9af5-2ec60c90243a","Type":"ContainerStarted","Data":"41047b0c8b85b3ed0aac7ed8e2861a748d610319d5fa74e0a66d58c867691337"}
Jul 07 14:50:31.828614 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:31.828199    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc" event={"ID":"89eb89f0-999e-410c-9af5-2ec60c90243a","Type":"ContainerStarted","Data":"5d9c6e9ac6e381ff1e00fb404842450f30ca2c43c4b71b3ca95331770f070e9f"}
Jul 07 14:50:31.828614 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:31.828287    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"
Jul 07 14:50:31.854521 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:31.854475    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc" podStartSLOduration=1.4677298890000001 podStartE2EDuration="1.854456867s" totalImagesPullingTime="386.726978ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:50:31.853406743 +0000 UTC m=+1587.059380872" watchObservedRunningTime="2026-07-07 14:50:31.854456867 +0000 UTC m=+1587.060430995"
Jul 07 14:50:32.779642 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:32.779546    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:50:35.299627 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.299579    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"]
Jul 07 14:50:35.300048 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.299855    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc" podUID="89eb89f0-999e-410c-9af5-2ec60c90243a" containerName="maas-api" containerID="cri-o://41047b0c8b85b3ed0aac7ed8e2861a748d610319d5fa74e0a66d58c867691337" gracePeriod=30
Jul 07 14:50:35.559932 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.559867    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"
Jul 07 14:50:35.696847 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.696788    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcgcd\" (UniqueName: \"kubernetes.io/projected/89eb89f0-999e-410c-9af5-2ec60c90243a-kube-api-access-rcgcd\") pod \"89eb89f0-999e-410c-9af5-2ec60c90243a\" (UID: \"89eb89f0-999e-410c-9af5-2ec60c90243a\") "
Jul 07 14:50:35.697078 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.696879    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89eb89f0-999e-410c-9af5-2ec60c90243a-maas-api-tls\") pod \"89eb89f0-999e-410c-9af5-2ec60c90243a\" (UID: \"89eb89f0-999e-410c-9af5-2ec60c90243a\") "
Jul 07 14:50:35.697078 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.696927    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89eb89f0-999e-410c-9af5-2ec60c90243a-openshift-service-ca\") pod \"89eb89f0-999e-410c-9af5-2ec60c90243a\" (UID: \"89eb89f0-999e-410c-9af5-2ec60c90243a\") "
Jul 07 14:50:35.697577 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.697532    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89eb89f0-999e-410c-9af5-2ec60c90243a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "89eb89f0-999e-410c-9af5-2ec60c90243a" (UID: "89eb89f0-999e-410c-9af5-2ec60c90243a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:50:35.699643 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.699584    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89eb89f0-999e-410c-9af5-2ec60c90243a-kube-api-access-rcgcd" (OuterVolumeSpecName: "kube-api-access-rcgcd") pod "89eb89f0-999e-410c-9af5-2ec60c90243a" (UID: "89eb89f0-999e-410c-9af5-2ec60c90243a"). InnerVolumeSpecName "kube-api-access-rcgcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:50:35.699814 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.699785    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89eb89f0-999e-410c-9af5-2ec60c90243a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "89eb89f0-999e-410c-9af5-2ec60c90243a" (UID: "89eb89f0-999e-410c-9af5-2ec60c90243a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:50:35.798409 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.798368    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89eb89f0-999e-410c-9af5-2ec60c90243a-openshift-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:35.798409 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.798398    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcgcd\" (UniqueName: \"kubernetes.io/projected/89eb89f0-999e-410c-9af5-2ec60c90243a-kube-api-access-rcgcd\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:35.798409 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.798408    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89eb89f0-999e-410c-9af5-2ec60c90243a-maas-api-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:50:35.850207 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.850110    2567 generic.go:356] "Generic (PLEG): container finished" podID="89eb89f0-999e-410c-9af5-2ec60c90243a" containerID="41047b0c8b85b3ed0aac7ed8e2861a748d610319d5fa74e0a66d58c867691337" exitCode=0
Jul 07 14:50:35.850207 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.850151    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc" event={"ID":"89eb89f0-999e-410c-9af5-2ec60c90243a","Type":"ContainerDied","Data":"41047b0c8b85b3ed0aac7ed8e2861a748d610319d5fa74e0a66d58c867691337"}
Jul 07 14:50:35.850207 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.850158    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"
Jul 07 14:50:35.850207 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.850191    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc" event={"ID":"89eb89f0-999e-410c-9af5-2ec60c90243a","Type":"ContainerDied","Data":"5d9c6e9ac6e381ff1e00fb404842450f30ca2c43c4b71b3ca95331770f070e9f"}
Jul 07 14:50:35.850512 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.850212    2567 scope.go:117] "RemoveContainer" containerID="41047b0c8b85b3ed0aac7ed8e2861a748d610319d5fa74e0a66d58c867691337"
Jul 07 14:50:35.860344 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.860317    2567 scope.go:117] "RemoveContainer" containerID="41047b0c8b85b3ed0aac7ed8e2861a748d610319d5fa74e0a66d58c867691337"
Jul 07 14:50:35.860669 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:50:35.860645    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41047b0c8b85b3ed0aac7ed8e2861a748d610319d5fa74e0a66d58c867691337\": container with ID starting with 41047b0c8b85b3ed0aac7ed8e2861a748d610319d5fa74e0a66d58c867691337 not found: ID does not exist" containerID="41047b0c8b85b3ed0aac7ed8e2861a748d610319d5fa74e0a66d58c867691337"
Jul 07 14:50:35.860740 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.860683    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41047b0c8b85b3ed0aac7ed8e2861a748d610319d5fa74e0a66d58c867691337"} err="failed to get container status \"41047b0c8b85b3ed0aac7ed8e2861a748d610319d5fa74e0a66d58c867691337\": rpc error: code = NotFound desc = could not find container \"41047b0c8b85b3ed0aac7ed8e2861a748d610319d5fa74e0a66d58c867691337\": container with ID starting with 41047b0c8b85b3ed0aac7ed8e2861a748d610319d5fa74e0a66d58c867691337 not found: ID does not exist"
Jul 07 14:50:35.876579 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.876550    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"]
Jul 07 14:50:35.882960 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:35.882936    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-a7cc6597-6b74789cbb-w5klc"]
Jul 07 14:50:37.297654 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:37.297613    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89eb89f0-999e-410c-9af5-2ec60c90243a" path="/var/lib/kubelet/pods/89eb89f0-999e-410c-9af5-2ec60c90243a/volumes"
Jul 07 14:50:41.483271 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:50:41.483236    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:52:09.666361 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:09.666324    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:52:16.682115 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:16.682082    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:52:24.474279 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:24.474235    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:52:25.041833 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.041799    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"]
Jul 07 14:52:25.042202 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.042187    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89eb89f0-999e-410c-9af5-2ec60c90243a" containerName="maas-api"
Jul 07 14:52:25.042249 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.042204    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="89eb89f0-999e-410c-9af5-2ec60c90243a" containerName="maas-api"
Jul 07 14:52:25.042283 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.042272    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="89eb89f0-999e-410c-9af5-2ec60c90243a" containerName="maas-api"
Jul 07 14:52:25.045614 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.045556    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.048348 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.048326    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-75cc9fc0-openshift-default-dockercfg-lw9vg\""
Jul 07 14:52:25.048457 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.048395    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 14:52:25.107496 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.107454    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"]
Jul 07 14:52:25.156952 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.156913    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-envoy\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.156952 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.156953    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5c7w\" (UniqueName: \"kubernetes.io/projected/9ad84297-4e0f-42c4-be86-725fa54e9c2f-kube-api-access-v5c7w\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.157168 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.156980    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-token\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.157168 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.157001    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istiod-ca-cert\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.157168 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.157048    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-workload-certs\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.157168 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.157071    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-credential-socket\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.157168 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.157091    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-workload-socket\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.157168 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.157125    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-podinfo\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.157168 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.157142    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-data\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.258380 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.258346    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-podinfo\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.258380 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.258385    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-data\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.258643 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.258515    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-envoy\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.258643 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.258558    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5c7w\" (UniqueName: \"kubernetes.io/projected/9ad84297-4e0f-42c4-be86-725fa54e9c2f-kube-api-access-v5c7w\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.258643 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.258583    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-token\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.258787 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.258745    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istiod-ca-cert\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.258834 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.258789    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-workload-certs\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.258834 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.258806    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-data\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.258834 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.258829    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-credential-socket\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.259011 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.258861    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-workload-socket\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.259099 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.259063    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-workload-certs\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.259224 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.259195    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-workload-socket\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.259339 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.259233    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-credential-socket\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.259670 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.259643    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istiod-ca-cert\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.260856 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.260833    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-envoy\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.261278 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.261261    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-podinfo\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.269216 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.269196    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-token\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.269339 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.269303    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5c7w\" (UniqueName: \"kubernetes.io/projected/9ad84297-4e0f-42c4-be86-725fa54e9c2f-kube-api-access-v5c7w\") pod \"e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") " pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.356628 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.356509    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:25.523478 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.523428    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"]
Jul 07 14:52:25.527403 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:52:25.527374    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad84297_4e0f_42c4_be86_725fa54e9c2f.slice/crio-8a6ff95d3207d87c31e4a86d35a4c0af0facb4faba754ca1ff3a16aa695922e0 WatchSource:0}: Error finding container 8a6ff95d3207d87c31e4a86d35a4c0af0facb4faba754ca1ff3a16aa695922e0: Status 404 returned error can't find the container with id 8a6ff95d3207d87c31e4a86d35a4c0af0facb4faba754ca1ff3a16aa695922e0
Jul 07 14:52:25.530158 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.530125    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:52:25.530233 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.530202    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:52:25.530273 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:25.530231    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:52:26.393312 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:26.393274    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv" event={"ID":"9ad84297-4e0f-42c4-be86-725fa54e9c2f","Type":"ContainerStarted","Data":"fea47a83135a3f72f1c95c5b2b02b1219b453166a3a2e721b6c248604fb457de"}
Jul 07 14:52:26.393502 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:26.393336    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv" event={"ID":"9ad84297-4e0f-42c4-be86-725fa54e9c2f","Type":"ContainerStarted","Data":"8a6ff95d3207d87c31e4a86d35a4c0af0facb4faba754ca1ff3a16aa695922e0"}
Jul 07 14:52:26.422709 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:26.422659    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv" podStartSLOduration=1.4226443579999999 podStartE2EDuration="1.422644358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:52:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:52:26.42191787 +0000 UTC m=+1701.627892012" watchObservedRunningTime="2026-07-07 14:52:26.422644358 +0000 UTC m=+1701.628618487"
Jul 07 14:52:27.357313 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:27.357278    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:27.362113 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:27.362089    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:27.398384 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:27.398356    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:27.399327 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:27.399306    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:28.525728 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:28.525691    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"]
Jul 07 14:52:28.529376 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:28.529358    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"
Jul 07 14:52:28.531913 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:28.531887    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-75cc9fc0-serving-cert\""
Jul 07 14:52:28.532058 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:28.532039    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cx6pw\""
Jul 07 14:52:28.543184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:28.543159    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"]
Jul 07 14:52:28.590899 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:28.590868    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9580504-78e1-46ed-b27a-7624d20e9739-maas-api-tls\") pod \"maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9\" (UID: \"e9580504-78e1-46ed-b27a-7624d20e9739\") " pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"
Jul 07 14:52:28.591059 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:28.590952    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fmfr\" (UniqueName: \"kubernetes.io/projected/e9580504-78e1-46ed-b27a-7624d20e9739-kube-api-access-6fmfr\") pod \"maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9\" (UID: \"e9580504-78e1-46ed-b27a-7624d20e9739\") " pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"
Jul 07 14:52:28.591059 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:28.590986    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9580504-78e1-46ed-b27a-7624d20e9739-openshift-service-ca\") pod \"maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9\" (UID: \"e9580504-78e1-46ed-b27a-7624d20e9739\") " pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"
Jul 07 14:52:28.691664 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:28.691628    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fmfr\" (UniqueName: \"kubernetes.io/projected/e9580504-78e1-46ed-b27a-7624d20e9739-kube-api-access-6fmfr\") pod \"maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9\" (UID: \"e9580504-78e1-46ed-b27a-7624d20e9739\") " pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"
Jul 07 14:52:28.691876 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:28.691691    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9580504-78e1-46ed-b27a-7624d20e9739-openshift-service-ca\") pod \"maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9\" (UID: \"e9580504-78e1-46ed-b27a-7624d20e9739\") " pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"
Jul 07 14:52:28.691876 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:28.691782    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9580504-78e1-46ed-b27a-7624d20e9739-maas-api-tls\") pod \"maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9\" (UID: \"e9580504-78e1-46ed-b27a-7624d20e9739\") " pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"
Jul 07 14:52:28.691965 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:52:28.691935    2567 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-75cc9fc0-serving-cert: secret "maas-api-e2e-mt-75cc9fc0-serving-cert" not found
Jul 07 14:52:28.692022 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:52:28.692010    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9580504-78e1-46ed-b27a-7624d20e9739-maas-api-tls podName:e9580504-78e1-46ed-b27a-7624d20e9739 nodeName:}" failed. No retries permitted until 2026-07-07 14:52:29.191989375 +0000 UTC m=+1704.397963485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e9580504-78e1-46ed-b27a-7624d20e9739-maas-api-tls") pod "maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9" (UID: "e9580504-78e1-46ed-b27a-7624d20e9739") : secret "maas-api-e2e-mt-75cc9fc0-serving-cert" not found
Jul 07 14:52:28.692342 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:28.692323    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9580504-78e1-46ed-b27a-7624d20e9739-openshift-service-ca\") pod \"maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9\" (UID: \"e9580504-78e1-46ed-b27a-7624d20e9739\") " pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"
Jul 07 14:52:28.706067 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:28.706037    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fmfr\" (UniqueName: \"kubernetes.io/projected/e9580504-78e1-46ed-b27a-7624d20e9739-kube-api-access-6fmfr\") pod \"maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9\" (UID: \"e9580504-78e1-46ed-b27a-7624d20e9739\") " pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"
Jul 07 14:52:29.197845 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:29.197801    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9580504-78e1-46ed-b27a-7624d20e9739-maas-api-tls\") pod \"maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9\" (UID: \"e9580504-78e1-46ed-b27a-7624d20e9739\") " pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"
Jul 07 14:52:29.200344 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:29.200317    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9580504-78e1-46ed-b27a-7624d20e9739-maas-api-tls\") pod \"maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9\" (UID: \"e9580504-78e1-46ed-b27a-7624d20e9739\") " pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"
Jul 07 14:52:29.440095 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:29.440049    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"
Jul 07 14:52:29.600758 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:29.600718    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"]
Jul 07 14:52:29.604183 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:52:29.604149    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9580504_78e1_46ed_b27a_7624d20e9739.slice/crio-86c101a93af3d9f7f5bda489732006a97c155afd66d4e30b09ff604445b9f9bf WatchSource:0}: Error finding container 86c101a93af3d9f7f5bda489732006a97c155afd66d4e30b09ff604445b9f9bf: Status 404 returned error can't find the container with id 86c101a93af3d9f7f5bda489732006a97c155afd66d4e30b09ff604445b9f9bf
Jul 07 14:52:30.415667 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:30.415625    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9" event={"ID":"e9580504-78e1-46ed-b27a-7624d20e9739","Type":"ContainerStarted","Data":"f8122c3c71a0601cedd966fd6d124ef7d4be439ea9d1659fd035f955ab0e7cc7"}
Jul 07 14:52:30.415868 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:30.415686    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9" event={"ID":"e9580504-78e1-46ed-b27a-7624d20e9739","Type":"ContainerStarted","Data":"86c101a93af3d9f7f5bda489732006a97c155afd66d4e30b09ff604445b9f9bf"}
Jul 07 14:52:30.415868 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:30.415786    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"
Jul 07 14:52:30.443539 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:30.443493    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9" podStartSLOduration=1.957831398 podStartE2EDuration="2.443477006s" totalImagesPullingTime="485.645608ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:52:30.442296399 +0000 UTC m=+1705.648270527" watchObservedRunningTime="2026-07-07 14:52:30.443477006 +0000 UTC m=+1705.649451134"
Jul 07 14:52:35.257972 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:35.257932    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:52:36.429826 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:36.429785    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"
Jul 07 14:52:41.375424 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:41.375391    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"]
Jul 07 14:52:41.375963 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:41.375646    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9" podUID="e9580504-78e1-46ed-b27a-7624d20e9739" containerName="maas-api" containerID="cri-o://f8122c3c71a0601cedd966fd6d124ef7d4be439ea9d1659fd035f955ab0e7cc7" gracePeriod=30
Jul 07 14:52:41.422124 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:41.422083    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9" podUID="e9580504-78e1-46ed-b27a-7624d20e9739" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.48:8443/health\": dial tcp 10.132.0.48:8443: connect: connection refused"
Jul 07 14:52:41.629854 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:41.629790    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"
Jul 07 14:52:41.709293 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:41.709245    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9580504-78e1-46ed-b27a-7624d20e9739-maas-api-tls\") pod \"e9580504-78e1-46ed-b27a-7624d20e9739\" (UID: \"e9580504-78e1-46ed-b27a-7624d20e9739\") "
Jul 07 14:52:41.709498 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:41.709322    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fmfr\" (UniqueName: \"kubernetes.io/projected/e9580504-78e1-46ed-b27a-7624d20e9739-kube-api-access-6fmfr\") pod \"e9580504-78e1-46ed-b27a-7624d20e9739\" (UID: \"e9580504-78e1-46ed-b27a-7624d20e9739\") "
Jul 07 14:52:41.709498 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:41.709390    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9580504-78e1-46ed-b27a-7624d20e9739-openshift-service-ca\") pod \"e9580504-78e1-46ed-b27a-7624d20e9739\" (UID: \"e9580504-78e1-46ed-b27a-7624d20e9739\") "
Jul 07 14:52:41.709893 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:41.709864    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9580504-78e1-46ed-b27a-7624d20e9739-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e9580504-78e1-46ed-b27a-7624d20e9739" (UID: "e9580504-78e1-46ed-b27a-7624d20e9739"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:52:41.711732 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:41.711703    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9580504-78e1-46ed-b27a-7624d20e9739-kube-api-access-6fmfr" (OuterVolumeSpecName: "kube-api-access-6fmfr") pod "e9580504-78e1-46ed-b27a-7624d20e9739" (UID: "e9580504-78e1-46ed-b27a-7624d20e9739"). InnerVolumeSpecName "kube-api-access-6fmfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:52:41.711850 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:41.711806    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9580504-78e1-46ed-b27a-7624d20e9739-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e9580504-78e1-46ed-b27a-7624d20e9739" (UID: "e9580504-78e1-46ed-b27a-7624d20e9739"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:52:41.810276 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:41.810241    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9580504-78e1-46ed-b27a-7624d20e9739-maas-api-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:52:41.810276 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:41.810271    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fmfr\" (UniqueName: \"kubernetes.io/projected/e9580504-78e1-46ed-b27a-7624d20e9739-kube-api-access-6fmfr\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:52:41.810276 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:41.810281    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9580504-78e1-46ed-b27a-7624d20e9739-openshift-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:52:42.480132 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:42.480095    2567 generic.go:356] "Generic (PLEG): container finished" podID="e9580504-78e1-46ed-b27a-7624d20e9739" containerID="f8122c3c71a0601cedd966fd6d124ef7d4be439ea9d1659fd035f955ab0e7cc7" exitCode=0
Jul 07 14:52:42.480132 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:42.480136    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"
Jul 07 14:52:42.480687 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:42.480165    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9" event={"ID":"e9580504-78e1-46ed-b27a-7624d20e9739","Type":"ContainerDied","Data":"f8122c3c71a0601cedd966fd6d124ef7d4be439ea9d1659fd035f955ab0e7cc7"}
Jul 07 14:52:42.480687 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:42.480209    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9" event={"ID":"e9580504-78e1-46ed-b27a-7624d20e9739","Type":"ContainerDied","Data":"86c101a93af3d9f7f5bda489732006a97c155afd66d4e30b09ff604445b9f9bf"}
Jul 07 14:52:42.480687 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:42.480236    2567 scope.go:117] "RemoveContainer" containerID="f8122c3c71a0601cedd966fd6d124ef7d4be439ea9d1659fd035f955ab0e7cc7"
Jul 07 14:52:42.497676 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:42.497644    2567 scope.go:117] "RemoveContainer" containerID="f8122c3c71a0601cedd966fd6d124ef7d4be439ea9d1659fd035f955ab0e7cc7"
Jul 07 14:52:42.498027 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:52:42.498005    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8122c3c71a0601cedd966fd6d124ef7d4be439ea9d1659fd035f955ab0e7cc7\": container with ID starting with f8122c3c71a0601cedd966fd6d124ef7d4be439ea9d1659fd035f955ab0e7cc7 not found: ID does not exist" containerID="f8122c3c71a0601cedd966fd6d124ef7d4be439ea9d1659fd035f955ab0e7cc7"
Jul 07 14:52:42.498113 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:42.498041    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8122c3c71a0601cedd966fd6d124ef7d4be439ea9d1659fd035f955ab0e7cc7"} err="failed to get container status \"f8122c3c71a0601cedd966fd6d124ef7d4be439ea9d1659fd035f955ab0e7cc7\": rpc error: code = NotFound desc = could not find container \"f8122c3c71a0601cedd966fd6d124ef7d4be439ea9d1659fd035f955ab0e7cc7\": container with ID starting with f8122c3c71a0601cedd966fd6d124ef7d4be439ea9d1659fd035f955ab0e7cc7 not found: ID does not exist"
Jul 07 14:52:42.510761 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:42.510732    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"]
Jul 07 14:52:42.514347 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:42.514324    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-75cc9fc0-8c78b4bc5-wmlb9"]
Jul 07 14:52:42.822077 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:42.821492    2567 patch_prober.go:28] interesting pod/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:49038->10.132.0.47:15021: read: connection reset by peer" start-of-body=
Jul 07 14:52:42.822077 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:42.821559    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv" podUID="9ad84297-4e0f-42c4-be86-725fa54e9c2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:49038->10.132.0.47:15021: read: connection reset by peer"
Jul 07 14:52:43.297270 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:43.297230    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9580504-78e1-46ed-b27a-7624d20e9739" path="/var/lib/kubelet/pods/e9580504-78e1-46ed-b27a-7624d20e9739/volumes"
Jul 07 14:52:43.486146 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:43.486113    2567 generic.go:356] "Generic (PLEG): container finished" podID="9ad84297-4e0f-42c4-be86-725fa54e9c2f" containerID="fea47a83135a3f72f1c95c5b2b02b1219b453166a3a2e721b6c248604fb457de" exitCode=0
Jul 07 14:52:43.486570 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:43.486184    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv" event={"ID":"9ad84297-4e0f-42c4-be86-725fa54e9c2f","Type":"ContainerDied","Data":"fea47a83135a3f72f1c95c5b2b02b1219b453166a3a2e721b6c248604fb457de"}
Jul 07 14:52:43.486689 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:43.486630    2567 scope.go:117] "RemoveContainer" containerID="fea47a83135a3f72f1c95c5b2b02b1219b453166a3a2e721b6c248604fb457de"
Jul 07 14:52:43.487650 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:43.487627    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:52:43.487719 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:43.487686    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:52:43.487768 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:43.487718    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:52:44.493393 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:44.493352    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv" event={"ID":"9ad84297-4e0f-42c4-be86-725fa54e9c2f","Type":"ContainerStarted","Data":"4f22646ef842583d03e9feca6229ad4619a15be18ef92658b0fd3e65aa2e1310"}
Jul 07 14:52:45.274955 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:45.274914    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:52:45.357017 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:45.356987    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:45.357193 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:45.357168    2567 patch_prober.go:28] interesting pod/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 07 14:52:45.357252 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:45.357221    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv" podUID="9ad84297-4e0f-42c4-be86-725fa54e9c2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 07 14:52:46.357000 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:46.356963    2567 patch_prober.go:28] interesting pod/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 07 14:52:46.357401 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:46.357024    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv" podUID="9ad84297-4e0f-42c4-be86-725fa54e9c2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 07 14:52:47.357156 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:47.357114    2567 patch_prober.go:28] interesting pod/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 07 14:52:47.357549 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:47.357183    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv" podUID="9ad84297-4e0f-42c4-be86-725fa54e9c2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 07 14:52:48.046515 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:48.046477    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"]
Jul 07 14:52:48.046827 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:48.046745    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv" podUID="9ad84297-4e0f-42c4-be86-725fa54e9c2f" containerName="istio-proxy" containerID="cri-o://4f22646ef842583d03e9feca6229ad4619a15be18ef92658b0fd3e65aa2e1310" gracePeriod=30
Jul 07 14:52:53.548097 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.548060    2567 generic.go:356] "Generic (PLEG): container finished" podID="9ad84297-4e0f-42c4-be86-725fa54e9c2f" containerID="4f22646ef842583d03e9feca6229ad4619a15be18ef92658b0fd3e65aa2e1310" exitCode=0
Jul 07 14:52:53.548559 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.548140    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv" event={"ID":"9ad84297-4e0f-42c4-be86-725fa54e9c2f","Type":"ContainerDied","Data":"4f22646ef842583d03e9feca6229ad4619a15be18ef92658b0fd3e65aa2e1310"}
Jul 07 14:52:53.548559 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.548205    2567 scope.go:117] "RemoveContainer" containerID="fea47a83135a3f72f1c95c5b2b02b1219b453166a3a2e721b6c248604fb457de"
Jul 07 14:52:53.608036 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.608009    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:53.720737 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.720701    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-workload-certs\") pod \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") "
Jul 07 14:52:53.720737 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.720738    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-workload-socket\") pod \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") "
Jul 07 14:52:53.721141 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.720786    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-envoy\") pod \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") "
Jul 07 14:52:53.721141 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.720810    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5c7w\" (UniqueName: \"kubernetes.io/projected/9ad84297-4e0f-42c4-be86-725fa54e9c2f-kube-api-access-v5c7w\") pod \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") "
Jul 07 14:52:53.721141 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.720902    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istiod-ca-cert\") pod \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") "
Jul 07 14:52:53.721141 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.720957    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-credential-socket\") pod \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") "
Jul 07 14:52:53.721141 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.721032    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ad84297-4e0f-42c4-be86-725fa54e9c2f" (UID: "9ad84297-4e0f-42c4-be86-725fa54e9c2f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:52:53.721141 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.721127    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ad84297-4e0f-42c4-be86-725fa54e9c2f" (UID: "9ad84297-4e0f-42c4-be86-725fa54e9c2f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:52:53.721766 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.721062    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-podinfo\") pod \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") "
Jul 07 14:52:53.721766 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.721282    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-token\") pod \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") "
Jul 07 14:52:53.721766 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.721338    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-data\") pod \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\" (UID: \"9ad84297-4e0f-42c4-be86-725fa54e9c2f\") "
Jul 07 14:52:53.721766 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.721350    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ad84297-4e0f-42c4-be86-725fa54e9c2f" (UID: "9ad84297-4e0f-42c4-be86-725fa54e9c2f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:52:53.721766 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.721473    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ad84297-4e0f-42c4-be86-725fa54e9c2f" (UID: "9ad84297-4e0f-42c4-be86-725fa54e9c2f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:52:53.722103 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.721772    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istiod-ca-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:52:53.722103 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.721812    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-credential-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:52:53.722103 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.721899    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-workload-certs\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:52:53.722931 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.722205    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-workload-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:52:53.723794 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.723670    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ad84297-4e0f-42c4-be86-725fa54e9c2f" (UID: "9ad84297-4e0f-42c4-be86-725fa54e9c2f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:52:53.724199 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.724100    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ad84297-4e0f-42c4-be86-725fa54e9c2f-kube-api-access-v5c7w" (OuterVolumeSpecName: "kube-api-access-v5c7w") pod "9ad84297-4e0f-42c4-be86-725fa54e9c2f" (UID: "9ad84297-4e0f-42c4-be86-725fa54e9c2f"). InnerVolumeSpecName "kube-api-access-v5c7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:52:53.724199 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.724176    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ad84297-4e0f-42c4-be86-725fa54e9c2f" (UID: "9ad84297-4e0f-42c4-be86-725fa54e9c2f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:52:53.724346 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.724321    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ad84297-4e0f-42c4-be86-725fa54e9c2f" (UID: "9ad84297-4e0f-42c4-be86-725fa54e9c2f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:52:53.724583 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.724555    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ad84297-4e0f-42c4-be86-725fa54e9c2f" (UID: "9ad84297-4e0f-42c4-be86-725fa54e9c2f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:52:53.823709 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.823678    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-podinfo\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:52:53.823709 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.823706    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-token\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:52:53.823709 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.823714    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-data\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:52:53.823969 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.823722    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ad84297-4e0f-42c4-be86-725fa54e9c2f-istio-envoy\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:52:53.823969 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:53.823730    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5c7w\" (UniqueName: \"kubernetes.io/projected/9ad84297-4e0f-42c4-be86-725fa54e9c2f-kube-api-access-v5c7w\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:52:54.554248 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:54.554216    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"
Jul 07 14:52:54.554248 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:54.554241    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv" event={"ID":"9ad84297-4e0f-42c4-be86-725fa54e9c2f","Type":"ContainerDied","Data":"8a6ff95d3207d87c31e4a86d35a4c0af0facb4faba754ca1ff3a16aa695922e0"}
Jul 07 14:52:54.554821 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:54.554301    2567 scope.go:117] "RemoveContainer" containerID="4f22646ef842583d03e9feca6229ad4619a15be18ef92658b0fd3e65aa2e1310"
Jul 07 14:52:54.577340 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:54.577317    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"]
Jul 07 14:52:54.584825 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:54.584793    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-75cc9fc0-openshift-default-596f49974c-8kjwv"]
Jul 07 14:52:55.298152 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:52:55.298108    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ad84297-4e0f-42c4-be86-725fa54e9c2f" path="/var/lib/kubelet/pods/9ad84297-4e0f-42c4-be86-725fa54e9c2f/volumes"
Jul 07 14:53:09.422939 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.422904    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"]
Jul 07 14:53:09.423443 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.423263    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9580504-78e1-46ed-b27a-7624d20e9739" containerName="maas-api"
Jul 07 14:53:09.423443 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.423274    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9580504-78e1-46ed-b27a-7624d20e9739" containerName="maas-api"
Jul 07 14:53:09.423443 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.423291    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ad84297-4e0f-42c4-be86-725fa54e9c2f" containerName="istio-proxy"
Jul 07 14:53:09.423443 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.423297    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ad84297-4e0f-42c4-be86-725fa54e9c2f" containerName="istio-proxy"
Jul 07 14:53:09.423443 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.423304    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ad84297-4e0f-42c4-be86-725fa54e9c2f" containerName="istio-proxy"
Jul 07 14:53:09.423443 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.423310    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ad84297-4e0f-42c4-be86-725fa54e9c2f" containerName="istio-proxy"
Jul 07 14:53:09.423443 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.423365    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9580504-78e1-46ed-b27a-7624d20e9739" containerName="maas-api"
Jul 07 14:53:09.423443 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.423373    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ad84297-4e0f-42c4-be86-725fa54e9c2f" containerName="istio-proxy"
Jul 07 14:53:09.423443 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.423380    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ad84297-4e0f-42c4-be86-725fa54e9c2f" containerName="istio-proxy"
Jul 07 14:53:09.426502 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.426484    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.429757 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.429735    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-54eeed17-openshift-default-dockercfg-w4w6d\""
Jul 07 14:53:09.430661 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.430645    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 14:53:09.460761 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.460730    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"]
Jul 07 14:53:09.557697 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.557654    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-credential-socket\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.557888 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.557807    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-workload-socket\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.557888 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.557851    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-workload-certs\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.557988 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.557896    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-podinfo\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.557988 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.557966    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-envoy\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.558062 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.558025    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5lhq\" (UniqueName: \"kubernetes.io/projected/a772e8a9-8e00-48ff-bccd-e50362c960ce-kube-api-access-g5lhq\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.558101 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.558063    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-token\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.558101 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.558082    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a772e8a9-8e00-48ff-bccd-e50362c960ce-istiod-ca-cert\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.558179 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.558100    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-data\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.659090 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.659057    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-data\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.659090 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.659104    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-credential-socket\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.659367 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.659148    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-workload-socket\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.659367 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.659166    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-workload-certs\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.659367 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.659181    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-podinfo\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.659367 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.659209    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-envoy\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.659367 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.659236    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5lhq\" (UniqueName: \"kubernetes.io/projected/a772e8a9-8e00-48ff-bccd-e50362c960ce-kube-api-access-g5lhq\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.659367 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.659270    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-token\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.659680 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.659483    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a772e8a9-8e00-48ff-bccd-e50362c960ce-istiod-ca-cert\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.659680 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.659517    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-data\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.659680 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.659570    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-workload-socket\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.659680 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.659670    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-credential-socket\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.659980 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.659957    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-workload-certs\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.660186 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.660167    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a772e8a9-8e00-48ff-bccd-e50362c960ce-istiod-ca-cert\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.661917 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.661893    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-envoy\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.662198 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.662176    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-podinfo\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.671663 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.671642    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-token\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.672157 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.672136    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5lhq\" (UniqueName: \"kubernetes.io/projected/a772e8a9-8e00-48ff-bccd-e50362c960ce-kube-api-access-g5lhq\") pod \"e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") " pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.737719 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.737619    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:09.889874 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.889849    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"]
Jul 07 14:53:09.892206 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:53:09.892185    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda772e8a9_8e00_48ff_bccd_e50362c960ce.slice/crio-6bdfcb9cc470da18a356eeb0125774e0270d19e55ca90a2e864cb551d9fbb985 WatchSource:0}: Error finding container 6bdfcb9cc470da18a356eeb0125774e0270d19e55ca90a2e864cb551d9fbb985: Status 404 returned error can't find the container with id 6bdfcb9cc470da18a356eeb0125774e0270d19e55ca90a2e864cb551d9fbb985
Jul 07 14:53:09.894374 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.894340    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:53:09.894448 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.894415    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:53:09.894448 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:09.894444    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:53:10.632428 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:10.632385    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7" event={"ID":"a772e8a9-8e00-48ff-bccd-e50362c960ce","Type":"ContainerStarted","Data":"e53e5982b8b20ac827fd27acf817fda67292be0c93133702b788062d67df8e06"}
Jul 07 14:53:10.632428 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:10.632436    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7" event={"ID":"a772e8a9-8e00-48ff-bccd-e50362c960ce","Type":"ContainerStarted","Data":"6bdfcb9cc470da18a356eeb0125774e0270d19e55ca90a2e864cb551d9fbb985"}
Jul 07 14:53:10.659416 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:10.659369    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7" podStartSLOduration=1.659354595 podStartE2EDuration="1.659354595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:53:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:53:10.656678747 +0000 UTC m=+1745.862652875" watchObservedRunningTime="2026-07-07 14:53:10.659354595 +0000 UTC m=+1745.865328724"
Jul 07 14:53:10.738395 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:10.738361    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:10.743853 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:10.743827    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:11.637039 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:11.637010    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:11.638188 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:11.638169    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:12.793947 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:12.793915    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"]
Jul 07 14:53:12.798293 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:12.798266    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"
Jul 07 14:53:12.802090 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:12.802066    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-54eeed17-serving-cert\""
Jul 07 14:53:12.802237 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:12.802215    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cx6pw\""
Jul 07 14:53:12.811369 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:12.811345    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"]
Jul 07 14:53:12.989939 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:12.989901    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-openshift-service-ca\") pod \"maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs\" (UID: \"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3\") " pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"
Jul 07 14:53:12.989939 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:12.989945    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vmfs\" (UniqueName: \"kubernetes.io/projected/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-kube-api-access-5vmfs\") pod \"maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs\" (UID: \"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3\") " pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"
Jul 07 14:53:12.990203 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:12.989967    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-maas-api-tls\") pod \"maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs\" (UID: \"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3\") " pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"
Jul 07 14:53:13.091060 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:13.090964    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-openshift-service-ca\") pod \"maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs\" (UID: \"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3\") " pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"
Jul 07 14:53:13.091060 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:13.091007    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vmfs\" (UniqueName: \"kubernetes.io/projected/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-kube-api-access-5vmfs\") pod \"maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs\" (UID: \"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3\") " pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"
Jul 07 14:53:13.091060 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:13.091030    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-maas-api-tls\") pod \"maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs\" (UID: \"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3\") " pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"
Jul 07 14:53:13.091351 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:53:13.091156    2567 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-54eeed17-serving-cert: secret "maas-api-e2e-mt-54eeed17-serving-cert" not found
Jul 07 14:53:13.091351 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:53:13.091220    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-maas-api-tls podName:5cbc4aad-a4a7-425f-999a-da6e5dffd1b3 nodeName:}" failed. No retries permitted until 2026-07-07 14:53:13.591201627 +0000 UTC m=+1748.797175751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-maas-api-tls") pod "maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs" (UID: "5cbc4aad-a4a7-425f-999a-da6e5dffd1b3") : secret "maas-api-e2e-mt-54eeed17-serving-cert" not found
Jul 07 14:53:13.091655 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:13.091636    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-openshift-service-ca\") pod \"maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs\" (UID: \"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3\") " pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"
Jul 07 14:53:13.105479 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:13.105455    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vmfs\" (UniqueName: \"kubernetes.io/projected/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-kube-api-access-5vmfs\") pod \"maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs\" (UID: \"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3\") " pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"
Jul 07 14:53:13.593651 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:13.593616    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-maas-api-tls\") pod \"maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs\" (UID: \"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3\") " pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"
Jul 07 14:53:13.596078 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:13.596060    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-maas-api-tls\") pod \"maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs\" (UID: \"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3\") " pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"
Jul 07 14:53:13.712391 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:13.712362    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"
Jul 07 14:53:13.856833 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:13.856805    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"]
Jul 07 14:53:13.858552 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:53:13.858523    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cbc4aad_a4a7_425f_999a_da6e5dffd1b3.slice/crio-0e6cfa79d836da0ffaa63b541b4a62803738235793a473ab3f0a45d5f935f652 WatchSource:0}: Error finding container 0e6cfa79d836da0ffaa63b541b4a62803738235793a473ab3f0a45d5f935f652: Status 404 returned error can't find the container with id 0e6cfa79d836da0ffaa63b541b4a62803738235793a473ab3f0a45d5f935f652
Jul 07 14:53:14.652281 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:14.652245    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs" event={"ID":"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3","Type":"ContainerStarted","Data":"e4d03962fe6d8f10a7cdffabfc403d4f0bd31ff7912ad454f942d5c834a37114"}
Jul 07 14:53:14.652438 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:14.652310    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs" event={"ID":"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3","Type":"ContainerStarted","Data":"0e6cfa79d836da0ffaa63b541b4a62803738235793a473ab3f0a45d5f935f652"}
Jul 07 14:53:14.652438 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:14.652367    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"
Jul 07 14:53:14.673233 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:14.673183    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs" podStartSLOduration=2.173636417 podStartE2EDuration="2.673168336s" totalImagesPullingTime="499.531919ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:53:14.672201036 +0000 UTC m=+1749.878175167" watchObservedRunningTime="2026-07-07 14:53:14.673168336 +0000 UTC m=+1749.879142464"
Jul 07 14:53:19.164915 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:19.164869    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:53:20.664433 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:20.664405    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"
Jul 07 14:53:27.183650 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:27.182769    2567 patch_prober.go:28] interesting pod/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": read tcp 10.132.0.2:46254->10.132.0.49:15021: read: connection reset by peer" start-of-body=
Jul 07 14:53:27.183650 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:27.182829    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7" podUID="a772e8a9-8e00-48ff-bccd-e50362c960ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": read tcp 10.132.0.2:46254->10.132.0.49:15021: read: connection reset by peer"
Jul 07 14:53:27.723323 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:27.723290    2567 generic.go:356] "Generic (PLEG): container finished" podID="a772e8a9-8e00-48ff-bccd-e50362c960ce" containerID="e53e5982b8b20ac827fd27acf817fda67292be0c93133702b788062d67df8e06" exitCode=0
Jul 07 14:53:27.723496 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:27.723365    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7" event={"ID":"a772e8a9-8e00-48ff-bccd-e50362c960ce","Type":"ContainerDied","Data":"e53e5982b8b20ac827fd27acf817fda67292be0c93133702b788062d67df8e06"}
Jul 07 14:53:27.723803 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:27.723786    2567 scope.go:117] "RemoveContainer" containerID="e53e5982b8b20ac827fd27acf817fda67292be0c93133702b788062d67df8e06"
Jul 07 14:53:27.724755 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:27.724728    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:53:27.724818 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:27.724804    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:53:27.724854 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:27.724836    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:53:28.730198 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:28.730164    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7" event={"ID":"a772e8a9-8e00-48ff-bccd-e50362c960ce","Type":"ContainerStarted","Data":"7eb9babbe4e8e4b8cde4991ed4a30166d41610441dc27b4a71c005157f8ef05c"}
Jul 07 14:53:28.738191 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:28.738166    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:28.738335 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:28.738313    2567 patch_prober.go:28] interesting pod/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 07 14:53:28.738384 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:28.738370    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7" podUID="a772e8a9-8e00-48ff-bccd-e50362c960ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 07 14:53:29.738897 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:29.738864    2567 patch_prober.go:28] interesting pod/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 07 14:53:29.739291 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:29.738913    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7" podUID="a772e8a9-8e00-48ff-bccd-e50362c960ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 07 14:53:30.744170 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:30.744109    2567 patch_prober.go:28] interesting pod/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 07 14:53:30.744608 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:30.744475    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7" podUID="a772e8a9-8e00-48ff-bccd-e50362c960ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 07 14:53:31.738034 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:31.737991    2567 patch_prober.go:28] interesting pod/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 07 14:53:31.738221 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:31.738056    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7" podUID="a772e8a9-8e00-48ff-bccd-e50362c960ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 07 14:53:32.738883 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:32.738845    2567 patch_prober.go:28] interesting pod/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 07 14:53:32.739272 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:32.738915    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7" podUID="a772e8a9-8e00-48ff-bccd-e50362c960ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 07 14:53:33.741637 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:33.741605    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:33.742117 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:33.742011    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:33.742641 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:33.742623    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:53:37.381454 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:53:37.381415    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:54:03.067984 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:03.067900    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:54:05.385869 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:05.385833    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:54:05.390381 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:05.390353    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:54:05.970874 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:05.970842    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"]
Jul 07 14:54:05.971106 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:05.971058    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs" podUID="5cbc4aad-a4a7-425f-999a-da6e5dffd1b3" containerName="maas-api" containerID="cri-o://e4d03962fe6d8f10a7cdffabfc403d4f0bd31ff7912ad454f942d5c834a37114" gracePeriod=30
Jul 07 14:54:06.234466 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.234398    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"
Jul 07 14:54:06.257868 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.257835    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vmfs\" (UniqueName: \"kubernetes.io/projected/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-kube-api-access-5vmfs\") pod \"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3\" (UID: \"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3\") "
Jul 07 14:54:06.258038 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.257923    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-maas-api-tls\") pod \"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3\" (UID: \"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3\") "
Jul 07 14:54:06.258038 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.257957    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-openshift-service-ca\") pod \"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3\" (UID: \"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3\") "
Jul 07 14:54:06.258377 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.258337    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5cbc4aad-a4a7-425f-999a-da6e5dffd1b3" (UID: "5cbc4aad-a4a7-425f-999a-da6e5dffd1b3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:54:06.260261 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.260230    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-kube-api-access-5vmfs" (OuterVolumeSpecName: "kube-api-access-5vmfs") pod "5cbc4aad-a4a7-425f-999a-da6e5dffd1b3" (UID: "5cbc4aad-a4a7-425f-999a-da6e5dffd1b3"). InnerVolumeSpecName "kube-api-access-5vmfs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:54:06.260377 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.260328    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5cbc4aad-a4a7-425f-999a-da6e5dffd1b3" (UID: "5cbc4aad-a4a7-425f-999a-da6e5dffd1b3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:54:06.358940 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.358907    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vmfs\" (UniqueName: \"kubernetes.io/projected/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-kube-api-access-5vmfs\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:54:06.358940 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.358935    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-maas-api-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:54:06.358940 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.358945    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3-openshift-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:54:06.923667 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.923634    2567 generic.go:356] "Generic (PLEG): container finished" podID="5cbc4aad-a4a7-425f-999a-da6e5dffd1b3" containerID="e4d03962fe6d8f10a7cdffabfc403d4f0bd31ff7912ad454f942d5c834a37114" exitCode=0
Jul 07 14:54:06.924088 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.923685    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"
Jul 07 14:54:06.924088 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.923728    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs" event={"ID":"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3","Type":"ContainerDied","Data":"e4d03962fe6d8f10a7cdffabfc403d4f0bd31ff7912ad454f942d5c834a37114"}
Jul 07 14:54:06.924088 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.923789    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs" event={"ID":"5cbc4aad-a4a7-425f-999a-da6e5dffd1b3","Type":"ContainerDied","Data":"0e6cfa79d836da0ffaa63b541b4a62803738235793a473ab3f0a45d5f935f652"}
Jul 07 14:54:06.924088 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.923814    2567 scope.go:117] "RemoveContainer" containerID="e4d03962fe6d8f10a7cdffabfc403d4f0bd31ff7912ad454f942d5c834a37114"
Jul 07 14:54:06.933360 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.933343    2567 scope.go:117] "RemoveContainer" containerID="e4d03962fe6d8f10a7cdffabfc403d4f0bd31ff7912ad454f942d5c834a37114"
Jul 07 14:54:06.933680 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:54:06.933648    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4d03962fe6d8f10a7cdffabfc403d4f0bd31ff7912ad454f942d5c834a37114\": container with ID starting with e4d03962fe6d8f10a7cdffabfc403d4f0bd31ff7912ad454f942d5c834a37114 not found: ID does not exist" containerID="e4d03962fe6d8f10a7cdffabfc403d4f0bd31ff7912ad454f942d5c834a37114"
Jul 07 14:54:06.933740 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.933692    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4d03962fe6d8f10a7cdffabfc403d4f0bd31ff7912ad454f942d5c834a37114"} err="failed to get container status \"e4d03962fe6d8f10a7cdffabfc403d4f0bd31ff7912ad454f942d5c834a37114\": rpc error: code = NotFound desc = could not find container \"e4d03962fe6d8f10a7cdffabfc403d4f0bd31ff7912ad454f942d5c834a37114\": container with ID starting with e4d03962fe6d8f10a7cdffabfc403d4f0bd31ff7912ad454f942d5c834a37114 not found: ID does not exist"
Jul 07 14:54:06.948577 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.948549    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"]
Jul 07 14:54:06.956328 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:06.956306    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-54eeed17-595bb96f75-rrpgs"]
Jul 07 14:54:07.296419 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:07.296337    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cbc4aad-a4a7-425f-999a-da6e5dffd1b3" path="/var/lib/kubelet/pods/5cbc4aad-a4a7-425f-999a-da6e5dffd1b3/volumes"
Jul 07 14:54:17.072603 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:17.072560    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:54:56.563406 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:54:56.563371    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:55:01.309959 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:01.309908    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"]
Jul 07 14:55:01.310404 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:01.310133    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7" podUID="a772e8a9-8e00-48ff-bccd-e50362c960ce" containerName="istio-proxy" containerID="cri-o://7eb9babbe4e8e4b8cde4991ed4a30166d41610441dc27b4a71c005157f8ef05c" gracePeriod=30
Jul 07 14:55:03.744884 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:03.744851    2567 patch_prober.go:28] interesting pod/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 14:55:03.745308 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:03.744908    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7" podUID="a772e8a9-8e00-48ff-bccd-e50362c960ce" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 14:55:06.014177 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.014137    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:55:06.581864 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.581795    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:55:06.687169 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.687121    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-credential-socket\") pod \"a772e8a9-8e00-48ff-bccd-e50362c960ce\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") "
Jul 07 14:55:06.687169 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.687188    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a772e8a9-8e00-48ff-bccd-e50362c960ce-istiod-ca-cert\") pod \"a772e8a9-8e00-48ff-bccd-e50362c960ce\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") "
Jul 07 14:55:06.687446 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.687212    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-podinfo\") pod \"a772e8a9-8e00-48ff-bccd-e50362c960ce\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") "
Jul 07 14:55:06.687446 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.687239    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-data\") pod \"a772e8a9-8e00-48ff-bccd-e50362c960ce\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") "
Jul 07 14:55:06.687446 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.687282    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-workload-socket\") pod \"a772e8a9-8e00-48ff-bccd-e50362c960ce\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") "
Jul 07 14:55:06.687446 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.687330    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-envoy\") pod \"a772e8a9-8e00-48ff-bccd-e50362c960ce\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") "
Jul 07 14:55:06.687446 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.687361    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5lhq\" (UniqueName: \"kubernetes.io/projected/a772e8a9-8e00-48ff-bccd-e50362c960ce-kube-api-access-g5lhq\") pod \"a772e8a9-8e00-48ff-bccd-e50362c960ce\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") "
Jul 07 14:55:06.687446 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.687392    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-workload-certs\") pod \"a772e8a9-8e00-48ff-bccd-e50362c960ce\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") "
Jul 07 14:55:06.687446 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.687427    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-token\") pod \"a772e8a9-8e00-48ff-bccd-e50362c960ce\" (UID: \"a772e8a9-8e00-48ff-bccd-e50362c960ce\") "
Jul 07 14:55:06.687823 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.687491    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a772e8a9-8e00-48ff-bccd-e50362c960ce" (UID: "a772e8a9-8e00-48ff-bccd-e50362c960ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:55:06.687823 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.687699    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a772e8a9-8e00-48ff-bccd-e50362c960ce" (UID: "a772e8a9-8e00-48ff-bccd-e50362c960ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:55:06.687823 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.687720    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a772e8a9-8e00-48ff-bccd-e50362c960ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a772e8a9-8e00-48ff-bccd-e50362c960ce" (UID: "a772e8a9-8e00-48ff-bccd-e50362c960ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:55:06.687823 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.687747    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-credential-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:55:06.688028 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.687916    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a772e8a9-8e00-48ff-bccd-e50362c960ce" (UID: "a772e8a9-8e00-48ff-bccd-e50362c960ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:55:06.688507 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.688425    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "a772e8a9-8e00-48ff-bccd-e50362c960ce" (UID: "a772e8a9-8e00-48ff-bccd-e50362c960ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:55:06.689833 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.689804    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "a772e8a9-8e00-48ff-bccd-e50362c960ce" (UID: "a772e8a9-8e00-48ff-bccd-e50362c960ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:55:06.689935 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.689864    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a772e8a9-8e00-48ff-bccd-e50362c960ce" (UID: "a772e8a9-8e00-48ff-bccd-e50362c960ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:55:06.689935 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.689883    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a772e8a9-8e00-48ff-bccd-e50362c960ce-kube-api-access-g5lhq" (OuterVolumeSpecName: "kube-api-access-g5lhq") pod "a772e8a9-8e00-48ff-bccd-e50362c960ce" (UID: "a772e8a9-8e00-48ff-bccd-e50362c960ce"). InnerVolumeSpecName "kube-api-access-g5lhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:55:06.689935 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.689891    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a772e8a9-8e00-48ff-bccd-e50362c960ce" (UID: "a772e8a9-8e00-48ff-bccd-e50362c960ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:55:06.788938 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.788901    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-token\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:55:06.788938 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.788931    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a772e8a9-8e00-48ff-bccd-e50362c960ce-istiod-ca-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:55:06.788938 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.788940    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-podinfo\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:55:06.788938 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.788947    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-data\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:55:06.789214 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.788955    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-workload-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:55:06.789214 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.788963    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-istio-envoy\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:55:06.789214 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.788971    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5lhq\" (UniqueName: \"kubernetes.io/projected/a772e8a9-8e00-48ff-bccd-e50362c960ce-kube-api-access-g5lhq\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:55:06.789214 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:06.788980    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a772e8a9-8e00-48ff-bccd-e50362c960ce-workload-certs\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:55:07.216771 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:07.216730    2567 generic.go:356] "Generic (PLEG): container finished" podID="a772e8a9-8e00-48ff-bccd-e50362c960ce" containerID="7eb9babbe4e8e4b8cde4991ed4a30166d41610441dc27b4a71c005157f8ef05c" exitCode=0
Jul 07 14:55:07.217269 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:07.216784    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"
Jul 07 14:55:07.217269 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:07.216822    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7" event={"ID":"a772e8a9-8e00-48ff-bccd-e50362c960ce","Type":"ContainerDied","Data":"7eb9babbe4e8e4b8cde4991ed4a30166d41610441dc27b4a71c005157f8ef05c"}
Jul 07 14:55:07.217269 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:07.216892    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7" event={"ID":"a772e8a9-8e00-48ff-bccd-e50362c960ce","Type":"ContainerDied","Data":"6bdfcb9cc470da18a356eeb0125774e0270d19e55ca90a2e864cb551d9fbb985"}
Jul 07 14:55:07.217269 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:07.216930    2567 scope.go:117] "RemoveContainer" containerID="7eb9babbe4e8e4b8cde4991ed4a30166d41610441dc27b4a71c005157f8ef05c"
Jul 07 14:55:07.227204 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:07.227182    2567 scope.go:117] "RemoveContainer" containerID="e53e5982b8b20ac827fd27acf817fda67292be0c93133702b788062d67df8e06"
Jul 07 14:55:07.235684 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:07.235662    2567 scope.go:117] "RemoveContainer" containerID="7eb9babbe4e8e4b8cde4991ed4a30166d41610441dc27b4a71c005157f8ef05c"
Jul 07 14:55:07.235981 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:55:07.235961    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eb9babbe4e8e4b8cde4991ed4a30166d41610441dc27b4a71c005157f8ef05c\": container with ID starting with 7eb9babbe4e8e4b8cde4991ed4a30166d41610441dc27b4a71c005157f8ef05c not found: ID does not exist" containerID="7eb9babbe4e8e4b8cde4991ed4a30166d41610441dc27b4a71c005157f8ef05c"
Jul 07 14:55:07.236034 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:07.235990    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eb9babbe4e8e4b8cde4991ed4a30166d41610441dc27b4a71c005157f8ef05c"} err="failed to get container status \"7eb9babbe4e8e4b8cde4991ed4a30166d41610441dc27b4a71c005157f8ef05c\": rpc error: code = NotFound desc = could not find container \"7eb9babbe4e8e4b8cde4991ed4a30166d41610441dc27b4a71c005157f8ef05c\": container with ID starting with 7eb9babbe4e8e4b8cde4991ed4a30166d41610441dc27b4a71c005157f8ef05c not found: ID does not exist"
Jul 07 14:55:07.236034 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:07.236010    2567 scope.go:117] "RemoveContainer" containerID="e53e5982b8b20ac827fd27acf817fda67292be0c93133702b788062d67df8e06"
Jul 07 14:55:07.236254 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:55:07.236239    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e53e5982b8b20ac827fd27acf817fda67292be0c93133702b788062d67df8e06\": container with ID starting with e53e5982b8b20ac827fd27acf817fda67292be0c93133702b788062d67df8e06 not found: ID does not exist" containerID="e53e5982b8b20ac827fd27acf817fda67292be0c93133702b788062d67df8e06"
Jul 07 14:55:07.236299 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:07.236259    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e53e5982b8b20ac827fd27acf817fda67292be0c93133702b788062d67df8e06"} err="failed to get container status \"e53e5982b8b20ac827fd27acf817fda67292be0c93133702b788062d67df8e06\": rpc error: code = NotFound desc = could not find container \"e53e5982b8b20ac827fd27acf817fda67292be0c93133702b788062d67df8e06\": container with ID starting with e53e5982b8b20ac827fd27acf817fda67292be0c93133702b788062d67df8e06 not found: ID does not exist"
Jul 07 14:55:07.266801 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:07.266771    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"]
Jul 07 14:55:07.272491 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:07.272464    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-54eeed17-openshift-default-596949f8b7-tddh7"]
Jul 07 14:55:07.296326 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:07.296296    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a772e8a9-8e00-48ff-bccd-e50362c960ce" path="/var/lib/kubelet/pods/a772e8a9-8e00-48ff-bccd-e50362c960ce/volumes"
Jul 07 14:55:20.080839 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:20.080801    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:55:58.482553 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.482520    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"]
Jul 07 14:55:58.483127 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.483106    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a772e8a9-8e00-48ff-bccd-e50362c960ce" containerName="istio-proxy"
Jul 07 14:55:58.483211 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.483131    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a772e8a9-8e00-48ff-bccd-e50362c960ce" containerName="istio-proxy"
Jul 07 14:55:58.483211 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.483155    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a772e8a9-8e00-48ff-bccd-e50362c960ce" containerName="istio-proxy"
Jul 07 14:55:58.483211 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.483165    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a772e8a9-8e00-48ff-bccd-e50362c960ce" containerName="istio-proxy"
Jul 07 14:55:58.483211 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.483178    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cbc4aad-a4a7-425f-999a-da6e5dffd1b3" containerName="maas-api"
Jul 07 14:55:58.483211 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.483187    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cbc4aad-a4a7-425f-999a-da6e5dffd1b3" containerName="maas-api"
Jul 07 14:55:58.483446 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.483292    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cbc4aad-a4a7-425f-999a-da6e5dffd1b3" containerName="maas-api"
Jul 07 14:55:58.483446 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.483303    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a772e8a9-8e00-48ff-bccd-e50362c960ce" containerName="istio-proxy"
Jul 07 14:55:58.483446 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.483314    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a772e8a9-8e00-48ff-bccd-e50362c960ce" containerName="istio-proxy"
Jul 07 14:55:58.486421 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.486401    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.489701 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.489681    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c289a3-openshift-default-dockercfg-g8hww\""
Jul 07 14:55:58.489799 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.489707    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 14:55:58.504417 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.504395    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"]
Jul 07 14:55:58.527486 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.527456    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-podinfo\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.527629 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.527501    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-workload-certs\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.527629 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.527521    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw8wh\" (UniqueName: \"kubernetes.io/projected/01c53e95-9c7c-4641-9220-d1b9e0172220-kube-api-access-vw8wh\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.527716 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.527636    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-workload-socket\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.527716 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.527673    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-envoy\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.527716 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.527702    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-data\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.527812 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.527756    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-credential-socket\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.527812 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.527782    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01c53e95-9c7c-4641-9220-d1b9e0172220-istiod-ca-cert\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.527879 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.527814    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-token\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.628165 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.628134    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-envoy\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.628165 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.628167    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-data\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.628400 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.628200    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-credential-socket\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.628400 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.628217    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01c53e95-9c7c-4641-9220-d1b9e0172220-istiod-ca-cert\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.628400 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.628237    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-token\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.628400 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.628260    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-podinfo\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.628639 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.628429    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-workload-certs\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.628639 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.628467    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw8wh\" (UniqueName: \"kubernetes.io/projected/01c53e95-9c7c-4641-9220-d1b9e0172220-kube-api-access-vw8wh\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.628639 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.628532    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-workload-socket\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.628828 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.628711    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-data\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.628828 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.628778    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-credential-socket\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.629071 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.628959    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-workload-socket\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.629071 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.629016    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-workload-certs\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.629071 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.629030    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01c53e95-9c7c-4641-9220-d1b9e0172220-istiod-ca-cert\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.630624 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.630580    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-envoy\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.630957 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.630938    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-podinfo\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.638035 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.638019    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-token\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.638543 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.638521    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw8wh\" (UniqueName: \"kubernetes.io/projected/01c53e95-9c7c-4641-9220-d1b9e0172220-kube-api-access-vw8wh\") pod \"e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") " pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.798527 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.798442    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:55:58.947905 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.947881    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"]
Jul 07 14:55:58.950232 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:55:58.950200    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01c53e95_9c7c_4641_9220_d1b9e0172220.slice/crio-ba7a0b4b048ef817cef6980577f93063c317fbe0b953d4cc47f22b72c9e50bd4 WatchSource:0}: Error finding container ba7a0b4b048ef817cef6980577f93063c317fbe0b953d4cc47f22b72c9e50bd4: Status 404 returned error can't find the container with id ba7a0b4b048ef817cef6980577f93063c317fbe0b953d4cc47f22b72c9e50bd4
Jul 07 14:55:58.952769 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.952729    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:55:58.952928 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.952841    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:55:58.953097 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:58.953066    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:55:59.475886 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:59.475848    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv" event={"ID":"01c53e95-9c7c-4641-9220-d1b9e0172220","Type":"ContainerStarted","Data":"8c6f9581c9a999bd943a9591f667815255fd590cb56ee20848a8cc279d597697"}
Jul 07 14:55:59.476068 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:59.475904    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv" event={"ID":"01c53e95-9c7c-4641-9220-d1b9e0172220","Type":"ContainerStarted","Data":"ba7a0b4b048ef817cef6980577f93063c317fbe0b953d4cc47f22b72c9e50bd4"}
Jul 07 14:55:59.499656 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:59.499582    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv" podStartSLOduration=1.499561578 podStartE2EDuration="1.499561578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:55:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:55:59.498248176 +0000 UTC m=+1914.704222307" watchObservedRunningTime="2026-07-07 14:55:59.499561578 +0000 UTC m=+1914.705535711"
Jul 07 14:55:59.798893 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:55:59.798805    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:56:00.804010 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:00.803980    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:56:01.485457 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.485422    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:56:01.486745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.486691    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:56:01.567961 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.567925    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"]
Jul 07 14:56:01.572019 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.571999    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"
Jul 07 14:56:01.574730 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.574704    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-c289a3-serving-cert\""
Jul 07 14:56:01.574990 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.574803    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cx6pw\""
Jul 07 14:56:01.582332 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.582267    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"]
Jul 07 14:56:01.651580 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.651534    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7vnq\" (UniqueName: \"kubernetes.io/projected/3734af65-7ca7-4813-8e11-ddfd758ccaea-kube-api-access-k7vnq\") pod \"maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg\" (UID: \"3734af65-7ca7-4813-8e11-ddfd758ccaea\") " pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"
Jul 07 14:56:01.651580 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.651602    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3734af65-7ca7-4813-8e11-ddfd758ccaea-maas-api-tls\") pod \"maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg\" (UID: \"3734af65-7ca7-4813-8e11-ddfd758ccaea\") " pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"
Jul 07 14:56:01.651821 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.651687    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3734af65-7ca7-4813-8e11-ddfd758ccaea-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg\" (UID: \"3734af65-7ca7-4813-8e11-ddfd758ccaea\") " pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"
Jul 07 14:56:01.752667 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.752533    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3734af65-7ca7-4813-8e11-ddfd758ccaea-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg\" (UID: \"3734af65-7ca7-4813-8e11-ddfd758ccaea\") " pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"
Jul 07 14:56:01.752667 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.752655    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7vnq\" (UniqueName: \"kubernetes.io/projected/3734af65-7ca7-4813-8e11-ddfd758ccaea-kube-api-access-k7vnq\") pod \"maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg\" (UID: \"3734af65-7ca7-4813-8e11-ddfd758ccaea\") " pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"
Jul 07 14:56:01.752928 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.752725    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3734af65-7ca7-4813-8e11-ddfd758ccaea-maas-api-tls\") pod \"maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg\" (UID: \"3734af65-7ca7-4813-8e11-ddfd758ccaea\") " pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"
Jul 07 14:56:01.756618 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.753472    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3734af65-7ca7-4813-8e11-ddfd758ccaea-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg\" (UID: \"3734af65-7ca7-4813-8e11-ddfd758ccaea\") " pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"
Jul 07 14:56:01.756618 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.756315    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3734af65-7ca7-4813-8e11-ddfd758ccaea-maas-api-tls\") pod \"maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg\" (UID: \"3734af65-7ca7-4813-8e11-ddfd758ccaea\") " pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"
Jul 07 14:56:01.763223 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.763194    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7vnq\" (UniqueName: \"kubernetes.io/projected/3734af65-7ca7-4813-8e11-ddfd758ccaea-kube-api-access-k7vnq\") pod \"maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg\" (UID: \"3734af65-7ca7-4813-8e11-ddfd758ccaea\") " pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"
Jul 07 14:56:01.886800 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:01.886758    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"
Jul 07 14:56:02.041672 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:02.041428    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"]
Jul 07 14:56:02.044263 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:56:02.044234    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3734af65_7ca7_4813_8e11_ddfd758ccaea.slice/crio-3a932127cca962e9426bcdd0724b913813a2b332152ad688b7926b58d885972c WatchSource:0}: Error finding container 3a932127cca962e9426bcdd0724b913813a2b332152ad688b7926b58d885972c: Status 404 returned error can't find the container with id 3a932127cca962e9426bcdd0724b913813a2b332152ad688b7926b58d885972c
Jul 07 14:56:02.045694 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:02.045672    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 14:56:02.491143 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:02.491110    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg" event={"ID":"3734af65-7ca7-4813-8e11-ddfd758ccaea","Type":"ContainerStarted","Data":"3a932127cca962e9426bcdd0724b913813a2b332152ad688b7926b58d885972c"}
Jul 07 14:56:03.499143 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:03.499104    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg" event={"ID":"3734af65-7ca7-4813-8e11-ddfd758ccaea","Type":"ContainerStarted","Data":"2cb5ee6acc2b93f7bd14506b5419214722bca769ae22829517686928c5340ecb"}
Jul 07 14:56:03.523757 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:03.523695    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg" podStartSLOduration=1.845312075 podStartE2EDuration="2.523679765s" totalImagesPullingTime="678.36769ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:56:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:56:03.52122735 +0000 UTC m=+1918.727201482" watchObservedRunningTime="2026-07-07 14:56:03.523679765 +0000 UTC m=+1918.729653963"
Jul 07 14:56:04.505790 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:04.505761    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"
Jul 07 14:56:09.172017 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:09.171978    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:56:10.111842 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:10.111799    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"]
Jul 07 14:56:10.116612 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:10.116128    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"
Jul 07 14:56:10.123616 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:10.123130    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-cf70a3-serving-cert\""
Jul 07 14:56:10.127612 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:10.124311    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfwwm\" (UniqueName: \"kubernetes.io/projected/edc6db10-8a67-4ea4-b009-eed0400e54aa-kube-api-access-mfwwm\") pod \"maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8\" (UID: \"edc6db10-8a67-4ea4-b009-eed0400e54aa\") " pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"
Jul 07 14:56:10.127612 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:10.124402    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc6db10-8a67-4ea4-b009-eed0400e54aa-maas-api-tls\") pod \"maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8\" (UID: \"edc6db10-8a67-4ea4-b009-eed0400e54aa\") " pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"
Jul 07 14:56:10.127612 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:10.124435    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc6db10-8a67-4ea4-b009-eed0400e54aa-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8\" (UID: \"edc6db10-8a67-4ea4-b009-eed0400e54aa\") " pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"
Jul 07 14:56:10.145623 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:10.143300    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"]
Jul 07 14:56:10.224975 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:10.224935    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc6db10-8a67-4ea4-b009-eed0400e54aa-maas-api-tls\") pod \"maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8\" (UID: \"edc6db10-8a67-4ea4-b009-eed0400e54aa\") " pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"
Jul 07 14:56:10.225582 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:10.225559    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc6db10-8a67-4ea4-b009-eed0400e54aa-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8\" (UID: \"edc6db10-8a67-4ea4-b009-eed0400e54aa\") " pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"
Jul 07 14:56:10.225826 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:10.225808    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfwwm\" (UniqueName: \"kubernetes.io/projected/edc6db10-8a67-4ea4-b009-eed0400e54aa-kube-api-access-mfwwm\") pod \"maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8\" (UID: \"edc6db10-8a67-4ea4-b009-eed0400e54aa\") " pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"
Jul 07 14:56:10.226414 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:56:10.226392    2567 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-cf70a3-serving-cert: secret "maas-api-e2e-inf-b-cf70a3-serving-cert" not found
Jul 07 14:56:10.226623 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:56:10.226609    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edc6db10-8a67-4ea4-b009-eed0400e54aa-maas-api-tls podName:edc6db10-8a67-4ea4-b009-eed0400e54aa nodeName:}" failed. No retries permitted until 2026-07-07 14:56:10.726566744 +0000 UTC m=+1925.932540857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/edc6db10-8a67-4ea4-b009-eed0400e54aa-maas-api-tls") pod "maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8" (UID: "edc6db10-8a67-4ea4-b009-eed0400e54aa") : secret "maas-api-e2e-inf-b-cf70a3-serving-cert" not found
Jul 07 14:56:10.227763 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:10.227482    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc6db10-8a67-4ea4-b009-eed0400e54aa-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8\" (UID: \"edc6db10-8a67-4ea4-b009-eed0400e54aa\") " pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"
Jul 07 14:56:10.237555 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:10.237527    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfwwm\" (UniqueName: \"kubernetes.io/projected/edc6db10-8a67-4ea4-b009-eed0400e54aa-kube-api-access-mfwwm\") pod \"maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8\" (UID: \"edc6db10-8a67-4ea4-b009-eed0400e54aa\") " pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"
Jul 07 14:56:10.524665 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:10.524631    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"
Jul 07 14:56:10.730656 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:10.730612    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc6db10-8a67-4ea4-b009-eed0400e54aa-maas-api-tls\") pod \"maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8\" (UID: \"edc6db10-8a67-4ea4-b009-eed0400e54aa\") " pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"
Jul 07 14:56:10.733311 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:10.733275    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc6db10-8a67-4ea4-b009-eed0400e54aa-maas-api-tls\") pod \"maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8\" (UID: \"edc6db10-8a67-4ea4-b009-eed0400e54aa\") " pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"
Jul 07 14:56:10.747202 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:10.747165    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"
Jul 07 14:56:11.133995 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:11.133889    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"]
Jul 07 14:56:11.136810 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:56:11.136778    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc6db10_8a67_4ea4_b009_eed0400e54aa.slice/crio-1a3813ac1fcf9fd509feb05e9fa97b2ad63c7de6bc99948820fca84d0c38fcda WatchSource:0}: Error finding container 1a3813ac1fcf9fd509feb05e9fa97b2ad63c7de6bc99948820fca84d0c38fcda: Status 404 returned error can't find the container with id 1a3813ac1fcf9fd509feb05e9fa97b2ad63c7de6bc99948820fca84d0c38fcda
Jul 07 14:56:11.540128 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:11.540101    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8" event={"ID":"edc6db10-8a67-4ea4-b009-eed0400e54aa","Type":"ContainerStarted","Data":"1a3813ac1fcf9fd509feb05e9fa97b2ad63c7de6bc99948820fca84d0c38fcda"}
Jul 07 14:56:12.546384 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:12.546344    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8" event={"ID":"edc6db10-8a67-4ea4-b009-eed0400e54aa","Type":"ContainerStarted","Data":"277bbd1c4d5d1fc4f1a705cd576b5d13874f796f3b9cc2dc14b53dc7599f381f"}
Jul 07 14:56:12.546860 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:12.546476    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"
Jul 07 14:56:12.567317 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:12.567247    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8" podStartSLOduration=2.185593387 podStartE2EDuration="2.567233778s" totalImagesPullingTime="381.640391ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:56:12.566488986 +0000 UTC m=+1927.772463115" watchObservedRunningTime="2026-07-07 14:56:12.567233778 +0000 UTC m=+1927.773207906"
Jul 07 14:56:17.009711 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:17.009022    2567 patch_prober.go:28] interesting pod/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:50934->10.132.0.51:15021: read: connection reset by peer" start-of-body=
Jul 07 14:56:17.009711 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:17.009095    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv" podUID="01c53e95-9c7c-4641-9220-d1b9e0172220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:50934->10.132.0.51:15021: read: connection reset by peer"
Jul 07 14:56:17.573915 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:17.573883    2567 generic.go:356] "Generic (PLEG): container finished" podID="01c53e95-9c7c-4641-9220-d1b9e0172220" containerID="8c6f9581c9a999bd943a9591f667815255fd590cb56ee20848a8cc279d597697" exitCode=0
Jul 07 14:56:17.574090 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:17.573926    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv" event={"ID":"01c53e95-9c7c-4641-9220-d1b9e0172220","Type":"ContainerDied","Data":"8c6f9581c9a999bd943a9591f667815255fd590cb56ee20848a8cc279d597697"}
Jul 07 14:56:17.574298 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:17.574284    2567 scope.go:117] "RemoveContainer" containerID="8c6f9581c9a999bd943a9591f667815255fd590cb56ee20848a8cc279d597697"
Jul 07 14:56:17.575245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:17.575219    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:56:17.575302 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:17.575289    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:56:17.575338 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:17.575324    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:56:18.557266 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:18.557237    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"
Jul 07 14:56:18.581052 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:18.581019    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv" event={"ID":"01c53e95-9c7c-4641-9220-d1b9e0172220","Type":"ContainerStarted","Data":"25c517acd7c042f8d40ab30e271570b420e8264c1ea265aab6369f2b50d6d7b8"}
Jul 07 14:56:18.798962 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:18.798926    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:56:18.799299 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:18.799276    2567 patch_prober.go:28] interesting pod/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 07 14:56:18.799451 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:18.799427    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv" podUID="01c53e95-9c7c-4641-9220-d1b9e0172220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 07 14:56:19.799855 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:19.799802    2567 patch_prober.go:28] interesting pod/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 07 14:56:19.800382 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:19.799894    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv" podUID="01c53e95-9c7c-4641-9220-d1b9e0172220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 07 14:56:20.799444 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:20.799403    2567 patch_prober.go:28] interesting pod/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 07 14:56:20.799776 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:20.799748    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv" podUID="01c53e95-9c7c-4641-9220-d1b9e0172220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 07 14:56:21.808038 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:21.807994    2567 patch_prober.go:28] interesting pod/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 07 14:56:21.808676 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:21.808643    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv" podUID="01c53e95-9c7c-4641-9220-d1b9e0172220" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 07 14:56:22.664638 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:22.664598    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:56:22.804311 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:22.804280    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:56:22.804752 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:22.804729    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:56:22.805479 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:22.805460    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:56:37.567380 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:37.567343    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:56:48.263113 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:56:48.263081    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:57:20.476706 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:20.476622    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:57:41.234514 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:41.234481    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"]
Jul 07 14:57:41.235165 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:41.234747    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg" podUID="3734af65-7ca7-4813-8e11-ddfd758ccaea" containerName="maas-api" containerID="cri-o://2cb5ee6acc2b93f7bd14506b5419214722bca769ae22829517686928c5340ecb" gracePeriod=30
Jul 07 14:57:41.489486 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:41.489426    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"
Jul 07 14:57:41.564970 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:41.564938    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3734af65-7ca7-4813-8e11-ddfd758ccaea-maas-api-tls\") pod \"3734af65-7ca7-4813-8e11-ddfd758ccaea\" (UID: \"3734af65-7ca7-4813-8e11-ddfd758ccaea\") "
Jul 07 14:57:41.565140 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:41.564982    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7vnq\" (UniqueName: \"kubernetes.io/projected/3734af65-7ca7-4813-8e11-ddfd758ccaea-kube-api-access-k7vnq\") pod \"3734af65-7ca7-4813-8e11-ddfd758ccaea\" (UID: \"3734af65-7ca7-4813-8e11-ddfd758ccaea\") "
Jul 07 14:57:41.565140 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:41.565032    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3734af65-7ca7-4813-8e11-ddfd758ccaea-openshift-service-ca\") pod \"3734af65-7ca7-4813-8e11-ddfd758ccaea\" (UID: \"3734af65-7ca7-4813-8e11-ddfd758ccaea\") "
Jul 07 14:57:41.565459 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:41.565435    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3734af65-7ca7-4813-8e11-ddfd758ccaea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3734af65-7ca7-4813-8e11-ddfd758ccaea" (UID: "3734af65-7ca7-4813-8e11-ddfd758ccaea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:57:41.567147 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:41.567122    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3734af65-7ca7-4813-8e11-ddfd758ccaea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3734af65-7ca7-4813-8e11-ddfd758ccaea" (UID: "3734af65-7ca7-4813-8e11-ddfd758ccaea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:57:41.567267 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:41.567252    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3734af65-7ca7-4813-8e11-ddfd758ccaea-kube-api-access-k7vnq" (OuterVolumeSpecName: "kube-api-access-k7vnq") pod "3734af65-7ca7-4813-8e11-ddfd758ccaea" (UID: "3734af65-7ca7-4813-8e11-ddfd758ccaea"). InnerVolumeSpecName "kube-api-access-k7vnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:57:41.665886 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:41.665854    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3734af65-7ca7-4813-8e11-ddfd758ccaea-maas-api-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:57:41.665886 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:41.665881    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7vnq\" (UniqueName: \"kubernetes.io/projected/3734af65-7ca7-4813-8e11-ddfd758ccaea-kube-api-access-k7vnq\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:57:41.665886 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:41.665893    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3734af65-7ca7-4813-8e11-ddfd758ccaea-openshift-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:57:42.009387 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:42.009354    2567 generic.go:356] "Generic (PLEG): container finished" podID="3734af65-7ca7-4813-8e11-ddfd758ccaea" containerID="2cb5ee6acc2b93f7bd14506b5419214722bca769ae22829517686928c5340ecb" exitCode=0
Jul 07 14:57:42.009555 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:42.009404    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"
Jul 07 14:57:42.009555 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:42.009408    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg" event={"ID":"3734af65-7ca7-4813-8e11-ddfd758ccaea","Type":"ContainerDied","Data":"2cb5ee6acc2b93f7bd14506b5419214722bca769ae22829517686928c5340ecb"}
Jul 07 14:57:42.009555 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:42.009539    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg" event={"ID":"3734af65-7ca7-4813-8e11-ddfd758ccaea","Type":"ContainerDied","Data":"3a932127cca962e9426bcdd0724b913813a2b332152ad688b7926b58d885972c"}
Jul 07 14:57:42.009718 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:42.009573    2567 scope.go:117] "RemoveContainer" containerID="2cb5ee6acc2b93f7bd14506b5419214722bca769ae22829517686928c5340ecb"
Jul 07 14:57:42.018849 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:42.018829    2567 scope.go:117] "RemoveContainer" containerID="2cb5ee6acc2b93f7bd14506b5419214722bca769ae22829517686928c5340ecb"
Jul 07 14:57:42.019169 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:57:42.019142    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cb5ee6acc2b93f7bd14506b5419214722bca769ae22829517686928c5340ecb\": container with ID starting with 2cb5ee6acc2b93f7bd14506b5419214722bca769ae22829517686928c5340ecb not found: ID does not exist" containerID="2cb5ee6acc2b93f7bd14506b5419214722bca769ae22829517686928c5340ecb"
Jul 07 14:57:42.019259 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:42.019178    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cb5ee6acc2b93f7bd14506b5419214722bca769ae22829517686928c5340ecb"} err="failed to get container status \"2cb5ee6acc2b93f7bd14506b5419214722bca769ae22829517686928c5340ecb\": rpc error: code = NotFound desc = could not find container \"2cb5ee6acc2b93f7bd14506b5419214722bca769ae22829517686928c5340ecb\": container with ID starting with 2cb5ee6acc2b93f7bd14506b5419214722bca769ae22829517686928c5340ecb not found: ID does not exist"
Jul 07 14:57:42.033139 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:42.033107    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"]
Jul 07 14:57:42.038177 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:42.038156    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-c289a3-78c674856f-lpbsg"]
Jul 07 14:57:43.296728 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:43.296695    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3734af65-7ca7-4813-8e11-ddfd758ccaea" path="/var/lib/kubelet/pods/3734af65-7ca7-4813-8e11-ddfd758ccaea/volumes"
Jul 07 14:57:43.660509 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:57:43.660475    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:58:23.780049 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:23.780010    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"]
Jul 07 14:58:23.780655 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:23.780352    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv" podUID="01c53e95-9c7c-4641-9220-d1b9e0172220" containerName="istio-proxy" containerID="cri-o://25c517acd7c042f8d40ab30e271570b420e8264c1ea265aab6369f2b50d6d7b8" gracePeriod=30
Jul 07 14:58:25.119020 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:25.118987    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"]
Jul 07 14:58:25.119503 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:25.119243    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8" podUID="edc6db10-8a67-4ea4-b009-eed0400e54aa" containerName="maas-api" containerID="cri-o://277bbd1c4d5d1fc4f1a705cd576b5d13874f796f3b9cc2dc14b53dc7599f381f" gracePeriod=30
Jul 07 14:58:25.381512 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:25.381446    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"
Jul 07 14:58:25.447259 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:25.447227    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfwwm\" (UniqueName: \"kubernetes.io/projected/edc6db10-8a67-4ea4-b009-eed0400e54aa-kube-api-access-mfwwm\") pod \"edc6db10-8a67-4ea4-b009-eed0400e54aa\" (UID: \"edc6db10-8a67-4ea4-b009-eed0400e54aa\") "
Jul 07 14:58:25.447429 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:25.447321    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc6db10-8a67-4ea4-b009-eed0400e54aa-openshift-service-ca\") pod \"edc6db10-8a67-4ea4-b009-eed0400e54aa\" (UID: \"edc6db10-8a67-4ea4-b009-eed0400e54aa\") "
Jul 07 14:58:25.447429 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:25.447364    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc6db10-8a67-4ea4-b009-eed0400e54aa-maas-api-tls\") pod \"edc6db10-8a67-4ea4-b009-eed0400e54aa\" (UID: \"edc6db10-8a67-4ea4-b009-eed0400e54aa\") "
Jul 07 14:58:25.447750 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:25.447723    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edc6db10-8a67-4ea4-b009-eed0400e54aa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "edc6db10-8a67-4ea4-b009-eed0400e54aa" (UID: "edc6db10-8a67-4ea4-b009-eed0400e54aa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:58:25.449626 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:25.449575    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edc6db10-8a67-4ea4-b009-eed0400e54aa-kube-api-access-mfwwm" (OuterVolumeSpecName: "kube-api-access-mfwwm") pod "edc6db10-8a67-4ea4-b009-eed0400e54aa" (UID: "edc6db10-8a67-4ea4-b009-eed0400e54aa"). InnerVolumeSpecName "kube-api-access-mfwwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:58:25.449626 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:25.449582    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edc6db10-8a67-4ea4-b009-eed0400e54aa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "edc6db10-8a67-4ea4-b009-eed0400e54aa" (UID: "edc6db10-8a67-4ea4-b009-eed0400e54aa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:58:25.548106 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:25.548071    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edc6db10-8a67-4ea4-b009-eed0400e54aa-openshift-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:58:25.548106 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:25.548102    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edc6db10-8a67-4ea4-b009-eed0400e54aa-maas-api-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:58:25.548106 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:25.548112    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfwwm\" (UniqueName: \"kubernetes.io/projected/edc6db10-8a67-4ea4-b009-eed0400e54aa-kube-api-access-mfwwm\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:58:26.223191 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:26.223150    2567 generic.go:356] "Generic (PLEG): container finished" podID="edc6db10-8a67-4ea4-b009-eed0400e54aa" containerID="277bbd1c4d5d1fc4f1a705cd576b5d13874f796f3b9cc2dc14b53dc7599f381f" exitCode=0
Jul 07 14:58:26.223714 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:26.223219    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"
Jul 07 14:58:26.223714 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:26.223233    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8" event={"ID":"edc6db10-8a67-4ea4-b009-eed0400e54aa","Type":"ContainerDied","Data":"277bbd1c4d5d1fc4f1a705cd576b5d13874f796f3b9cc2dc14b53dc7599f381f"}
Jul 07 14:58:26.223714 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:26.223355    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8" event={"ID":"edc6db10-8a67-4ea4-b009-eed0400e54aa","Type":"ContainerDied","Data":"1a3813ac1fcf9fd509feb05e9fa97b2ad63c7de6bc99948820fca84d0c38fcda"}
Jul 07 14:58:26.223714 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:26.223378    2567 scope.go:117] "RemoveContainer" containerID="277bbd1c4d5d1fc4f1a705cd576b5d13874f796f3b9cc2dc14b53dc7599f381f"
Jul 07 14:58:26.236062 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:26.236041    2567 scope.go:117] "RemoveContainer" containerID="277bbd1c4d5d1fc4f1a705cd576b5d13874f796f3b9cc2dc14b53dc7599f381f"
Jul 07 14:58:26.236318 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:58:26.236299    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"277bbd1c4d5d1fc4f1a705cd576b5d13874f796f3b9cc2dc14b53dc7599f381f\": container with ID starting with 277bbd1c4d5d1fc4f1a705cd576b5d13874f796f3b9cc2dc14b53dc7599f381f not found: ID does not exist" containerID="277bbd1c4d5d1fc4f1a705cd576b5d13874f796f3b9cc2dc14b53dc7599f381f"
Jul 07 14:58:26.236371 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:26.236327    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"277bbd1c4d5d1fc4f1a705cd576b5d13874f796f3b9cc2dc14b53dc7599f381f"} err="failed to get container status \"277bbd1c4d5d1fc4f1a705cd576b5d13874f796f3b9cc2dc14b53dc7599f381f\": rpc error: code = NotFound desc = could not find container \"277bbd1c4d5d1fc4f1a705cd576b5d13874f796f3b9cc2dc14b53dc7599f381f\": container with ID starting with 277bbd1c4d5d1fc4f1a705cd576b5d13874f796f3b9cc2dc14b53dc7599f381f not found: ID does not exist"
Jul 07 14:58:26.249250 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:26.249228    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"]
Jul 07 14:58:26.254355 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:26.254331    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cf70a3-5d87bdb48-zpvp8"]
Jul 07 14:58:27.296746 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:27.296711    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edc6db10-8a67-4ea4-b009-eed0400e54aa" path="/var/lib/kubelet/pods/edc6db10-8a67-4ea4-b009-eed0400e54aa/volumes"
Jul 07 14:58:27.974826 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:27.974791    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:58:29.046677 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.046622    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:58:29.180533 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.180500    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-credential-socket\") pod \"01c53e95-9c7c-4641-9220-d1b9e0172220\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") "
Jul 07 14:58:29.180725 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.180542    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-data\") pod \"01c53e95-9c7c-4641-9220-d1b9e0172220\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") "
Jul 07 14:58:29.180725 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.180570    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-token\") pod \"01c53e95-9c7c-4641-9220-d1b9e0172220\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") "
Jul 07 14:58:29.180725 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.180629    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-podinfo\") pod \"01c53e95-9c7c-4641-9220-d1b9e0172220\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") "
Jul 07 14:58:29.180725 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.180665    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw8wh\" (UniqueName: \"kubernetes.io/projected/01c53e95-9c7c-4641-9220-d1b9e0172220-kube-api-access-vw8wh\") pod \"01c53e95-9c7c-4641-9220-d1b9e0172220\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") "
Jul 07 14:58:29.180725 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.180692    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-workload-socket\") pod \"01c53e95-9c7c-4641-9220-d1b9e0172220\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") "
Jul 07 14:58:29.180725 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.180718    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-envoy\") pod \"01c53e95-9c7c-4641-9220-d1b9e0172220\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") "
Jul 07 14:58:29.181055 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.180915    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "01c53e95-9c7c-4641-9220-d1b9e0172220" (UID: "01c53e95-9c7c-4641-9220-d1b9e0172220"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:58:29.181055 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.180960    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01c53e95-9c7c-4641-9220-d1b9e0172220-istiod-ca-cert\") pod \"01c53e95-9c7c-4641-9220-d1b9e0172220\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") "
Jul 07 14:58:29.181055 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.181025    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-workload-certs\") pod \"01c53e95-9c7c-4641-9220-d1b9e0172220\" (UID: \"01c53e95-9c7c-4641-9220-d1b9e0172220\") "
Jul 07 14:58:29.181055 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.181036    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "01c53e95-9c7c-4641-9220-d1b9e0172220" (UID: "01c53e95-9c7c-4641-9220-d1b9e0172220"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:58:29.181364 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.181325    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-workload-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:58:29.181364 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.181351    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-credential-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:58:29.181364 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.181325    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "01c53e95-9c7c-4641-9220-d1b9e0172220" (UID: "01c53e95-9c7c-4641-9220-d1b9e0172220"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:58:29.181689 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.181336    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01c53e95-9c7c-4641-9220-d1b9e0172220-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "01c53e95-9c7c-4641-9220-d1b9e0172220" (UID: "01c53e95-9c7c-4641-9220-d1b9e0172220"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:58:29.181689 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.181634    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-data" (OuterVolumeSpecName: "istio-data") pod "01c53e95-9c7c-4641-9220-d1b9e0172220" (UID: "01c53e95-9c7c-4641-9220-d1b9e0172220"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:58:29.183144 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.183116    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-token" (OuterVolumeSpecName: "istio-token") pod "01c53e95-9c7c-4641-9220-d1b9e0172220" (UID: "01c53e95-9c7c-4641-9220-d1b9e0172220"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:58:29.183144 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.183125    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "01c53e95-9c7c-4641-9220-d1b9e0172220" (UID: "01c53e95-9c7c-4641-9220-d1b9e0172220"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:58:29.183144 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.183135    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01c53e95-9c7c-4641-9220-d1b9e0172220-kube-api-access-vw8wh" (OuterVolumeSpecName: "kube-api-access-vw8wh") pod "01c53e95-9c7c-4641-9220-d1b9e0172220" (UID: "01c53e95-9c7c-4641-9220-d1b9e0172220"). InnerVolumeSpecName "kube-api-access-vw8wh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:58:29.183343 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.183237    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "01c53e95-9c7c-4641-9220-d1b9e0172220" (UID: "01c53e95-9c7c-4641-9220-d1b9e0172220"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:58:29.241325 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.241295    2567 generic.go:356] "Generic (PLEG): container finished" podID="01c53e95-9c7c-4641-9220-d1b9e0172220" containerID="25c517acd7c042f8d40ab30e271570b420e8264c1ea265aab6369f2b50d6d7b8" exitCode=0
Jul 07 14:58:29.241475 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.241352    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"
Jul 07 14:58:29.241475 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.241378    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv" event={"ID":"01c53e95-9c7c-4641-9220-d1b9e0172220","Type":"ContainerDied","Data":"25c517acd7c042f8d40ab30e271570b420e8264c1ea265aab6369f2b50d6d7b8"}
Jul 07 14:58:29.241475 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.241445    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv" event={"ID":"01c53e95-9c7c-4641-9220-d1b9e0172220","Type":"ContainerDied","Data":"ba7a0b4b048ef817cef6980577f93063c317fbe0b953d4cc47f22b72c9e50bd4"}
Jul 07 14:58:29.241697 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.241479    2567 scope.go:117] "RemoveContainer" containerID="25c517acd7c042f8d40ab30e271570b420e8264c1ea265aab6369f2b50d6d7b8"
Jul 07 14:58:29.250960 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.250943    2567 scope.go:117] "RemoveContainer" containerID="8c6f9581c9a999bd943a9591f667815255fd590cb56ee20848a8cc279d597697"
Jul 07 14:58:29.259361 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.259346    2567 scope.go:117] "RemoveContainer" containerID="25c517acd7c042f8d40ab30e271570b420e8264c1ea265aab6369f2b50d6d7b8"
Jul 07 14:58:29.259641 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:58:29.259622    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25c517acd7c042f8d40ab30e271570b420e8264c1ea265aab6369f2b50d6d7b8\": container with ID starting with 25c517acd7c042f8d40ab30e271570b420e8264c1ea265aab6369f2b50d6d7b8 not found: ID does not exist" containerID="25c517acd7c042f8d40ab30e271570b420e8264c1ea265aab6369f2b50d6d7b8"
Jul 07 14:58:29.259685 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.259650    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25c517acd7c042f8d40ab30e271570b420e8264c1ea265aab6369f2b50d6d7b8"} err="failed to get container status \"25c517acd7c042f8d40ab30e271570b420e8264c1ea265aab6369f2b50d6d7b8\": rpc error: code = NotFound desc = could not find container \"25c517acd7c042f8d40ab30e271570b420e8264c1ea265aab6369f2b50d6d7b8\": container with ID starting with 25c517acd7c042f8d40ab30e271570b420e8264c1ea265aab6369f2b50d6d7b8 not found: ID does not exist"
Jul 07 14:58:29.259685 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.259666    2567 scope.go:117] "RemoveContainer" containerID="8c6f9581c9a999bd943a9591f667815255fd590cb56ee20848a8cc279d597697"
Jul 07 14:58:29.259905 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:58:29.259890    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c6f9581c9a999bd943a9591f667815255fd590cb56ee20848a8cc279d597697\": container with ID starting with 8c6f9581c9a999bd943a9591f667815255fd590cb56ee20848a8cc279d597697 not found: ID does not exist" containerID="8c6f9581c9a999bd943a9591f667815255fd590cb56ee20848a8cc279d597697"
Jul 07 14:58:29.259956 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.259909    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c6f9581c9a999bd943a9591f667815255fd590cb56ee20848a8cc279d597697"} err="failed to get container status \"8c6f9581c9a999bd943a9591f667815255fd590cb56ee20848a8cc279d597697\": rpc error: code = NotFound desc = could not find container \"8c6f9581c9a999bd943a9591f667815255fd590cb56ee20848a8cc279d597697\": container with ID starting with 8c6f9581c9a999bd943a9591f667815255fd590cb56ee20848a8cc279d597697 not found: ID does not exist"
Jul 07 14:58:29.266511 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.266491    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"]
Jul 07 14:58:29.270673 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.270650    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c289a3-openshift-default-84bb96ff9c-dw4cv"]
Jul 07 14:58:29.282390 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.282370    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-data\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:58:29.282390 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.282388    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-token\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:58:29.282512 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.282396    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-podinfo\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:58:29.282512 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.282404    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw8wh\" (UniqueName: \"kubernetes.io/projected/01c53e95-9c7c-4641-9220-d1b9e0172220-kube-api-access-vw8wh\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:58:29.282512 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.282413    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-istio-envoy\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:58:29.282512 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.282423    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01c53e95-9c7c-4641-9220-d1b9e0172220-istiod-ca-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:58:29.282512 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.282430    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01c53e95-9c7c-4641-9220-d1b9e0172220-workload-certs\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:58:29.296308 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:29.296286    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01c53e95-9c7c-4641-9220-d1b9e0172220" path="/var/lib/kubelet/pods/01c53e95-9c7c-4641-9220-d1b9e0172220/volumes"
Jul 07 14:58:32.897156 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:32.897114    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"]
Jul 07 14:58:32.897694 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:32.897675    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edc6db10-8a67-4ea4-b009-eed0400e54aa" containerName="maas-api"
Jul 07 14:58:32.897753 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:32.897698    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="edc6db10-8a67-4ea4-b009-eed0400e54aa" containerName="maas-api"
Jul 07 14:58:32.897753 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:32.897708    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c53e95-9c7c-4641-9220-d1b9e0172220" containerName="istio-proxy"
Jul 07 14:58:32.897753 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:32.897716    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c53e95-9c7c-4641-9220-d1b9e0172220" containerName="istio-proxy"
Jul 07 14:58:32.897753 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:32.897730    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3734af65-7ca7-4813-8e11-ddfd758ccaea" containerName="maas-api"
Jul 07 14:58:32.897753 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:32.897740    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3734af65-7ca7-4813-8e11-ddfd758ccaea" containerName="maas-api"
Jul 07 14:58:32.897934 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:32.897846    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="01c53e95-9c7c-4641-9220-d1b9e0172220" containerName="istio-proxy"
Jul 07 14:58:32.897934 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:32.897859    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="edc6db10-8a67-4ea4-b009-eed0400e54aa" containerName="maas-api"
Jul 07 14:58:32.897934 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:32.897873    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3734af65-7ca7-4813-8e11-ddfd758ccaea" containerName="maas-api"
Jul 07 14:58:32.897934 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:32.897881    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="01c53e95-9c7c-4641-9220-d1b9e0172220" containerName="istio-proxy"
Jul 07 14:58:32.902606 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:32.902572    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:32.906166 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:32.906139    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 14:58:32.906253 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:32.906166    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-8f5749-openshift-default-dockercfg-mkm5m\""
Jul 07 14:58:32.914973 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:32.914951    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"]
Jul 07 14:58:33.013979 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.013945    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-data\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.014175 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.013986    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-token\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.014175 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.014012    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-podinfo\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.014175 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.014039    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-workload-socket\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.014175 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.014061    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-workload-certs\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.014175 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.014106    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istiod-ca-cert\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.014401 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.014186    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-envoy\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.014401 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.014208    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2btl\" (UniqueName: \"kubernetes.io/projected/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-kube-api-access-t2btl\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.014401 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.014261    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-credential-socket\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.115047 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.115015    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-workload-socket\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.115245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.115053    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-workload-certs\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.115245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.115082    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istiod-ca-cert\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.115245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.115143    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-envoy\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.115245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.115169    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2btl\" (UniqueName: \"kubernetes.io/projected/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-kube-api-access-t2btl\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.115245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.115221    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-credential-socket\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.115518 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.115271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-data\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.115518 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.115302    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-token\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.115518 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.115328    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-podinfo\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.115518 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.115481    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-workload-certs\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.115760 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.115552    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-credential-socket\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.115760 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.115690    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-workload-socket\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.115760 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.115690    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-data\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.115892 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.115870    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istiod-ca-cert\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.117790 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.117771    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-envoy\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.117956 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.117939    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-podinfo\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.129097 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.129066    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2btl\" (UniqueName: \"kubernetes.io/projected/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-kube-api-access-t2btl\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.130351 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.130331    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-token\") pod \"e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") " pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.213535 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.213445    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:33.364326 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.364298    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"]
Jul 07 14:58:33.365918 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:58:33.365882    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b46fcce_7fbc_42a6_8ffd_925c21c94a0f.slice/crio-a63494181b9b6477dea11071ca8b6db344c70d052ddb07323cc1189cf3cf5d01 WatchSource:0}: Error finding container a63494181b9b6477dea11071ca8b6db344c70d052ddb07323cc1189cf3cf5d01: Status 404 returned error can't find the container with id a63494181b9b6477dea11071ca8b6db344c70d052ddb07323cc1189cf3cf5d01
Jul 07 14:58:33.368066 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.368031    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:58:33.368179 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.368107    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:58:33.368179 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:33.368152    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:58:34.267580 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:34.267542    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl" event={"ID":"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f","Type":"ContainerStarted","Data":"bb7ce3c2648037076524f3019477e9588c439ac3d73080881a6b494eca3601ef"}
Jul 07 14:58:34.267997 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:34.267650    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl" event={"ID":"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f","Type":"ContainerStarted","Data":"a63494181b9b6477dea11071ca8b6db344c70d052ddb07323cc1189cf3cf5d01"}
Jul 07 14:58:34.300906 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:34.300846    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl" podStartSLOduration=2.300829065 podStartE2EDuration="2.300829065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:58:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:34.299710196 +0000 UTC m=+2069.505684326" watchObservedRunningTime="2026-07-07 14:58:34.300829065 +0000 UTC m=+2069.506803192"
Jul 07 14:58:35.214293 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:35.214254    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:35.218840 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:35.218817    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:35.273998 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:35.273967    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:35.275013 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:35.274992    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:36.499074 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:36.499040    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"]
Jul 07 14:58:36.499629 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:36.499610    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01c53e95-9c7c-4641-9220-d1b9e0172220" containerName="istio-proxy"
Jul 07 14:58:36.499697 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:36.499634    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="01c53e95-9c7c-4641-9220-d1b9e0172220" containerName="istio-proxy"
Jul 07 14:58:36.503298 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:36.503277    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"
Jul 07 14:58:36.506389 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:36.506366    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-8f5749-serving-cert\""
Jul 07 14:58:36.506496 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:36.506435    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cx6pw\""
Jul 07 14:58:36.518479 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:36.518448    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"]
Jul 07 14:58:36.649370 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:36.649330    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68f2780-a73b-415a-81cf-ed388d8108a0-openshift-service-ca\") pod \"maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb\" (UID: \"e68f2780-a73b-415a-81cf-ed388d8108a0\") " pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"
Jul 07 14:58:36.649574 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:36.649505    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l77bc\" (UniqueName: \"kubernetes.io/projected/e68f2780-a73b-415a-81cf-ed388d8108a0-kube-api-access-l77bc\") pod \"maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb\" (UID: \"e68f2780-a73b-415a-81cf-ed388d8108a0\") " pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"
Jul 07 14:58:36.649574 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:36.649539    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e68f2780-a73b-415a-81cf-ed388d8108a0-maas-api-tls\") pod \"maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb\" (UID: \"e68f2780-a73b-415a-81cf-ed388d8108a0\") " pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"
Jul 07 14:58:36.751056 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:36.750956    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l77bc\" (UniqueName: \"kubernetes.io/projected/e68f2780-a73b-415a-81cf-ed388d8108a0-kube-api-access-l77bc\") pod \"maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb\" (UID: \"e68f2780-a73b-415a-81cf-ed388d8108a0\") " pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"
Jul 07 14:58:36.751056 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:36.750995    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e68f2780-a73b-415a-81cf-ed388d8108a0-maas-api-tls\") pod \"maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb\" (UID: \"e68f2780-a73b-415a-81cf-ed388d8108a0\") " pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"
Jul 07 14:58:36.751056 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:36.751037    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68f2780-a73b-415a-81cf-ed388d8108a0-openshift-service-ca\") pod \"maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb\" (UID: \"e68f2780-a73b-415a-81cf-ed388d8108a0\") " pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"
Jul 07 14:58:36.751337 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:58:36.751166    2567 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-8f5749-serving-cert: secret "maas-api-e2e-api-a-8f5749-serving-cert" not found
Jul 07 14:58:36.751337 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:58:36.751236    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e68f2780-a73b-415a-81cf-ed388d8108a0-maas-api-tls podName:e68f2780-a73b-415a-81cf-ed388d8108a0 nodeName:}" failed. No retries permitted until 2026-07-07 14:58:37.251215924 +0000 UTC m=+2072.457190041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e68f2780-a73b-415a-81cf-ed388d8108a0-maas-api-tls") pod "maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb" (UID: "e68f2780-a73b-415a-81cf-ed388d8108a0") : secret "maas-api-e2e-api-a-8f5749-serving-cert" not found
Jul 07 14:58:36.751671 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:36.751653    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68f2780-a73b-415a-81cf-ed388d8108a0-openshift-service-ca\") pod \"maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb\" (UID: \"e68f2780-a73b-415a-81cf-ed388d8108a0\") " pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"
Jul 07 14:58:36.761696 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:36.761677    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l77bc\" (UniqueName: \"kubernetes.io/projected/e68f2780-a73b-415a-81cf-ed388d8108a0-kube-api-access-l77bc\") pod \"maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb\" (UID: \"e68f2780-a73b-415a-81cf-ed388d8108a0\") " pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"
Jul 07 14:58:37.254646 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:37.254615    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e68f2780-a73b-415a-81cf-ed388d8108a0-maas-api-tls\") pod \"maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb\" (UID: \"e68f2780-a73b-415a-81cf-ed388d8108a0\") " pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"
Jul 07 14:58:37.257333 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:37.257308    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e68f2780-a73b-415a-81cf-ed388d8108a0-maas-api-tls\") pod \"maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb\" (UID: \"e68f2780-a73b-415a-81cf-ed388d8108a0\") " pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"
Jul 07 14:58:37.415570 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:37.415531    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"
Jul 07 14:58:37.570579 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:37.570558    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"]
Jul 07 14:58:37.572573 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:58:37.572546    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68f2780_a73b_415a_81cf_ed388d8108a0.slice/crio-28965636001a52a05a940ea05bdfeefd4e3f1650a497eb706ecc00fad2576193 WatchSource:0}: Error finding container 28965636001a52a05a940ea05bdfeefd4e3f1650a497eb706ecc00fad2576193: Status 404 returned error can't find the container with id 28965636001a52a05a940ea05bdfeefd4e3f1650a497eb706ecc00fad2576193
Jul 07 14:58:38.291387 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:38.291358    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb" event={"ID":"e68f2780-a73b-415a-81cf-ed388d8108a0","Type":"ContainerStarted","Data":"28965636001a52a05a940ea05bdfeefd4e3f1650a497eb706ecc00fad2576193"}
Jul 07 14:58:39.298469 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:39.298428    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb" event={"ID":"e68f2780-a73b-415a-81cf-ed388d8108a0","Type":"ContainerStarted","Data":"847b10810465a46e55926f85eab58418e57625913e98d043da132770b52a1dbe"}
Jul 07 14:58:39.298950 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:39.298506    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"
Jul 07 14:58:39.342329 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:39.342271    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb" podStartSLOduration=2.631066879 podStartE2EDuration="3.342255086s" totalImagesPullingTime="711.188207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:39.338879052 +0000 UTC m=+2074.544853182" watchObservedRunningTime="2026-07-07 14:58:39.342255086 +0000 UTC m=+2074.548229214"
Jul 07 14:58:40.667568 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:40.667532    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:58:41.654945 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.654905    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"]
Jul 07 14:58:41.659567 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.659537    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.663903 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.663875    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-d09310-openshift-default-dockercfg-5ssks\""
Jul 07 14:58:41.672294 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.671928    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"]
Jul 07 14:58:41.792999 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.792955    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-envoy\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.792999 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.793003    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-workload-certs\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.793277 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.793099    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-data\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.793277 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.793141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istiod-ca-cert\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.793277 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.793230    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-credential-socket\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.793277 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.793258    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-podinfo\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.793464 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.793288    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-token\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.793464 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.793318    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-workload-socket\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.793464 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.793345    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwk6q\" (UniqueName: \"kubernetes.io/projected/acd371f9-24d1-48a0-a6f5-14fc51c736b9-kube-api-access-lwk6q\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.893994 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.893954    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-credential-socket\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.893994 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.893993    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-podinfo\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.894269 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.894011    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-token\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.894269 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.894144    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-workload-socket\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.894269 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.894178    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwk6q\" (UniqueName: \"kubernetes.io/projected/acd371f9-24d1-48a0-a6f5-14fc51c736b9-kube-api-access-lwk6q\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.894269 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.894231    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-envoy\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.894269 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.894254    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-workload-certs\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.894534 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.894312    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-data\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.894534 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.894363    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istiod-ca-cert\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.894534 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.894411    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-credential-socket\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.894534 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.894490    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-workload-socket\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.894773 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.894656    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-workload-certs\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.894773 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.894737    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-data\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.895043 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.895014    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istiod-ca-cert\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.896548 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.896525    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-envoy\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.896748 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.896704    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-podinfo\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.905003 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.904919    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-token\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.907314 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.907282    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwk6q\" (UniqueName: \"kubernetes.io/projected/acd371f9-24d1-48a0-a6f5-14fc51c736b9-kube-api-access-lwk6q\") pod \"e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") " pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:41.991431 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:41.991378    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:42.187091 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:42.187069    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"]
Jul 07 14:58:42.189518 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:58:42.189488    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd371f9_24d1_48a0_a6f5_14fc51c736b9.slice/crio-26d36c8f2d2a0df2d7ce42d98b21c3247b66c1e506dded0281fd822c9cf16b78 WatchSource:0}: Error finding container 26d36c8f2d2a0df2d7ce42d98b21c3247b66c1e506dded0281fd822c9cf16b78: Status 404 returned error can't find the container with id 26d36c8f2d2a0df2d7ce42d98b21c3247b66c1e506dded0281fd822c9cf16b78
Jul 07 14:58:42.191847 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:42.191812    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:58:42.191925 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:42.191886    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:58:42.191925 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:42.191918    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:58:42.321615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:42.321034    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t" event={"ID":"acd371f9-24d1-48a0-a6f5-14fc51c736b9","Type":"ContainerStarted","Data":"74828b463de45707cdd2383d20a0b03f93f167bbb50b34eeb5c9368b36bb9b0a"}
Jul 07 14:58:42.321615 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:42.321102    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t" event={"ID":"acd371f9-24d1-48a0-a6f5-14fc51c736b9","Type":"ContainerStarted","Data":"26d36c8f2d2a0df2d7ce42d98b21c3247b66c1e506dded0281fd822c9cf16b78"}
Jul 07 14:58:42.350581 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:42.350526    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t" podStartSLOduration=1.3505088299999999 podStartE2EDuration="1.35050883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:58:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:42.347703464 +0000 UTC m=+2077.553677591" watchObservedRunningTime="2026-07-07 14:58:42.35050883 +0000 UTC m=+2077.556482958"
Jul 07 14:58:42.992448 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:42.992419    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:43.997050 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:43.997016    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:44.338823 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:44.338736    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:44.339984 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:44.339963    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:58:44.364998 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:44.364969    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"]
Jul 07 14:58:44.369167 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:44.369139    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"
Jul 07 14:58:44.371510 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:44.371485    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-d09310-serving-cert\""
Jul 07 14:58:44.387774 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:44.387751    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"]
Jul 07 14:58:44.436915 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:44.436029    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9b75\" (UniqueName: \"kubernetes.io/projected/48f2e82c-9733-4e85-9bc2-7c8400c7a967-kube-api-access-m9b75\") pod \"maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb\" (UID: \"48f2e82c-9733-4e85-9bc2-7c8400c7a967\") " pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"
Jul 07 14:58:44.436915 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:44.436131    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48f2e82c-9733-4e85-9bc2-7c8400c7a967-openshift-service-ca\") pod \"maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb\" (UID: \"48f2e82c-9733-4e85-9bc2-7c8400c7a967\") " pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"
Jul 07 14:58:44.436915 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:44.436159    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48f2e82c-9733-4e85-9bc2-7c8400c7a967-maas-api-tls\") pod \"maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb\" (UID: \"48f2e82c-9733-4e85-9bc2-7c8400c7a967\") " pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"
Jul 07 14:58:44.537503 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:44.537461    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48f2e82c-9733-4e85-9bc2-7c8400c7a967-openshift-service-ca\") pod \"maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb\" (UID: \"48f2e82c-9733-4e85-9bc2-7c8400c7a967\") " pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"
Jul 07 14:58:44.537704 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:44.537509    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48f2e82c-9733-4e85-9bc2-7c8400c7a967-maas-api-tls\") pod \"maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb\" (UID: \"48f2e82c-9733-4e85-9bc2-7c8400c7a967\") " pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"
Jul 07 14:58:44.537704 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:44.537559    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9b75\" (UniqueName: \"kubernetes.io/projected/48f2e82c-9733-4e85-9bc2-7c8400c7a967-kube-api-access-m9b75\") pod \"maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb\" (UID: \"48f2e82c-9733-4e85-9bc2-7c8400c7a967\") " pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"
Jul 07 14:58:44.537810 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:58:44.537726    2567 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-d09310-serving-cert: secret "maas-api-e2e-api-b-d09310-serving-cert" not found
Jul 07 14:58:44.537810 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:58:44.537808    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48f2e82c-9733-4e85-9bc2-7c8400c7a967-maas-api-tls podName:48f2e82c-9733-4e85-9bc2-7c8400c7a967 nodeName:}" failed. No retries permitted until 2026-07-07 14:58:45.037789485 +0000 UTC m=+2080.243763617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/48f2e82c-9733-4e85-9bc2-7c8400c7a967-maas-api-tls") pod "maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb" (UID: "48f2e82c-9733-4e85-9bc2-7c8400c7a967") : secret "maas-api-e2e-api-b-d09310-serving-cert" not found
Jul 07 14:58:44.538222 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:44.538201    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48f2e82c-9733-4e85-9bc2-7c8400c7a967-openshift-service-ca\") pod \"maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb\" (UID: \"48f2e82c-9733-4e85-9bc2-7c8400c7a967\") " pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"
Jul 07 14:58:44.555193 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:44.555148    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9b75\" (UniqueName: \"kubernetes.io/projected/48f2e82c-9733-4e85-9bc2-7c8400c7a967-kube-api-access-m9b75\") pod \"maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb\" (UID: \"48f2e82c-9733-4e85-9bc2-7c8400c7a967\") " pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"
Jul 07 14:58:45.041259 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:45.041212    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48f2e82c-9733-4e85-9bc2-7c8400c7a967-maas-api-tls\") pod \"maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb\" (UID: \"48f2e82c-9733-4e85-9bc2-7c8400c7a967\") " pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"
Jul 07 14:58:45.043816 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:45.043792    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48f2e82c-9733-4e85-9bc2-7c8400c7a967-maas-api-tls\") pod \"maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb\" (UID: \"48f2e82c-9733-4e85-9bc2-7c8400c7a967\") " pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"
Jul 07 14:58:45.284274 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:45.284244    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"
Jul 07 14:58:45.332728 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:45.331862    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"
Jul 07 14:58:45.528252 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:45.528217    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"]
Jul 07 14:58:45.534445 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:58:45.534415    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f2e82c_9733_4e85_9bc2_7c8400c7a967.slice/crio-5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997 WatchSource:0}: Error finding container 5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997: Status 404 returned error can't find the container with id 5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997
Jul 07 14:58:46.353206 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:46.353169    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb" event={"ID":"48f2e82c-9733-4e85-9bc2-7c8400c7a967","Type":"ContainerStarted","Data":"2da5a1990212c0921e58325129ea0baf9b8b1c8e5c206e8a899b4942ddaebad8"}
Jul 07 14:58:46.353694 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:46.353226    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb" event={"ID":"48f2e82c-9733-4e85-9bc2-7c8400c7a967","Type":"ContainerStarted","Data":"5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997"}
Jul 07 14:58:46.353694 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:46.353260    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"
Jul 07 14:58:46.385552 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:46.385496    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb" podStartSLOduration=2.039760505 podStartE2EDuration="2.385473241s" totalImagesPullingTime="345.712736ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:58:46.382352771 +0000 UTC m=+2081.588326900" watchObservedRunningTime="2026-07-07 14:58:46.385473241 +0000 UTC m=+2081.591447371"
Jul 07 14:58:49.369770 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:49.369736    2567 generic.go:356] "Generic (PLEG): container finished" podID="0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" containerID="bb7ce3c2648037076524f3019477e9588c439ac3d73080881a6b494eca3601ef" exitCode=0
Jul 07 14:58:49.370188 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:49.369817    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl" event={"ID":"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f","Type":"ContainerDied","Data":"bb7ce3c2648037076524f3019477e9588c439ac3d73080881a6b494eca3601ef"}
Jul 07 14:58:49.370391 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:49.370372    2567 scope.go:117] "RemoveContainer" containerID="bb7ce3c2648037076524f3019477e9588c439ac3d73080881a6b494eca3601ef"
Jul 07 14:58:49.371518 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:49.371491    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:58:49.371581 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:49.371568    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:58:49.371663 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:49.371648    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:58:50.274225 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:50.274187    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:50.376953 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:50.376913    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl" event={"ID":"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f","Type":"ContainerStarted","Data":"75c7fdf100ee2e7b3918111b1b5f272632daf3c4578fd4f15194741c9e63e085"}
Jul 07 14:58:51.214148 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:51.214096    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:51.215521 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:51.215484    2567 patch_prober.go:28] interesting pod/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 07 14:58:51.215681 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:51.215552    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl" podUID="0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 07 14:58:52.214645 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:52.214574    2567 patch_prober.go:28] interesting pod/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 07 14:58:52.215156 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:52.214690    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl" podUID="0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 07 14:58:52.364207 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:52.364174    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"
Jul 07 14:58:53.214501 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:53.214460    2567 patch_prober.go:28] interesting pod/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 07 14:58:53.214745 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:53.214533    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl" podUID="0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 07 14:58:54.214630 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:54.214568    2567 patch_prober.go:28] interesting pod/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 07 14:58:54.214851 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:54.214649    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl" podUID="0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 07 14:58:55.217822 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:55.217790    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:55.218423 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:55.218167    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:55.218863 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:55.218848    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:58:55.375337 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:55.375304    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:58:57.844484 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:57.843708    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"]
Jul 07 14:58:57.844484 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:57.843965    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb" podUID="e68f2780-a73b-415a-81cf-ed388d8108a0" containerName="maas-api" containerID="cri-o://847b10810465a46e55926f85eab58418e57625913e98d043da132770b52a1dbe" gracePeriod=30
Jul 07 14:58:58.155296 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.155267    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"
Jul 07 14:58:58.270235 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.270205    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l77bc\" (UniqueName: \"kubernetes.io/projected/e68f2780-a73b-415a-81cf-ed388d8108a0-kube-api-access-l77bc\") pod \"e68f2780-a73b-415a-81cf-ed388d8108a0\" (UID: \"e68f2780-a73b-415a-81cf-ed388d8108a0\") "
Jul 07 14:58:58.270407 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.270288    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68f2780-a73b-415a-81cf-ed388d8108a0-openshift-service-ca\") pod \"e68f2780-a73b-415a-81cf-ed388d8108a0\" (UID: \"e68f2780-a73b-415a-81cf-ed388d8108a0\") "
Jul 07 14:58:58.270458 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.270413    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e68f2780-a73b-415a-81cf-ed388d8108a0-maas-api-tls\") pod \"e68f2780-a73b-415a-81cf-ed388d8108a0\" (UID: \"e68f2780-a73b-415a-81cf-ed388d8108a0\") "
Jul 07 14:58:58.270549 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.270532    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e68f2780-a73b-415a-81cf-ed388d8108a0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e68f2780-a73b-415a-81cf-ed388d8108a0" (UID: "e68f2780-a73b-415a-81cf-ed388d8108a0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:58:58.270723 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.270711    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68f2780-a73b-415a-81cf-ed388d8108a0-openshift-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:58:58.272436 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.272405    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e68f2780-a73b-415a-81cf-ed388d8108a0-kube-api-access-l77bc" (OuterVolumeSpecName: "kube-api-access-l77bc") pod "e68f2780-a73b-415a-81cf-ed388d8108a0" (UID: "e68f2780-a73b-415a-81cf-ed388d8108a0"). InnerVolumeSpecName "kube-api-access-l77bc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:58:58.272542 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.272521    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e68f2780-a73b-415a-81cf-ed388d8108a0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e68f2780-a73b-415a-81cf-ed388d8108a0" (UID: "e68f2780-a73b-415a-81cf-ed388d8108a0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:58:58.371544 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.371511    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e68f2780-a73b-415a-81cf-ed388d8108a0-maas-api-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:58:58.371544 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.371538    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l77bc\" (UniqueName: \"kubernetes.io/projected/e68f2780-a73b-415a-81cf-ed388d8108a0-kube-api-access-l77bc\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:58:58.426662 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.426622    2567 generic.go:356] "Generic (PLEG): container finished" podID="e68f2780-a73b-415a-81cf-ed388d8108a0" containerID="847b10810465a46e55926f85eab58418e57625913e98d043da132770b52a1dbe" exitCode=0
Jul 07 14:58:58.426857 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.426704    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb" event={"ID":"e68f2780-a73b-415a-81cf-ed388d8108a0","Type":"ContainerDied","Data":"847b10810465a46e55926f85eab58418e57625913e98d043da132770b52a1dbe"}
Jul 07 14:58:58.426857 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.426754    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb" event={"ID":"e68f2780-a73b-415a-81cf-ed388d8108a0","Type":"ContainerDied","Data":"28965636001a52a05a940ea05bdfeefd4e3f1650a497eb706ecc00fad2576193"}
Jul 07 14:58:58.426857 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.426785    2567 scope.go:117] "RemoveContainer" containerID="847b10810465a46e55926f85eab58418e57625913e98d043da132770b52a1dbe"
Jul 07 14:58:58.427037 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.426943    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"
Jul 07 14:58:58.436660 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.436640    2567 scope.go:117] "RemoveContainer" containerID="847b10810465a46e55926f85eab58418e57625913e98d043da132770b52a1dbe"
Jul 07 14:58:58.436935 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:58:58.436915    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"847b10810465a46e55926f85eab58418e57625913e98d043da132770b52a1dbe\": container with ID starting with 847b10810465a46e55926f85eab58418e57625913e98d043da132770b52a1dbe not found: ID does not exist" containerID="847b10810465a46e55926f85eab58418e57625913e98d043da132770b52a1dbe"
Jul 07 14:58:58.436991 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.436944    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847b10810465a46e55926f85eab58418e57625913e98d043da132770b52a1dbe"} err="failed to get container status \"847b10810465a46e55926f85eab58418e57625913e98d043da132770b52a1dbe\": rpc error: code = NotFound desc = could not find container \"847b10810465a46e55926f85eab58418e57625913e98d043da132770b52a1dbe\": container with ID starting with 847b10810465a46e55926f85eab58418e57625913e98d043da132770b52a1dbe not found: ID does not exist"
Jul 07 14:58:58.450769 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.450747    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"]
Jul 07 14:58:58.455940 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:58.455920    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-8f5749-86485ffb7f-kmndb"]
Jul 07 14:58:59.297241 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:58:59.297200    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e68f2780-a73b-415a-81cf-ed388d8108a0" path="/var/lib/kubelet/pods/e68f2780-a73b-415a-81cf-ed388d8108a0/volumes"
Jul 07 14:59:04.391606 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:04.391552    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"]
Jul 07 14:59:04.392089 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:04.391785    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl" podUID="0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" containerName="istio-proxy" containerID="cri-o://75c7fdf100ee2e7b3918111b1b5f272632daf3c4578fd4f15194741c9e63e085" gracePeriod=30
Jul 07 14:59:04.460179 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:04.460146    2567 generic.go:356] "Generic (PLEG): container finished" podID="acd371f9-24d1-48a0-a6f5-14fc51c736b9" containerID="74828b463de45707cdd2383d20a0b03f93f167bbb50b34eeb5c9368b36bb9b0a" exitCode=0
Jul 07 14:59:04.460356 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:04.460230    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t" event={"ID":"acd371f9-24d1-48a0-a6f5-14fc51c736b9","Type":"ContainerDied","Data":"74828b463de45707cdd2383d20a0b03f93f167bbb50b34eeb5c9368b36bb9b0a"}
Jul 07 14:59:04.460714 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:04.460694    2567 scope.go:117] "RemoveContainer" containerID="74828b463de45707cdd2383d20a0b03f93f167bbb50b34eeb5c9368b36bb9b0a"
Jul 07 14:59:04.461739 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:04.461708    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:59:04.461827 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:04.461777    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:59:04.461827 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:04.461806    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:59:05.438201 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:05.438174    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:59:05.440242 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:05.440217    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 14:59:05.467487 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:05.467442    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t" event={"ID":"acd371f9-24d1-48a0-a6f5-14fc51c736b9","Type":"ContainerStarted","Data":"b93ab1a107eeeae21918d4e0ce2384152e62a956a564b58ff7bb1e017ec7efb4"}
Jul 07 14:59:05.679420 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:05.679387    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"]
Jul 07 14:59:05.680531 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:05.679986    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb" podUID="48f2e82c-9733-4e85-9bc2-7c8400c7a967" containerName="maas-api" containerID="cri-o://2da5a1990212c0921e58325129ea0baf9b8b1c8e5c206e8a899b4942ddaebad8" gracePeriod=30
Jul 07 14:59:05.981734 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:05.981708    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"
Jul 07 14:59:05.992416 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:05.992392    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:59:05.992641 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:05.992615    2567 patch_prober.go:28] interesting pod/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 07 14:59:05.992700 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:05.992686    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t" podUID="acd371f9-24d1-48a0-a6f5-14fc51c736b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 07 14:59:06.047420 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.047385    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48f2e82c-9733-4e85-9bc2-7c8400c7a967-openshift-service-ca\") pod \"48f2e82c-9733-4e85-9bc2-7c8400c7a967\" (UID: \"48f2e82c-9733-4e85-9bc2-7c8400c7a967\") "
Jul 07 14:59:06.047641 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.047544    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9b75\" (UniqueName: \"kubernetes.io/projected/48f2e82c-9733-4e85-9bc2-7c8400c7a967-kube-api-access-m9b75\") pod \"48f2e82c-9733-4e85-9bc2-7c8400c7a967\" (UID: \"48f2e82c-9733-4e85-9bc2-7c8400c7a967\") "
Jul 07 14:59:06.047641 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.047577    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48f2e82c-9733-4e85-9bc2-7c8400c7a967-maas-api-tls\") pod \"48f2e82c-9733-4e85-9bc2-7c8400c7a967\" (UID: \"48f2e82c-9733-4e85-9bc2-7c8400c7a967\") "
Jul 07 14:59:06.047828 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.047805    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48f2e82c-9733-4e85-9bc2-7c8400c7a967-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "48f2e82c-9733-4e85-9bc2-7c8400c7a967" (UID: "48f2e82c-9733-4e85-9bc2-7c8400c7a967"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:59:06.049796 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.049764    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48f2e82c-9733-4e85-9bc2-7c8400c7a967-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "48f2e82c-9733-4e85-9bc2-7c8400c7a967" (UID: "48f2e82c-9733-4e85-9bc2-7c8400c7a967"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 14:59:06.049920 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.049807    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48f2e82c-9733-4e85-9bc2-7c8400c7a967-kube-api-access-m9b75" (OuterVolumeSpecName: "kube-api-access-m9b75") pod "48f2e82c-9733-4e85-9bc2-7c8400c7a967" (UID: "48f2e82c-9733-4e85-9bc2-7c8400c7a967"). InnerVolumeSpecName "kube-api-access-m9b75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:59:06.148404 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.148371    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9b75\" (UniqueName: \"kubernetes.io/projected/48f2e82c-9733-4e85-9bc2-7c8400c7a967-kube-api-access-m9b75\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:06.148404 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.148403    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/48f2e82c-9733-4e85-9bc2-7c8400c7a967-maas-api-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:06.148404 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.148412    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/48f2e82c-9733-4e85-9bc2-7c8400c7a967-openshift-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:06.474243 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.474210    2567 generic.go:356] "Generic (PLEG): container finished" podID="48f2e82c-9733-4e85-9bc2-7c8400c7a967" containerID="2da5a1990212c0921e58325129ea0baf9b8b1c8e5c206e8a899b4942ddaebad8" exitCode=0
Jul 07 14:59:06.474732 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.474258    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"
Jul 07 14:59:06.474732 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.474291    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb" event={"ID":"48f2e82c-9733-4e85-9bc2-7c8400c7a967","Type":"ContainerDied","Data":"2da5a1990212c0921e58325129ea0baf9b8b1c8e5c206e8a899b4942ddaebad8"}
Jul 07 14:59:06.474732 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.474358    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb" event={"ID":"48f2e82c-9733-4e85-9bc2-7c8400c7a967","Type":"ContainerDied","Data":"5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997"}
Jul 07 14:59:06.474732 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.474395    2567 scope.go:117] "RemoveContainer" containerID="2da5a1990212c0921e58325129ea0baf9b8b1c8e5c206e8a899b4942ddaebad8"
Jul 07 14:59:06.483432 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.483413    2567 scope.go:117] "RemoveContainer" containerID="2da5a1990212c0921e58325129ea0baf9b8b1c8e5c206e8a899b4942ddaebad8"
Jul 07 14:59:06.483738 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:59:06.483721    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2da5a1990212c0921e58325129ea0baf9b8b1c8e5c206e8a899b4942ddaebad8\": container with ID starting with 2da5a1990212c0921e58325129ea0baf9b8b1c8e5c206e8a899b4942ddaebad8 not found: ID does not exist" containerID="2da5a1990212c0921e58325129ea0baf9b8b1c8e5c206e8a899b4942ddaebad8"
Jul 07 14:59:06.483784 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.483749    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2da5a1990212c0921e58325129ea0baf9b8b1c8e5c206e8a899b4942ddaebad8"} err="failed to get container status \"2da5a1990212c0921e58325129ea0baf9b8b1c8e5c206e8a899b4942ddaebad8\": rpc error: code = NotFound desc = could not find container \"2da5a1990212c0921e58325129ea0baf9b8b1c8e5c206e8a899b4942ddaebad8\": container with ID starting with 2da5a1990212c0921e58325129ea0baf9b8b1c8e5c206e8a899b4942ddaebad8 not found: ID does not exist"
Jul 07 14:59:06.499146 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.499110    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"]
Jul 07 14:59:06.506713 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.506682    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d09310-5f7d96bf98-m79jb"]
Jul 07 14:59:06.992192 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.992162    2567 patch_prober.go:28] interesting pod/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 07 14:59:06.992364 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:06.992219    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t" podUID="acd371f9-24d1-48a0-a6f5-14fc51c736b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 07 14:59:07.296698 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:07.296579    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48f2e82c-9733-4e85-9bc2-7c8400c7a967" path="/var/lib/kubelet/pods/48f2e82c-9733-4e85-9bc2-7c8400c7a967/volumes"
Jul 07 14:59:07.992437 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:07.992401    2567 patch_prober.go:28] interesting pod/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 07 14:59:07.992869 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:07.992454    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t" podUID="acd371f9-24d1-48a0-a6f5-14fc51c736b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 07 14:59:08.991853 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:08.991816    2567 patch_prober.go:28] interesting pod/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 07 14:59:08.992043 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:08.991888    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t" podUID="acd371f9-24d1-48a0-a6f5-14fc51c736b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 07 14:59:09.474645 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.474612    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:59:09.649788 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.649762    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:59:09.781728 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.781632    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2btl\" (UniqueName: \"kubernetes.io/projected/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-kube-api-access-t2btl\") pod \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") "
Jul 07 14:59:09.781728 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.781690    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istiod-ca-cert\") pod \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") "
Jul 07 14:59:09.781728 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.781729    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-envoy\") pod \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") "
Jul 07 14:59:09.782015 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.781766    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-credential-socket\") pod \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") "
Jul 07 14:59:09.782015 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.781794    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-workload-certs\") pod \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") "
Jul 07 14:59:09.782015 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.781823    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-token\") pod \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") "
Jul 07 14:59:09.782015 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.781863    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-podinfo\") pod \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") "
Jul 07 14:59:09.782015 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.781916    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-data\") pod \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") "
Jul 07 14:59:09.782015 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.781944    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-workload-socket\") pod \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\" (UID: \"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f\") "
Jul 07 14:59:09.782291 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.782129    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" (UID: "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:59:09.782291 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.782150    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" (UID: "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:59:09.782291 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.782186    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" (UID: "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:59:09.782291 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.782272    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-workload-certs\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:09.782291 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.782291    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istiod-ca-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:09.782556 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.782304    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-credential-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:09.782556 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.782436    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" (UID: "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:59:09.782982 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.782962    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-data" (OuterVolumeSpecName: "istio-data") pod "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" (UID: "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:59:09.784078 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.784054    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" (UID: "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:59:09.784271 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.784252    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" (UID: "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:59:09.784779 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.784754    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-kube-api-access-t2btl" (OuterVolumeSpecName: "kube-api-access-t2btl") pod "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" (UID: "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f"). InnerVolumeSpecName "kube-api-access-t2btl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:59:09.784873 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.784754    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-token" (OuterVolumeSpecName: "istio-token") pod "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" (UID: "0b46fcce-7fbc-42a6-8ffd-925c21c94a0f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:59:09.883644 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.883608    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-envoy\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:09.883644 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.883636    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-token\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:09.883644 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.883644    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-podinfo\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:09.883644 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.883652    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-istio-data\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:09.883900 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.883660    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-workload-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:09.883900 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.883668    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2btl\" (UniqueName: \"kubernetes.io/projected/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f-kube-api-access-t2btl\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:09.996222 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.996191    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:59:09.996465 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.996444    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:59:09.997242 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:09.997222    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:59:10.498514 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:10.498483    2567 generic.go:356] "Generic (PLEG): container finished" podID="0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" containerID="75c7fdf100ee2e7b3918111b1b5f272632daf3c4578fd4f15194741c9e63e085" exitCode=0
Jul 07 14:59:10.498999 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:10.498532    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"
Jul 07 14:59:10.498999 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:10.498571    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl" event={"ID":"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f","Type":"ContainerDied","Data":"75c7fdf100ee2e7b3918111b1b5f272632daf3c4578fd4f15194741c9e63e085"}
Jul 07 14:59:10.498999 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:10.498657    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl" event={"ID":"0b46fcce-7fbc-42a6-8ffd-925c21c94a0f","Type":"ContainerDied","Data":"a63494181b9b6477dea11071ca8b6db344c70d052ddb07323cc1189cf3cf5d01"}
Jul 07 14:59:10.498999 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:10.498692    2567 scope.go:117] "RemoveContainer" containerID="75c7fdf100ee2e7b3918111b1b5f272632daf3c4578fd4f15194741c9e63e085"
Jul 07 14:59:10.509161 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:10.508992    2567 scope.go:117] "RemoveContainer" containerID="bb7ce3c2648037076524f3019477e9588c439ac3d73080881a6b494eca3601ef"
Jul 07 14:59:10.517519 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:10.517497    2567 scope.go:117] "RemoveContainer" containerID="75c7fdf100ee2e7b3918111b1b5f272632daf3c4578fd4f15194741c9e63e085"
Jul 07 14:59:10.517816 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:59:10.517786    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75c7fdf100ee2e7b3918111b1b5f272632daf3c4578fd4f15194741c9e63e085\": container with ID starting with 75c7fdf100ee2e7b3918111b1b5f272632daf3c4578fd4f15194741c9e63e085 not found: ID does not exist" containerID="75c7fdf100ee2e7b3918111b1b5f272632daf3c4578fd4f15194741c9e63e085"
Jul 07 14:59:10.517899 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:10.517820    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75c7fdf100ee2e7b3918111b1b5f272632daf3c4578fd4f15194741c9e63e085"} err="failed to get container status \"75c7fdf100ee2e7b3918111b1b5f272632daf3c4578fd4f15194741c9e63e085\": rpc error: code = NotFound desc = could not find container \"75c7fdf100ee2e7b3918111b1b5f272632daf3c4578fd4f15194741c9e63e085\": container with ID starting with 75c7fdf100ee2e7b3918111b1b5f272632daf3c4578fd4f15194741c9e63e085 not found: ID does not exist"
Jul 07 14:59:10.517899 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:10.517838    2567 scope.go:117] "RemoveContainer" containerID="bb7ce3c2648037076524f3019477e9588c439ac3d73080881a6b494eca3601ef"
Jul 07 14:59:10.518070 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:59:10.518056    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb7ce3c2648037076524f3019477e9588c439ac3d73080881a6b494eca3601ef\": container with ID starting with bb7ce3c2648037076524f3019477e9588c439ac3d73080881a6b494eca3601ef not found: ID does not exist" containerID="bb7ce3c2648037076524f3019477e9588c439ac3d73080881a6b494eca3601ef"
Jul 07 14:59:10.518110 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:10.518073    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb7ce3c2648037076524f3019477e9588c439ac3d73080881a6b494eca3601ef"} err="failed to get container status \"bb7ce3c2648037076524f3019477e9588c439ac3d73080881a6b494eca3601ef\": rpc error: code = NotFound desc = could not find container \"bb7ce3c2648037076524f3019477e9588c439ac3d73080881a6b494eca3601ef\": container with ID starting with bb7ce3c2648037076524f3019477e9588c439ac3d73080881a6b494eca3601ef not found: ID does not exist"
Jul 07 14:59:10.523785 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:10.523761    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"]
Jul 07 14:59:10.529127 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:10.529105    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-8f5749-openshift-default-6c489d744f-bzmvl"]
Jul 07 14:59:10.959430 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:59:10.959393    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f2e82c_9733_4e85_9bc2_7c8400c7a967.slice/crio-5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997\": RecentStats: unable to find data in memory cache]"
Jul 07 14:59:11.297866 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:11.297781    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" path="/var/lib/kubelet/pods/0b46fcce-7fbc-42a6-8ffd-925c21c94a0f/volumes"
Jul 07 14:59:11.885858 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:11.885817    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"]
Jul 07 14:59:12.201364 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:59:12.201330    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f2e82c_9733_4e85_9bc2_7c8400c7a967.slice/crio-5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997\": RecentStats: unable to find data in memory cache]"
Jul 07 14:59:12.510420 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:12.510309    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t" podUID="acd371f9-24d1-48a0-a6f5-14fc51c736b9" containerName="istio-proxy" containerID="cri-o://b93ab1a107eeeae21918d4e0ce2384152e62a956a564b58ff7bb1e017ec7efb4" gracePeriod=30
Jul 07 14:59:15.973222 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:15.973190    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"]
Jul 07 14:59:15.973631 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:15.973613    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" containerName="istio-proxy"
Jul 07 14:59:15.973692 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:15.973634    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" containerName="istio-proxy"
Jul 07 14:59:15.973692 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:15.973681    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e68f2780-a73b-415a-81cf-ed388d8108a0" containerName="maas-api"
Jul 07 14:59:15.973692 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:15.973688    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e68f2780-a73b-415a-81cf-ed388d8108a0" containerName="maas-api"
Jul 07 14:59:15.973790 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:15.973696    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f2e82c-9733-4e85-9bc2-7c8400c7a967" containerName="maas-api"
Jul 07 14:59:15.973790 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:15.973702    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f2e82c-9733-4e85-9bc2-7c8400c7a967" containerName="maas-api"
Jul 07 14:59:15.973790 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:15.973775    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="48f2e82c-9733-4e85-9bc2-7c8400c7a967" containerName="maas-api"
Jul 07 14:59:15.973790 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:15.973785    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e68f2780-a73b-415a-81cf-ed388d8108a0" containerName="maas-api"
Jul 07 14:59:15.973790 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:15.973790    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" containerName="istio-proxy"
Jul 07 14:59:15.978398 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:15.978374    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"
Jul 07 14:59:15.988025 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:15.988002    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-82db1a-serving-cert\""
Jul 07 14:59:15.988183 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:15.988149    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cx6pw\""
Jul 07 14:59:15.990495 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:15.990474    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"]
Jul 07 14:59:16.140942 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:16.140903    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvndp\" (UniqueName: \"kubernetes.io/projected/33f41fe0-aebb-400f-af54-eb8e9cd79179-kube-api-access-bvndp\") pod \"maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd\" (UID: \"33f41fe0-aebb-400f-af54-eb8e9cd79179\") " pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"
Jul 07 14:59:16.141121 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:16.140953    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33f41fe0-aebb-400f-af54-eb8e9cd79179-maas-api-tls\") pod \"maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd\" (UID: \"33f41fe0-aebb-400f-af54-eb8e9cd79179\") " pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"
Jul 07 14:59:16.141121 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:16.141034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f41fe0-aebb-400f-af54-eb8e9cd79179-openshift-service-ca\") pod \"maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd\" (UID: \"33f41fe0-aebb-400f-af54-eb8e9cd79179\") " pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"
Jul 07 14:59:16.241844 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:16.241752    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f41fe0-aebb-400f-af54-eb8e9cd79179-openshift-service-ca\") pod \"maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd\" (UID: \"33f41fe0-aebb-400f-af54-eb8e9cd79179\") " pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"
Jul 07 14:59:16.241844 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:16.241825    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvndp\" (UniqueName: \"kubernetes.io/projected/33f41fe0-aebb-400f-af54-eb8e9cd79179-kube-api-access-bvndp\") pod \"maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd\" (UID: \"33f41fe0-aebb-400f-af54-eb8e9cd79179\") " pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"
Jul 07 14:59:16.242049 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:16.241849    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33f41fe0-aebb-400f-af54-eb8e9cd79179-maas-api-tls\") pod \"maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd\" (UID: \"33f41fe0-aebb-400f-af54-eb8e9cd79179\") " pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"
Jul 07 14:59:16.242501 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:16.242481    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f41fe0-aebb-400f-af54-eb8e9cd79179-openshift-service-ca\") pod \"maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd\" (UID: \"33f41fe0-aebb-400f-af54-eb8e9cd79179\") " pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"
Jul 07 14:59:16.244462 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:16.244440    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33f41fe0-aebb-400f-af54-eb8e9cd79179-maas-api-tls\") pod \"maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd\" (UID: \"33f41fe0-aebb-400f-af54-eb8e9cd79179\") " pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"
Jul 07 14:59:16.253423 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:16.253395    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvndp\" (UniqueName: \"kubernetes.io/projected/33f41fe0-aebb-400f-af54-eb8e9cd79179-kube-api-access-bvndp\") pod \"maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd\" (UID: \"33f41fe0-aebb-400f-af54-eb8e9cd79179\") " pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"
Jul 07 14:59:16.291430 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:16.291405    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"
Jul 07 14:59:16.434332 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:16.434262    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"]
Jul 07 14:59:16.436670 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:59:16.436638    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33f41fe0_aebb_400f_af54_eb8e9cd79179.slice/crio-b14cb9952e3b5f5f00ee6b5c8dbd691855f410a42ad2b4eb30daf8cb935bedbd WatchSource:0}: Error finding container b14cb9952e3b5f5f00ee6b5c8dbd691855f410a42ad2b4eb30daf8cb935bedbd: Status 404 returned error can't find the container with id b14cb9952e3b5f5f00ee6b5c8dbd691855f410a42ad2b4eb30daf8cb935bedbd
Jul 07 14:59:16.531296 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:16.531211    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd" event={"ID":"33f41fe0-aebb-400f-af54-eb8e9cd79179","Type":"ContainerStarted","Data":"b14cb9952e3b5f5f00ee6b5c8dbd691855f410a42ad2b4eb30daf8cb935bedbd"}
Jul 07 14:59:17.538701 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.538664    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd" event={"ID":"33f41fe0-aebb-400f-af54-eb8e9cd79179","Type":"ContainerStarted","Data":"60a140ac78763ac069612e4617e4c5765e262f8bd2a6216edf9c8dd7830ea932"}
Jul 07 14:59:17.539059 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.538805    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"
Jul 07 14:59:17.559405 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.559364    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd" podStartSLOduration=2.203212896 podStartE2EDuration="2.559348094s" totalImagesPullingTime="356.135198ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:59:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:59:17.557949909 +0000 UTC m=+2112.763924038" watchObservedRunningTime="2026-07-07 14:59:17.559348094 +0000 UTC m=+2112.765322223"
Jul 07 14:59:17.779134 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.779073    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:59:17.957010 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.956968    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-podinfo\") pod \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") "
Jul 07 14:59:17.957010 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.957016    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-token\") pod \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") "
Jul 07 14:59:17.957245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.957050    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-data\") pod \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") "
Jul 07 14:59:17.957245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.957079    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-workload-certs\") pod \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") "
Jul 07 14:59:17.957245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.957177    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istiod-ca-cert\") pod \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") "
Jul 07 14:59:17.957245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.957205    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-credential-socket\") pod \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") "
Jul 07 14:59:17.957245 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.957230    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-envoy\") pod \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") "
Jul 07 14:59:17.957490 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.957254    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwk6q\" (UniqueName: \"kubernetes.io/projected/acd371f9-24d1-48a0-a6f5-14fc51c736b9-kube-api-access-lwk6q\") pod \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") "
Jul 07 14:59:17.957490 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.957275    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-workload-socket\") pod \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\" (UID: \"acd371f9-24d1-48a0-a6f5-14fc51c736b9\") "
Jul 07 14:59:17.957635 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.957543    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "acd371f9-24d1-48a0-a6f5-14fc51c736b9" (UID: "acd371f9-24d1-48a0-a6f5-14fc51c736b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:59:17.957702 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.957680    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "acd371f9-24d1-48a0-a6f5-14fc51c736b9" (UID: "acd371f9-24d1-48a0-a6f5-14fc51c736b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:59:17.957795 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.957771    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "acd371f9-24d1-48a0-a6f5-14fc51c736b9" (UID: "acd371f9-24d1-48a0-a6f5-14fc51c736b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:59:17.957872 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.957851    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "acd371f9-24d1-48a0-a6f5-14fc51c736b9" (UID: "acd371f9-24d1-48a0-a6f5-14fc51c736b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 14:59:17.958002 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.957962    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "acd371f9-24d1-48a0-a6f5-14fc51c736b9" (UID: "acd371f9-24d1-48a0-a6f5-14fc51c736b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:59:17.959431 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.959412    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "acd371f9-24d1-48a0-a6f5-14fc51c736b9" (UID: "acd371f9-24d1-48a0-a6f5-14fc51c736b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:59:17.959687 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.959671    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acd371f9-24d1-48a0-a6f5-14fc51c736b9-kube-api-access-lwk6q" (OuterVolumeSpecName: "kube-api-access-lwk6q") pod "acd371f9-24d1-48a0-a6f5-14fc51c736b9" (UID: "acd371f9-24d1-48a0-a6f5-14fc51c736b9"). InnerVolumeSpecName "kube-api-access-lwk6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 14:59:17.959881 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.959865    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "acd371f9-24d1-48a0-a6f5-14fc51c736b9" (UID: "acd371f9-24d1-48a0-a6f5-14fc51c736b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 14:59:17.959939 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:17.959879    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "acd371f9-24d1-48a0-a6f5-14fc51c736b9" (UID: "acd371f9-24d1-48a0-a6f5-14fc51c736b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 14:59:18.058224 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.058141    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istiod-ca-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:18.058224 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.058169    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-credential-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:18.058224 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.058180    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-envoy\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:18.058224 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.058189    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwk6q\" (UniqueName: \"kubernetes.io/projected/acd371f9-24d1-48a0-a6f5-14fc51c736b9-kube-api-access-lwk6q\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:18.058224 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.058198    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-workload-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:18.058224 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.058206    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-podinfo\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:18.058224 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.058213    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-token\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:18.058224 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.058221    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-istio-data\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:18.058224 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.058228    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acd371f9-24d1-48a0-a6f5-14fc51c736b9-workload-certs\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 14:59:18.546629 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.546569    2567 generic.go:356] "Generic (PLEG): container finished" podID="acd371f9-24d1-48a0-a6f5-14fc51c736b9" containerID="b93ab1a107eeeae21918d4e0ce2384152e62a956a564b58ff7bb1e017ec7efb4" exitCode=0
Jul 07 14:59:18.547138 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.546659    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"
Jul 07 14:59:18.547138 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.546670    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t" event={"ID":"acd371f9-24d1-48a0-a6f5-14fc51c736b9","Type":"ContainerDied","Data":"b93ab1a107eeeae21918d4e0ce2384152e62a956a564b58ff7bb1e017ec7efb4"}
Jul 07 14:59:18.547138 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.546774    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t" event={"ID":"acd371f9-24d1-48a0-a6f5-14fc51c736b9","Type":"ContainerDied","Data":"26d36c8f2d2a0df2d7ce42d98b21c3247b66c1e506dded0281fd822c9cf16b78"}
Jul 07 14:59:18.547138 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.546809    2567 scope.go:117] "RemoveContainer" containerID="b93ab1a107eeeae21918d4e0ce2384152e62a956a564b58ff7bb1e017ec7efb4"
Jul 07 14:59:18.556864 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.556846    2567 scope.go:117] "RemoveContainer" containerID="74828b463de45707cdd2383d20a0b03f93f167bbb50b34eeb5c9368b36bb9b0a"
Jul 07 14:59:18.565094 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.565077    2567 scope.go:117] "RemoveContainer" containerID="b93ab1a107eeeae21918d4e0ce2384152e62a956a564b58ff7bb1e017ec7efb4"
Jul 07 14:59:18.565336 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:59:18.565317    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b93ab1a107eeeae21918d4e0ce2384152e62a956a564b58ff7bb1e017ec7efb4\": container with ID starting with b93ab1a107eeeae21918d4e0ce2384152e62a956a564b58ff7bb1e017ec7efb4 not found: ID does not exist" containerID="b93ab1a107eeeae21918d4e0ce2384152e62a956a564b58ff7bb1e017ec7efb4"
Jul 07 14:59:18.565374 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.565348    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b93ab1a107eeeae21918d4e0ce2384152e62a956a564b58ff7bb1e017ec7efb4"} err="failed to get container status \"b93ab1a107eeeae21918d4e0ce2384152e62a956a564b58ff7bb1e017ec7efb4\": rpc error: code = NotFound desc = could not find container \"b93ab1a107eeeae21918d4e0ce2384152e62a956a564b58ff7bb1e017ec7efb4\": container with ID starting with b93ab1a107eeeae21918d4e0ce2384152e62a956a564b58ff7bb1e017ec7efb4 not found: ID does not exist"
Jul 07 14:59:18.565374 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.565365    2567 scope.go:117] "RemoveContainer" containerID="74828b463de45707cdd2383d20a0b03f93f167bbb50b34eeb5c9368b36bb9b0a"
Jul 07 14:59:18.565638 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:59:18.565616    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74828b463de45707cdd2383d20a0b03f93f167bbb50b34eeb5c9368b36bb9b0a\": container with ID starting with 74828b463de45707cdd2383d20a0b03f93f167bbb50b34eeb5c9368b36bb9b0a not found: ID does not exist" containerID="74828b463de45707cdd2383d20a0b03f93f167bbb50b34eeb5c9368b36bb9b0a"
Jul 07 14:59:18.565712 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.565645    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74828b463de45707cdd2383d20a0b03f93f167bbb50b34eeb5c9368b36bb9b0a"} err="failed to get container status \"74828b463de45707cdd2383d20a0b03f93f167bbb50b34eeb5c9368b36bb9b0a\": rpc error: code = NotFound desc = could not find container \"74828b463de45707cdd2383d20a0b03f93f167bbb50b34eeb5c9368b36bb9b0a\": container with ID starting with 74828b463de45707cdd2383d20a0b03f93f167bbb50b34eeb5c9368b36bb9b0a not found: ID does not exist"
Jul 07 14:59:18.571400 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.571376    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"]
Jul 07 14:59:18.577280 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:18.577258    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-d09310-openshift-default-677948f6c5-fvn6t"]
Jul 07 14:59:19.296937 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:19.296901    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acd371f9-24d1-48a0-a6f5-14fc51c736b9" path="/var/lib/kubelet/pods/acd371f9-24d1-48a0-a6f5-14fc51c736b9/volumes"
Jul 07 14:59:20.991060 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:20.991030    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"]
Jul 07 14:59:20.991424 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:20.991389    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acd371f9-24d1-48a0-a6f5-14fc51c736b9" containerName="istio-proxy"
Jul 07 14:59:20.991424 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:20.991400    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="acd371f9-24d1-48a0-a6f5-14fc51c736b9" containerName="istio-proxy"
Jul 07 14:59:20.991424 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:20.991413    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" containerName="istio-proxy"
Jul 07 14:59:20.991424 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:20.991418    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" containerName="istio-proxy"
Jul 07 14:59:20.991553 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:20.991428    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acd371f9-24d1-48a0-a6f5-14fc51c736b9" containerName="istio-proxy"
Jul 07 14:59:20.991553 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:20.991434    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="acd371f9-24d1-48a0-a6f5-14fc51c736b9" containerName="istio-proxy"
Jul 07 14:59:20.991553 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:20.991506    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="acd371f9-24d1-48a0-a6f5-14fc51c736b9" containerName="istio-proxy"
Jul 07 14:59:20.991553 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:20.991515    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b46fcce-7fbc-42a6-8ffd-925c21c94a0f" containerName="istio-proxy"
Jul 07 14:59:20.996165 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:20.996145    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:20.999659 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:20.999129    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 14:59:20.999659 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:20.999381    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-537d76-openshift-default-dockercfg-b7964\""
Jul 07 14:59:21.012362 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.012336    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"]
Jul 07 14:59:21.085073 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.085032    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-envoy\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.085073 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.085071    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-token\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.085296 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.085094    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-workload-socket\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.085296 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.085147    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istiod-ca-cert\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.085296 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.085165    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-data\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.085296 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.085184    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kvqh\" (UniqueName: \"kubernetes.io/projected/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-kube-api-access-4kvqh\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.085296 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.085207    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-credential-socket\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.085296 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.085221    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-workload-certs\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.085296 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.085273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-podinfo\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.185761 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.185721    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-envoy\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.185761 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.185768    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-token\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.186036 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.185903    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-workload-socket\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.186036 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.185991    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istiod-ca-cert\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.186036 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.186029    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-data\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.186191 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.186054    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kvqh\" (UniqueName: \"kubernetes.io/projected/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-kube-api-access-4kvqh\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.186191 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.186098    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-credential-socket\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.186191 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.186123    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-workload-certs\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.186191 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.186170    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-podinfo\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.186473 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.186445    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-data\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.186541 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.186512    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-workload-certs\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.186644 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.186557    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-credential-socket\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.186741 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.186724    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-workload-socket\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.186791 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.186769    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istiod-ca-cert\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.188269 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.188245    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-envoy\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.188791 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.188774    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-podinfo\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.198438 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.198411    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kvqh\" (UniqueName: \"kubernetes.io/projected/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-kube-api-access-4kvqh\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.198840 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.198818    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-token\") pod \"e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") " pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.308235 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.308145    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:21.459300 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.459276    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"]
Jul 07 14:59:21.461171 ip-10-0-139-48 kubenswrapper[2567]: W0707 14:59:21.461137    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3792dd0_9ab6_4701_a4ea_b8eb8d232ba2.slice/crio-08308561d77fdc3df5dce84f48cfe68d078e099f04e6331dfca9fcae60c9666a WatchSource:0}: Error finding container 08308561d77fdc3df5dce84f48cfe68d078e099f04e6331dfca9fcae60c9666a: Status 404 returned error can't find the container with id 08308561d77fdc3df5dce84f48cfe68d078e099f04e6331dfca9fcae60c9666a
Jul 07 14:59:21.463366 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.463334    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:59:21.463474 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.463411    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:59:21.463474 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.463440    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:59:21.565278 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.565176    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs" event={"ID":"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2","Type":"ContainerStarted","Data":"d00eb7d2c2d11681f9e6f13d6d0753c548efe1e9c21b4e71926c427f06bc6e1b"}
Jul 07 14:59:21.565278 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.565246    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs" event={"ID":"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2","Type":"ContainerStarted","Data":"08308561d77fdc3df5dce84f48cfe68d078e099f04e6331dfca9fcae60c9666a"}
Jul 07 14:59:21.591546 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:21.591496    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs" podStartSLOduration=1.591477179 podStartE2EDuration="1.591477179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:59:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:59:21.589997296 +0000 UTC m=+2116.795971426" watchObservedRunningTime="2026-07-07 14:59:21.591477179 +0000 UTC m=+2116.797451310"
Jul 07 14:59:22.211181 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:59:22.211136    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f2e82c_9733_4e85_9bc2_7c8400c7a967.slice/crio-5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997\": RecentStats: unable to find data in memory cache]"
Jul 07 14:59:22.309024 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:22.308992    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:22.313919 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:22.313893    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:22.570685 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:22.570571    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:22.571720 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:22.571699    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:23.552184 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:23.552158    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"
Jul 07 14:59:23.818724 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:23.818637    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:59:25.924692 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:59:25.924659    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f2e82c_9733_4e85_9bc2_7c8400c7a967.slice/crio-5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997\": RecentStats: unable to find data in memory cache]"
Jul 07 14:59:32.261344 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:59:32.261304    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f2e82c_9733_4e85_9bc2_7c8400c7a967.slice/crio-5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997\": RecentStats: unable to find data in memory cache]"
Jul 07 14:59:36.469481 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:36.469446    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:59:38.284127 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:38.283460    2567 patch_prober.go:28] interesting pod/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": read tcp 10.132.0.2:50778->10.132.0.59:15021: read: connection reset by peer" start-of-body=
Jul 07 14:59:38.284127 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:38.283525    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs" podUID="a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": read tcp 10.132.0.2:50778->10.132.0.59:15021: read: connection reset by peer"
Jul 07 14:59:38.674865 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:38.674833    2567 generic.go:356] "Generic (PLEG): container finished" podID="a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" containerID="d00eb7d2c2d11681f9e6f13d6d0753c548efe1e9c21b4e71926c427f06bc6e1b" exitCode=0
Jul 07 14:59:38.675036 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:38.674888    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs" event={"ID":"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2","Type":"ContainerDied","Data":"d00eb7d2c2d11681f9e6f13d6d0753c548efe1e9c21b4e71926c427f06bc6e1b"}
Jul 07 14:59:38.675322 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:38.675303    2567 scope.go:117] "RemoveContainer" containerID="d00eb7d2c2d11681f9e6f13d6d0753c548efe1e9c21b4e71926c427f06bc6e1b"
Jul 07 14:59:38.676442 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:38.676415    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:59:38.676509 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:38.676489    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:59:38.676546 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:38.676523    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 07 14:59:39.681561 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:39.681524    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs" event={"ID":"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2","Type":"ContainerStarted","Data":"750a50d37e92972eca3bbb91dd5f01dbd25dd94f5b8f940fb5f0d0342a5ff419"}
Jul 07 14:59:40.309036 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:40.308993    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:40.309369 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:40.309057    2567 patch_prober.go:28] interesting pod/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 07 14:59:40.309582 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:40.309542    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs" podUID="a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 07 14:59:40.957885 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:59:40.957848    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f2e82c_9733_4e85_9bc2_7c8400c7a967.slice/crio-5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997\": RecentStats: unable to find data in memory cache]"
Jul 07 14:59:41.308662 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:41.308546    2567 patch_prober.go:28] interesting pod/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 07 14:59:41.308943 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:41.308910    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs" podUID="a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 07 14:59:42.270776 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:59:42.270745    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f2e82c_9733_4e85_9bc2_7c8400c7a967.slice/crio-5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997\": RecentStats: unable to find data in memory cache]"
Jul 07 14:59:42.308825 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:42.308779    2567 patch_prober.go:28] interesting pod/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 07 14:59:42.309034 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:42.308865    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs" podUID="a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 07 14:59:43.308611 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:43.308558    2567 patch_prober.go:28] interesting pod/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 07 14:59:43.309212 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:43.309178    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs" podUID="a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 07 14:59:44.312356 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:44.312318    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:44.312822 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:44.312702    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:44.313424 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:44.313408    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 14:59:46.371221 ip-10-0-139-48 kubenswrapper[2567]: I0707 14:59:46.371189    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 14:59:52.318623 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:59:52.318572    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f2e82c_9733_4e85_9bc2_7c8400c7a967.slice/crio-5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997\": RecentStats: unable to find data in memory cache]"
Jul 07 14:59:55.930579 ip-10-0-139-48 kubenswrapper[2567]: E0707 14:59:55.930541    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f2e82c_9733_4e85_9bc2_7c8400c7a967.slice/crio-5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997\": RecentStats: unable to find data in memory cache]"
Jul 07 15:00:00.142910 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.142821    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp"]
Jul 07 15:00:00.143357 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.143281    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="acd371f9-24d1-48a0-a6f5-14fc51c736b9" containerName="istio-proxy"
Jul 07 15:00:00.147353 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.147334    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29723940-xdxlm"]
Jul 07 15:00:00.147478 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.147454    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp"
Jul 07 15:00:00.150499 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.150482    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723940-xdxlm"
Jul 07 15:00:00.157268 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.157240    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp"]
Jul 07 15:00:00.160557 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.160531    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723940-xdxlm"]
Jul 07 15:00:00.230641 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.230574    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq5nl\" (UniqueName: \"kubernetes.io/projected/2a9b6ac7-479d-442d-bc53-ffa947de4325-kube-api-access-lq5nl\") pod \"maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp\" (UID: \"2a9b6ac7-479d-442d-bc53-ffa947de4325\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp"
Jul 07 15:00:00.230830 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.230671    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj7vv\" (UniqueName: \"kubernetes.io/projected/9162417b-ab0a-4ed9-a80c-3bb1d16fb3df-kube-api-access-jj7vv\") pod \"maas-api-key-cleanup-29723940-xdxlm\" (UID: \"9162417b-ab0a-4ed9-a80c-3bb1d16fb3df\") " pod="opendatahub/maas-api-key-cleanup-29723940-xdxlm"
Jul 07 15:00:00.331320 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.331283    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq5nl\" (UniqueName: \"kubernetes.io/projected/2a9b6ac7-479d-442d-bc53-ffa947de4325-kube-api-access-lq5nl\") pod \"maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp\" (UID: \"2a9b6ac7-479d-442d-bc53-ffa947de4325\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp"
Jul 07 15:00:00.331500 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.331338    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7vv\" (UniqueName: \"kubernetes.io/projected/9162417b-ab0a-4ed9-a80c-3bb1d16fb3df-kube-api-access-jj7vv\") pod \"maas-api-key-cleanup-29723940-xdxlm\" (UID: \"9162417b-ab0a-4ed9-a80c-3bb1d16fb3df\") " pod="opendatahub/maas-api-key-cleanup-29723940-xdxlm"
Jul 07 15:00:00.341926 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.341894    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq5nl\" (UniqueName: \"kubernetes.io/projected/2a9b6ac7-479d-442d-bc53-ffa947de4325-kube-api-access-lq5nl\") pod \"maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp\" (UID: \"2a9b6ac7-479d-442d-bc53-ffa947de4325\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp"
Jul 07 15:00:00.341926 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.341921    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj7vv\" (UniqueName: \"kubernetes.io/projected/9162417b-ab0a-4ed9-a80c-3bb1d16fb3df-kube-api-access-jj7vv\") pod \"maas-api-key-cleanup-29723940-xdxlm\" (UID: \"9162417b-ab0a-4ed9-a80c-3bb1d16fb3df\") " pod="opendatahub/maas-api-key-cleanup-29723940-xdxlm"
Jul 07 15:00:00.461703 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.461653    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp"
Jul 07 15:00:00.470064 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.470038    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723940-xdxlm"
Jul 07 15:00:00.609195 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.609166    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp"]
Jul 07 15:00:00.612623 ip-10-0-139-48 kubenswrapper[2567]: W0707 15:00:00.612565    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a9b6ac7_479d_442d_bc53_ffa947de4325.slice/crio-cd865eb1a2142bfc6702d6f5e37bc46eb230b35079975e00632bae33033bdbde WatchSource:0}: Error finding container cd865eb1a2142bfc6702d6f5e37bc46eb230b35079975e00632bae33033bdbde: Status 404 returned error can't find the container with id cd865eb1a2142bfc6702d6f5e37bc46eb230b35079975e00632bae33033bdbde
Jul 07 15:00:00.639613 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.636322    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29723940-xdxlm"]
Jul 07 15:00:00.786847 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.786752    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723940-xdxlm" event={"ID":"9162417b-ab0a-4ed9-a80c-3bb1d16fb3df","Type":"ContainerStarted","Data":"f78f5d871cc453c05fc1ada0d7f1f25654fbe448b960863e6c4fce9cdc29f477"}
Jul 07 15:00:00.787929 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:00.787897    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp" event={"ID":"2a9b6ac7-479d-442d-bc53-ffa947de4325","Type":"ContainerStarted","Data":"cd865eb1a2142bfc6702d6f5e37bc46eb230b35079975e00632bae33033bdbde"}
Jul 07 15:00:01.794499 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:01.794459    2567 generic.go:356] "Generic (PLEG): container finished" podID="9162417b-ab0a-4ed9-a80c-3bb1d16fb3df" containerID="bceed032450ef70ddbcdee7f75098deb74ca2c4d77da12e52831c9252b72a1fc" exitCode=0
Jul 07 15:00:01.794941 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:01.794542    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723940-xdxlm" event={"ID":"9162417b-ab0a-4ed9-a80c-3bb1d16fb3df","Type":"ContainerDied","Data":"bceed032450ef70ddbcdee7f75098deb74ca2c4d77da12e52831c9252b72a1fc"}
Jul 07 15:00:01.796083 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:01.796055    2567 generic.go:356] "Generic (PLEG): container finished" podID="2a9b6ac7-479d-442d-bc53-ffa947de4325" containerID="dbed3b3afc08bbba3369b187a465276af1b7f2adb5150e94c55272743cbf06f1" exitCode=0
Jul 07 15:00:01.796214 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:01.796117    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp" event={"ID":"2a9b6ac7-479d-442d-bc53-ffa947de4325","Type":"ContainerDied","Data":"dbed3b3afc08bbba3369b187a465276af1b7f2adb5150e94c55272743cbf06f1"}
Jul 07 15:00:02.368544 ip-10-0-139-48 kubenswrapper[2567]: E0707 15:00:02.368505    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f2e82c_9733_4e85_9bc2_7c8400c7a967.slice/crio-5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997\": RecentStats: unable to find data in memory cache]"
Jul 07 15:00:02.964517 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:02.964490    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp"
Jul 07 15:00:02.967498 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:02.967476    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723940-xdxlm"
Jul 07 15:00:03.056986 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:03.056889    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jj7vv\" (UniqueName: \"kubernetes.io/projected/9162417b-ab0a-4ed9-a80c-3bb1d16fb3df-kube-api-access-jj7vv\") pod \"9162417b-ab0a-4ed9-a80c-3bb1d16fb3df\" (UID: \"9162417b-ab0a-4ed9-a80c-3bb1d16fb3df\") "
Jul 07 15:00:03.057138 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:03.056985    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq5nl\" (UniqueName: \"kubernetes.io/projected/2a9b6ac7-479d-442d-bc53-ffa947de4325-kube-api-access-lq5nl\") pod \"2a9b6ac7-479d-442d-bc53-ffa947de4325\" (UID: \"2a9b6ac7-479d-442d-bc53-ffa947de4325\") "
Jul 07 15:00:03.059213 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:03.059178    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a9b6ac7-479d-442d-bc53-ffa947de4325-kube-api-access-lq5nl" (OuterVolumeSpecName: "kube-api-access-lq5nl") pod "2a9b6ac7-479d-442d-bc53-ffa947de4325" (UID: "2a9b6ac7-479d-442d-bc53-ffa947de4325"). InnerVolumeSpecName "kube-api-access-lq5nl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:00:03.059347 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:03.059246    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9162417b-ab0a-4ed9-a80c-3bb1d16fb3df-kube-api-access-jj7vv" (OuterVolumeSpecName: "kube-api-access-jj7vv") pod "9162417b-ab0a-4ed9-a80c-3bb1d16fb3df" (UID: "9162417b-ab0a-4ed9-a80c-3bb1d16fb3df"). InnerVolumeSpecName "kube-api-access-jj7vv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:00:03.158306 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:03.158261    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq5nl\" (UniqueName: \"kubernetes.io/projected/2a9b6ac7-479d-442d-bc53-ffa947de4325-kube-api-access-lq5nl\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 15:00:03.158306 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:03.158303    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jj7vv\" (UniqueName: \"kubernetes.io/projected/9162417b-ab0a-4ed9-a80c-3bb1d16fb3df-kube-api-access-jj7vv\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 15:00:03.509180 ip-10-0-139-48 kubenswrapper[2567]: E0707 15:00:03.509134    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f2e82c_9733_4e85_9bc2_7c8400c7a967.slice/crio-5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997\": RecentStats: unable to find data in memory cache]"
Jul 07 15:00:03.509525 ip-10-0-139-48 kubenswrapper[2567]: E0707 15:00:03.509500    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f2e82c_9733_4e85_9bc2_7c8400c7a967.slice/crio-5fb33071b28c4896bb89243f89cb5e5bd1f83be61927736b274b5035478b9997\": RecentStats: unable to find data in memory cache]"
Jul 07 15:00:03.808537 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:03.808452    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29723940-xdxlm"
Jul 07 15:00:03.808537 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:03.808482    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29723940-xdxlm" event={"ID":"9162417b-ab0a-4ed9-a80c-3bb1d16fb3df","Type":"ContainerDied","Data":"f78f5d871cc453c05fc1ada0d7f1f25654fbe448b960863e6c4fce9cdc29f477"}
Jul 07 15:00:03.808537 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:03.808530    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f78f5d871cc453c05fc1ada0d7f1f25654fbe448b960863e6c4fce9cdc29f477"
Jul 07 15:00:03.809876 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:03.809848    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp" event={"ID":"2a9b6ac7-479d-442d-bc53-ffa947de4325","Type":"ContainerDied","Data":"cd865eb1a2142bfc6702d6f5e37bc46eb230b35079975e00632bae33033bdbde"}
Jul 07 15:00:03.809988 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:03.809894    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd865eb1a2142bfc6702d6f5e37bc46eb230b35079975e00632bae33033bdbde"
Jul 07 15:00:03.809988 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:03.809862    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp"
Jul 07 15:00:14.375110 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:14.375076    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:00:31.967370 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:31.967335    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:00:47.866386 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:00:47.866352    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:01:02.508169 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:01:02.508133    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:01:18.375805 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:01:18.375757    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:01:33.674572 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:01:33.674493    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:01:51.472660 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:01:51.472621    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:02:08.396034 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:02:08.395999    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:02:26.364603 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:02:26.364557    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:03:29.864694 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:03:29.864662    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:03:42.866492 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:03:42.866455    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:04:03.107690 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:04:03.107648    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:04:05.468642 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:04:05.468571    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 15:04:05.474066 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:04:05.474040    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 15:04:17.174803 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:04:17.174767    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:04:36.169568 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:04:36.169477    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:05:00.061752 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:00.061709    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:05:13.582242 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:13.582206    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:05:24.555496 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:24.555463    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"]
Jul 07 15:05:24.555984 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:24.555788    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd" podUID="33f41fe0-aebb-400f-af54-eb8e9cd79179" containerName="maas-api" containerID="cri-o://60a140ac78763ac069612e4617e4c5765e262f8bd2a6216edf9c8dd7830ea932" gracePeriod=30
Jul 07 15:05:24.803917 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:24.803877    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"
Jul 07 15:05:24.871913 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:24.871827    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33f41fe0-aebb-400f-af54-eb8e9cd79179-maas-api-tls\") pod \"33f41fe0-aebb-400f-af54-eb8e9cd79179\" (UID: \"33f41fe0-aebb-400f-af54-eb8e9cd79179\") "
Jul 07 15:05:24.871913 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:24.871908    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f41fe0-aebb-400f-af54-eb8e9cd79179-openshift-service-ca\") pod \"33f41fe0-aebb-400f-af54-eb8e9cd79179\" (UID: \"33f41fe0-aebb-400f-af54-eb8e9cd79179\") "
Jul 07 15:05:24.872110 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:24.871960    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvndp\" (UniqueName: \"kubernetes.io/projected/33f41fe0-aebb-400f-af54-eb8e9cd79179-kube-api-access-bvndp\") pod \"33f41fe0-aebb-400f-af54-eb8e9cd79179\" (UID: \"33f41fe0-aebb-400f-af54-eb8e9cd79179\") "
Jul 07 15:05:24.872281 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:24.872256    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33f41fe0-aebb-400f-af54-eb8e9cd79179-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "33f41fe0-aebb-400f-af54-eb8e9cd79179" (UID: "33f41fe0-aebb-400f-af54-eb8e9cd79179"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:05:24.874165 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:24.874135    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33f41fe0-aebb-400f-af54-eb8e9cd79179-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "33f41fe0-aebb-400f-af54-eb8e9cd79179" (UID: "33f41fe0-aebb-400f-af54-eb8e9cd79179"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:05:24.874299 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:24.874179    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33f41fe0-aebb-400f-af54-eb8e9cd79179-kube-api-access-bvndp" (OuterVolumeSpecName: "kube-api-access-bvndp") pod "33f41fe0-aebb-400f-af54-eb8e9cd79179" (UID: "33f41fe0-aebb-400f-af54-eb8e9cd79179"). InnerVolumeSpecName "kube-api-access-bvndp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:05:24.972753 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:24.972716    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33f41fe0-aebb-400f-af54-eb8e9cd79179-openshift-service-ca\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 15:05:24.972753 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:24.972745    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvndp\" (UniqueName: \"kubernetes.io/projected/33f41fe0-aebb-400f-af54-eb8e9cd79179-kube-api-access-bvndp\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 15:05:24.972753 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:24.972757    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33f41fe0-aebb-400f-af54-eb8e9cd79179-maas-api-tls\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 15:05:25.426287 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:25.426249    2567 generic.go:356] "Generic (PLEG): container finished" podID="33f41fe0-aebb-400f-af54-eb8e9cd79179" containerID="60a140ac78763ac069612e4617e4c5765e262f8bd2a6216edf9c8dd7830ea932" exitCode=0
Jul 07 15:05:25.426465 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:25.426294    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"
Jul 07 15:05:25.426465 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:25.426329    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd" event={"ID":"33f41fe0-aebb-400f-af54-eb8e9cd79179","Type":"ContainerDied","Data":"60a140ac78763ac069612e4617e4c5765e262f8bd2a6216edf9c8dd7830ea932"}
Jul 07 15:05:25.426465 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:25.426386    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd" event={"ID":"33f41fe0-aebb-400f-af54-eb8e9cd79179","Type":"ContainerDied","Data":"b14cb9952e3b5f5f00ee6b5c8dbd691855f410a42ad2b4eb30daf8cb935bedbd"}
Jul 07 15:05:25.426465 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:25.426415    2567 scope.go:117] "RemoveContainer" containerID="60a140ac78763ac069612e4617e4c5765e262f8bd2a6216edf9c8dd7830ea932"
Jul 07 15:05:25.435516 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:25.435501    2567 scope.go:117] "RemoveContainer" containerID="60a140ac78763ac069612e4617e4c5765e262f8bd2a6216edf9c8dd7830ea932"
Jul 07 15:05:25.435799 ip-10-0-139-48 kubenswrapper[2567]: E0707 15:05:25.435773    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60a140ac78763ac069612e4617e4c5765e262f8bd2a6216edf9c8dd7830ea932\": container with ID starting with 60a140ac78763ac069612e4617e4c5765e262f8bd2a6216edf9c8dd7830ea932 not found: ID does not exist" containerID="60a140ac78763ac069612e4617e4c5765e262f8bd2a6216edf9c8dd7830ea932"
Jul 07 15:05:25.435914 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:25.435809    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a140ac78763ac069612e4617e4c5765e262f8bd2a6216edf9c8dd7830ea932"} err="failed to get container status \"60a140ac78763ac069612e4617e4c5765e262f8bd2a6216edf9c8dd7830ea932\": rpc error: code = NotFound desc = could not find container \"60a140ac78763ac069612e4617e4c5765e262f8bd2a6216edf9c8dd7830ea932\": container with ID starting with 60a140ac78763ac069612e4617e4c5765e262f8bd2a6216edf9c8dd7830ea932 not found: ID does not exist"
Jul 07 15:05:25.447170 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:25.447144    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"]
Jul 07 15:05:25.452872 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:25.452847    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-82db1a-85475db4cc-gwxwd"]
Jul 07 15:05:27.298215 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:27.298177    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33f41fe0-aebb-400f-af54-eb8e9cd79179" path="/var/lib/kubelet/pods/33f41fe0-aebb-400f-af54-eb8e9cd79179/volumes"
Jul 07 15:05:28.166237 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:05:28.166203    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:06:09.567562 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:09.567528    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp"]
Jul 07 15:06:09.573055 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:09.573032    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-537d76-29723940-cv7tp"]
Jul 07 15:06:11.297195 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:11.297149    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a9b6ac7-479d-442d-bc53-ffa947de4325" path="/var/lib/kubelet/pods/2a9b6ac7-479d-442d-bc53-ffa947de4325/volumes"
Jul 07 15:06:11.985097 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:11.985062    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-drhvz"]
Jul 07 15:06:16.500459 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:16.500420    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"]
Jul 07 15:06:16.500949 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:16.500747    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs" podUID="a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" containerName="istio-proxy" containerID="cri-o://750a50d37e92972eca3bbb91dd5f01dbd25dd94f5b8f940fb5f0d0342a5ff419" gracePeriod=30
Jul 07 15:06:21.699663 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.699621    2567 generic.go:356] "Generic (PLEG): container finished" podID="a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" containerID="750a50d37e92972eca3bbb91dd5f01dbd25dd94f5b8f940fb5f0d0342a5ff419" exitCode=0
Jul 07 15:06:21.700019 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.699637    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs" event={"ID":"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2","Type":"ContainerDied","Data":"750a50d37e92972eca3bbb91dd5f01dbd25dd94f5b8f940fb5f0d0342a5ff419"}
Jul 07 15:06:21.700019 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.699760    2567 scope.go:117] "RemoveContainer" containerID="d00eb7d2c2d11681f9e6f13d6d0753c548efe1e9c21b4e71926c427f06bc6e1b"
Jul 07 15:06:21.761082 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.761056    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 15:06:21.870097 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.869999    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-workload-socket\") pod \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") "
Jul 07 15:06:21.870097 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.870037    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-podinfo\") pod \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") "
Jul 07 15:06:21.870097 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.870088    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-data\") pod \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") "
Jul 07 15:06:21.870389 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.870138    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kvqh\" (UniqueName: \"kubernetes.io/projected/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-kube-api-access-4kvqh\") pod \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") "
Jul 07 15:06:21.870389 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.870184    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-token\") pod \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") "
Jul 07 15:06:21.870389 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.870210    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-envoy\") pod \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") "
Jul 07 15:06:21.870389 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.870244    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-credential-socket\") pod \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") "
Jul 07 15:06:21.870389 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.870271    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-workload-certs\") pod \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") "
Jul 07 15:06:21.870389 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.870295    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istiod-ca-cert\") pod \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\" (UID: \"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2\") "
Jul 07 15:06:21.870389 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.870330    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" (UID: "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:06:21.870792 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.870672    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-workload-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 15:06:21.870792 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.870670    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" (UID: "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:06:21.870792 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.870684    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" (UID: "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:06:21.871114 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.870908    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" (UID: "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:06:21.871926 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.871895    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-data" (OuterVolumeSpecName: "istio-data") pod "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" (UID: "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:06:21.872649 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.872609    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-kube-api-access-4kvqh" (OuterVolumeSpecName: "kube-api-access-4kvqh") pod "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" (UID: "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2"). InnerVolumeSpecName "kube-api-access-4kvqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:06:21.872735 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.872696    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" (UID: "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 15:06:21.872850 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.872833    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-token" (OuterVolumeSpecName: "istio-token") pod "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" (UID: "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:06:21.872928 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.872915    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" (UID: "a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:06:21.971339 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.971299    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-podinfo\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 15:06:21.971339 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.971329    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-data\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 15:06:21.971339 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.971339    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kvqh\" (UniqueName: \"kubernetes.io/projected/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-kube-api-access-4kvqh\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 15:06:21.971339 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.971350    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-token\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 15:06:21.971748 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.971359    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istio-envoy\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 15:06:21.971748 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.971367    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-credential-socket\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 15:06:21.971748 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.971374    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-workload-certs\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 15:06:21.971748 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:21.971382    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2-istiod-ca-cert\") on node \"ip-10-0-139-48.ec2.internal\" DevicePath \"\""
Jul 07 15:06:22.024364 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:22.024318    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qggrw_05ad9a6a-6f93-423f-9260-e456ce15339c/manager/0.log"
Jul 07 15:06:22.165478 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:22.165452    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4hlgb_62869e62-4787-495c-bf1f-904935df387c/manager/0.log"
Jul 07 15:06:22.444171 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:22.444089    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723925-prwqb_dbbd0031-301d-44a7-a368-0e652eb72165/cleanup/0.log"
Jul 07 15:06:22.559383 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:22.559356    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723940-xdxlm_9162417b-ab0a-4ed9-a80c-3bb1d16fb3df/cleanup/0.log"
Jul 07 15:06:22.706281 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:22.706208    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"
Jul 07 15:06:22.706719 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:22.706205    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs" event={"ID":"a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2","Type":"ContainerDied","Data":"08308561d77fdc3df5dce84f48cfe68d078e099f04e6331dfca9fcae60c9666a"}
Jul 07 15:06:22.706719 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:22.706336    2567 scope.go:117] "RemoveContainer" containerID="750a50d37e92972eca3bbb91dd5f01dbd25dd94f5b8f940fb5f0d0342a5ff419"
Jul 07 15:06:22.746120 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:22.746093    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"]
Jul 07 15:06:22.757883 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:22.757861    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-537d76-openshift-default-5985d67ff5-c8xqs"]
Jul 07 15:06:22.872706 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:22.872678    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jv86q_c4653351-bbcb-4253-9a9d-31cf77dd7663/server/0.log"
Jul 07 15:06:23.003863 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:23.003779    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9rchv_f87872ae-8a93-48c2-b65a-1620cadde5e2/manager/0.log"
Jul 07 15:06:23.138013 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:23.137981    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f546bc4-7hrb8_490ce88c-25d5-4b0c-8036-7341ddf0b1c5/copy-manifests/0.log"
Jul 07 15:06:23.158649 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:23.158617    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f546bc4-7hrb8_490ce88c-25d5-4b0c-8036-7341ddf0b1c5/manager/0.log"
Jul 07 15:06:23.298458 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:23.298370    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" path="/var/lib/kubelet/pods/a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2/volumes"
Jul 07 15:06:25.175505 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:25.175470    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hmwst_f59eea95-96d6-4240-a114-6a8086095b57/manager/0.log"
Jul 07 15:06:25.299204 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:25.299168    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-g9d88_22c5ec46-b098-4a03-b15a-dccbb2e70633/manager/0.log"
Jul 07 15:06:25.553885 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:25.553790    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gq5vw_e88c0219-8d24-451f-934d-0323169f6718/registry-server/0.log"
Jul 07 15:06:25.710671 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:25.710635    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vdpgc_2ea57ae0-5122-4176-9088-46de388c0c63/manager/0.log"
Jul 07 15:06:25.865349 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:25.865269    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-drhvz_d2c6668c-2d32-494c-9304-03d0b2ea7b5e/limitador/0.log"
Jul 07 15:06:25.992867 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:25.992839    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-klhxb_c325f1d6-139e-4191-b3c7-375bb76fa1ec/manager/0.log"
Jul 07 15:06:26.628172 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:26.628142    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f67c6995-qjcf8_fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6/kube-auth-proxy/0.log"
Jul 07 15:06:27.318178 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:27.318153    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5df69cc7c9-xdxbd_ec46e625-a505-4243-97cd-b319c114f668/router/0.log"
Jul 07 15:06:32.341608 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.341559    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qxj2b/must-gather-tkh59"]
Jul 07 15:06:32.342005 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.341954    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a9b6ac7-479d-442d-bc53-ffa947de4325" containerName="cleanup"
Jul 07 15:06:32.342005 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.341968    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a9b6ac7-479d-442d-bc53-ffa947de4325" containerName="cleanup"
Jul 07 15:06:32.342005 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.341976    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f41fe0-aebb-400f-af54-eb8e9cd79179" containerName="maas-api"
Jul 07 15:06:32.342005 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.341982    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f41fe0-aebb-400f-af54-eb8e9cd79179" containerName="maas-api"
Jul 07 15:06:32.342005 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.341988    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" containerName="istio-proxy"
Jul 07 15:06:32.342005 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.341994    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" containerName="istio-proxy"
Jul 07 15:06:32.342005 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.342006    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9162417b-ab0a-4ed9-a80c-3bb1d16fb3df" containerName="cleanup"
Jul 07 15:06:32.342223 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.342011    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9162417b-ab0a-4ed9-a80c-3bb1d16fb3df" containerName="cleanup"
Jul 07 15:06:32.342223 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.342023    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" containerName="istio-proxy"
Jul 07 15:06:32.342223 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.342028    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" containerName="istio-proxy"
Jul 07 15:06:32.342223 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.342079    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" containerName="istio-proxy"
Jul 07 15:06:32.342223 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.342089    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="33f41fe0-aebb-400f-af54-eb8e9cd79179" containerName="maas-api"
Jul 07 15:06:32.342223 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.342095    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9162417b-ab0a-4ed9-a80c-3bb1d16fb3df" containerName="cleanup"
Jul 07 15:06:32.342223 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.342101    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a9b6ac7-479d-442d-bc53-ffa947de4325" containerName="cleanup"
Jul 07 15:06:32.342223 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.342208    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3792dd0-9ab6-4701-a4ea-b8eb8d232ba2" containerName="istio-proxy"
Jul 07 15:06:32.346740 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.346722    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qxj2b/must-gather-tkh59"
Jul 07 15:06:32.355618 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.355579    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qxj2b\"/\"default-dockercfg-q76xq\""
Jul 07 15:06:32.355738 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.355615    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qxj2b\"/\"kube-root-ca.crt\""
Jul 07 15:06:32.355738 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.355673    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qxj2b\"/\"openshift-service-ca.crt\""
Jul 07 15:06:32.362794 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.362772    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qxj2b/must-gather-tkh59"]
Jul 07 15:06:32.461661 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.461627    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/badad4e2-1e7e-4ce1-aa52-73051bffecff-must-gather-output\") pod \"must-gather-tkh59\" (UID: \"badad4e2-1e7e-4ce1-aa52-73051bffecff\") " pod="openshift-must-gather-qxj2b/must-gather-tkh59"
Jul 07 15:06:32.461845 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.461692    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f96p\" (UniqueName: \"kubernetes.io/projected/badad4e2-1e7e-4ce1-aa52-73051bffecff-kube-api-access-6f96p\") pod \"must-gather-tkh59\" (UID: \"badad4e2-1e7e-4ce1-aa52-73051bffecff\") " pod="openshift-must-gather-qxj2b/must-gather-tkh59"
Jul 07 15:06:32.563129 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.563085    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/badad4e2-1e7e-4ce1-aa52-73051bffecff-must-gather-output\") pod \"must-gather-tkh59\" (UID: \"badad4e2-1e7e-4ce1-aa52-73051bffecff\") " pod="openshift-must-gather-qxj2b/must-gather-tkh59"
Jul 07 15:06:32.563299 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.563149    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f96p\" (UniqueName: \"kubernetes.io/projected/badad4e2-1e7e-4ce1-aa52-73051bffecff-kube-api-access-6f96p\") pod \"must-gather-tkh59\" (UID: \"badad4e2-1e7e-4ce1-aa52-73051bffecff\") " pod="openshift-must-gather-qxj2b/must-gather-tkh59"
Jul 07 15:06:32.563428 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.563410    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/badad4e2-1e7e-4ce1-aa52-73051bffecff-must-gather-output\") pod \"must-gather-tkh59\" (UID: \"badad4e2-1e7e-4ce1-aa52-73051bffecff\") " pod="openshift-must-gather-qxj2b/must-gather-tkh59"
Jul 07 15:06:32.579891 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.579863    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f96p\" (UniqueName: \"kubernetes.io/projected/badad4e2-1e7e-4ce1-aa52-73051bffecff-kube-api-access-6f96p\") pod \"must-gather-tkh59\" (UID: \"badad4e2-1e7e-4ce1-aa52-73051bffecff\") " pod="openshift-must-gather-qxj2b/must-gather-tkh59"
Jul 07 15:06:32.655695 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.655663    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qxj2b/must-gather-tkh59"
Jul 07 15:06:32.801135 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.801066    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qxj2b/must-gather-tkh59"]
Jul 07 15:06:32.803421 ip-10-0-139-48 kubenswrapper[2567]: W0707 15:06:32.803394    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbadad4e2_1e7e_4ce1_aa52_73051bffecff.slice/crio-671f8e39c6de6547cc556300833a039d7aadcc2fded118a7ee2e70d514de1160 WatchSource:0}: Error finding container 671f8e39c6de6547cc556300833a039d7aadcc2fded118a7ee2e70d514de1160: Status 404 returned error can't find the container with id 671f8e39c6de6547cc556300833a039d7aadcc2fded118a7ee2e70d514de1160
Jul 07 15:06:32.805389 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:32.805371    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:06:33.765757 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:33.765721    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qxj2b/must-gather-tkh59" event={"ID":"badad4e2-1e7e-4ce1-aa52-73051bffecff","Type":"ContainerStarted","Data":"671f8e39c6de6547cc556300833a039d7aadcc2fded118a7ee2e70d514de1160"}
Jul 07 15:06:34.776376 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:34.776329    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qxj2b/must-gather-tkh59" event={"ID":"badad4e2-1e7e-4ce1-aa52-73051bffecff","Type":"ContainerStarted","Data":"5c8dd9458199ce83aa4fc6ccc6f85ff4a77e7accc7e498fe1ec15d34aa8764dd"}
Jul 07 15:06:34.776871 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:34.776392    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qxj2b/must-gather-tkh59" event={"ID":"badad4e2-1e7e-4ce1-aa52-73051bffecff","Type":"ContainerStarted","Data":"d81c9e10ad76990bcb1c560c03881c9e6d2ceb92ae62a8ab2c92c88b5265eaf9"}
Jul 07 15:06:34.802942 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:34.802893    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qxj2b/must-gather-tkh59" podStartSLOduration=1.764480061 podStartE2EDuration="2.80287753s" totalImagesPullingTime="1.038397469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:06:34.80108868 +0000 UTC m=+2550.007062811" watchObservedRunningTime="2026-07-07 15:06:34.80287753 +0000 UTC m=+2550.008851660"
Jul 07 15:06:35.801985 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:35.801946    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pr7wh_b3a21f69-c388-41a9-9d35-f6c4aa77ed86/global-pull-secret-syncer/0.log"
Jul 07 15:06:35.935880 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:35.935850    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8f6xm_00f603e4-c02e-408c-bcf0-2dbc2f1338cd/konnectivity-agent/0.log"
Jul 07 15:06:36.028744 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:36.028714    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-48.ec2.internal_ad68e1f845990f6848aad9efe7f0aba0/haproxy/0.log"
Jul 07 15:06:41.343762 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:41.343723    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hmwst_f59eea95-96d6-4240-a114-6a8086095b57/manager/0.log"
Jul 07 15:06:41.371962 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:41.371928    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-g9d88_22c5ec46-b098-4a03-b15a-dccbb2e70633/manager/0.log"
Jul 07 15:06:41.450219 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:41.450170    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gq5vw_e88c0219-8d24-451f-934d-0323169f6718/registry-server/0.log"
Jul 07 15:06:41.611476 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:41.611315    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vdpgc_2ea57ae0-5122-4176-9088-46de388c0c63/manager/0.log"
Jul 07 15:06:41.640905 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:41.640866    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-drhvz_d2c6668c-2d32-494c-9304-03d0b2ea7b5e/limitador/0.log"
Jul 07 15:06:41.725912 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:41.725877    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-klhxb_c325f1d6-139e-4191-b3c7-375bb76fa1ec/manager/0.log"
Jul 07 15:06:43.697484 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:43.697447    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-kfp8s_51ff0204-46fd-46b7-bd27-4a28a0683ae4/cluster-monitoring-operator/0.log"
Jul 07 15:06:43.968681 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:43.968607    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tpxvn_1f0628b4-8713-45b5-ba34-c099777692f6/node-exporter/0.log"
Jul 07 15:06:44.001898 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:44.001860    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tpxvn_1f0628b4-8713-45b5-ba34-c099777692f6/kube-rbac-proxy/0.log"
Jul 07 15:06:44.030962 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:44.030934    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tpxvn_1f0628b4-8713-45b5-ba34-c099777692f6/init-textfile/0.log"
Jul 07 15:06:45.728040 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.727993    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"]
Jul 07 15:06:45.736218 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.736192    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:45.742962 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.742895    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"]
Jul 07 15:06:45.799538 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.799508    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aba52523-0443-4a35-8dce-c0ce6a69eb38-lib-modules\") pod \"perf-node-gather-daemonset-kms86\" (UID: \"aba52523-0443-4a35-8dce-c0ce6a69eb38\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:45.799753 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.799665    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rxcm\" (UniqueName: \"kubernetes.io/projected/aba52523-0443-4a35-8dce-c0ce6a69eb38-kube-api-access-9rxcm\") pod \"perf-node-gather-daemonset-kms86\" (UID: \"aba52523-0443-4a35-8dce-c0ce6a69eb38\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:45.799753 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.799719    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aba52523-0443-4a35-8dce-c0ce6a69eb38-podres\") pod \"perf-node-gather-daemonset-kms86\" (UID: \"aba52523-0443-4a35-8dce-c0ce6a69eb38\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:45.799753 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.799741    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aba52523-0443-4a35-8dce-c0ce6a69eb38-sys\") pod \"perf-node-gather-daemonset-kms86\" (UID: \"aba52523-0443-4a35-8dce-c0ce6a69eb38\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:45.799933 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.799870    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aba52523-0443-4a35-8dce-c0ce6a69eb38-proc\") pod \"perf-node-gather-daemonset-kms86\" (UID: \"aba52523-0443-4a35-8dce-c0ce6a69eb38\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:45.900379 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.900334    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aba52523-0443-4a35-8dce-c0ce6a69eb38-lib-modules\") pod \"perf-node-gather-daemonset-kms86\" (UID: \"aba52523-0443-4a35-8dce-c0ce6a69eb38\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:45.900579 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.900410    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rxcm\" (UniqueName: \"kubernetes.io/projected/aba52523-0443-4a35-8dce-c0ce6a69eb38-kube-api-access-9rxcm\") pod \"perf-node-gather-daemonset-kms86\" (UID: \"aba52523-0443-4a35-8dce-c0ce6a69eb38\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:45.900579 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.900457    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aba52523-0443-4a35-8dce-c0ce6a69eb38-podres\") pod \"perf-node-gather-daemonset-kms86\" (UID: \"aba52523-0443-4a35-8dce-c0ce6a69eb38\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:45.900579 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.900482    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aba52523-0443-4a35-8dce-c0ce6a69eb38-sys\") pod \"perf-node-gather-daemonset-kms86\" (UID: \"aba52523-0443-4a35-8dce-c0ce6a69eb38\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:45.900579 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.900541    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aba52523-0443-4a35-8dce-c0ce6a69eb38-proc\") pod \"perf-node-gather-daemonset-kms86\" (UID: \"aba52523-0443-4a35-8dce-c0ce6a69eb38\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:45.900823 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.900670    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/aba52523-0443-4a35-8dce-c0ce6a69eb38-proc\") pod \"perf-node-gather-daemonset-kms86\" (UID: \"aba52523-0443-4a35-8dce-c0ce6a69eb38\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:45.900823 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.900793    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aba52523-0443-4a35-8dce-c0ce6a69eb38-lib-modules\") pod \"perf-node-gather-daemonset-kms86\" (UID: \"aba52523-0443-4a35-8dce-c0ce6a69eb38\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:45.901236 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.901208    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/aba52523-0443-4a35-8dce-c0ce6a69eb38-podres\") pod \"perf-node-gather-daemonset-kms86\" (UID: \"aba52523-0443-4a35-8dce-c0ce6a69eb38\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:45.901306 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.901293    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aba52523-0443-4a35-8dce-c0ce6a69eb38-sys\") pod \"perf-node-gather-daemonset-kms86\" (UID: \"aba52523-0443-4a35-8dce-c0ce6a69eb38\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:45.911842 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:45.911800    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rxcm\" (UniqueName: \"kubernetes.io/projected/aba52523-0443-4a35-8dce-c0ce6a69eb38-kube-api-access-9rxcm\") pod \"perf-node-gather-daemonset-kms86\" (UID: \"aba52523-0443-4a35-8dce-c0ce6a69eb38\") " pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:46.049870 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:46.049789    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:46.244802 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:46.244713    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"]
Jul 07 15:06:46.247890 ip-10-0-139-48 kubenswrapper[2567]: W0707 15:06:46.247859    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaba52523_0443_4a35_8dce_c0ce6a69eb38.slice/crio-646a6ceec668bb16266cb7dbe0789fc192197e6e58c6adc163fdb401054d90fe WatchSource:0}: Error finding container 646a6ceec668bb16266cb7dbe0789fc192197e6e58c6adc163fdb401054d90fe: Status 404 returned error can't find the container with id 646a6ceec668bb16266cb7dbe0789fc192197e6e58c6adc163fdb401054d90fe
Jul 07 15:06:46.784842 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:46.784816    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/1.log"
Jul 07 15:06:46.791706 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:46.791680    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-wsdv5_feff296c-ca8b-401c-840d-819465005d5d/console-operator/2.log"
Jul 07 15:06:46.867669 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:46.867625    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86" event={"ID":"aba52523-0443-4a35-8dce-c0ce6a69eb38","Type":"ContainerStarted","Data":"5f3fdd11ee7d14f38e67684969e3e58d79868e04f081b0db643388d5510add4a"}
Jul 07 15:06:46.867865 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:46.867702    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86" event={"ID":"aba52523-0443-4a35-8dce-c0ce6a69eb38","Type":"ContainerStarted","Data":"646a6ceec668bb16266cb7dbe0789fc192197e6e58c6adc163fdb401054d90fe"}
Jul 07 15:06:46.867865 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:46.867786    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:46.890049 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:46.889978    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86" podStartSLOduration=1.889956115 podStartE2EDuration="1.889956115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:06:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:06:46.886941451 +0000 UTC m=+2562.092915582" watchObservedRunningTime="2026-07-07 15:06:46.889956115 +0000 UTC m=+2562.095930247"
Jul 07 15:06:48.066365 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:48.066332    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-btm8c_8a8c4c65-4c6f-4780-a9af-e0501ba8ae27/volume-data-source-validator/0.log"
Jul 07 15:06:49.437159 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:49.437132    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lzhnd_48d7352c-0608-4b17-aecf-ff2cf067b5fd/dns/0.log"
Jul 07 15:06:49.475774 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:49.475748    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lzhnd_48d7352c-0608-4b17-aecf-ff2cf067b5fd/kube-rbac-proxy/0.log"
Jul 07 15:06:49.604745 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:49.604720    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5pgr7_95a06780-deaf-4ca6-82b5-3040caf89229/dns-node-resolver/0.log"
Jul 07 15:06:50.390973 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:50.390940    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lwnqf_302a7403-a5f3-4749-92a3-05bcc8138f1a/node-ca/0.log"
Jul 07 15:06:51.782605 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:51.782558    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f67c6995-qjcf8_fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6/kube-auth-proxy/0.log"
Jul 07 15:06:52.136536 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:52.136459    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5df69cc7c9-xdxbd_ec46e625-a505-4243-97cd-b319c114f668/router/0.log"
Jul 07 15:06:52.884769 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:52.884743    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qxj2b/perf-node-gather-daemonset-kms86"
Jul 07 15:06:53.082142 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:53.082112    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s48x2_c3570076-b2c5-4087-819a-412ab7f410df/serve-healthcheck-canary/0.log"
Jul 07 15:06:53.645874 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:53.645841    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-m4684_246e477f-d040-4356-a575-f78f652b6192/insights-operator/0.log"
Jul 07 15:06:53.646647 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:53.646633    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-m4684_246e477f-d040-4356-a575-f78f652b6192/insights-operator/1.log"
Jul 07 15:06:53.675696 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:53.675665    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8r8r6_bddc2009-c225-47db-b309-a7a961b6997f/kube-rbac-proxy/0.log"
Jul 07 15:06:53.711134 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:53.711101    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8r8r6_bddc2009-c225-47db-b309-a7a961b6997f/exporter/0.log"
Jul 07 15:06:53.747288 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:53.747229    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8r8r6_bddc2009-c225-47db-b309-a7a961b6997f/extractor/0.log"
Jul 07 15:06:56.214514 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:56.214483    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f67c6995-qjcf8_fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6/kube-auth-proxy/0.log"
Jul 07 15:06:56.369422 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:56.369340    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5df69cc7c9-xdxbd_ec46e625-a505-4243-97cd-b319c114f668/router/0.log"
Jul 07 15:06:56.708766 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:56.708737    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qggrw_05ad9a6a-6f93-423f-9260-e456ce15339c/manager/0.log"
Jul 07 15:06:56.886614 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:56.886095    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4hlgb_62869e62-4787-495c-bf1f-904935df387c/manager/0.log"
Jul 07 15:06:57.039163 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:57.039135    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723925-prwqb_dbbd0031-301d-44a7-a368-0e652eb72165/cleanup/0.log"
Jul 07 15:06:57.109704 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:57.109673    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29723940-xdxlm_9162417b-ab0a-4ed9-a80c-3bb1d16fb3df/cleanup/0.log"
Jul 07 15:06:57.300261 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:57.300177    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jv86q_c4653351-bbcb-4253-9a9d-31cf77dd7663/server/0.log"
Jul 07 15:06:57.400612 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:57.400561    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9rchv_f87872ae-8a93-48c2-b65a-1620cadde5e2/manager/0.log"
Jul 07 15:06:57.486276 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:57.486245    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f546bc4-7hrb8_490ce88c-25d5-4b0c-8036-7341ddf0b1c5/manager/0.log"
Jul 07 15:06:57.530519 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:57.530481    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f546bc4-7hrb8_490ce88c-25d5-4b0c-8036-7341ddf0b1c5/copy-manifests/0.log"
Jul 07 15:06:57.715651 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:57.715623    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f67c6995-qjcf8_fe615e35-169e-4fcb-8b1f-9ca2c8bdc3a6/kube-auth-proxy/0.log"
Jul 07 15:06:57.900524 ip-10-0-139-48 kubenswrapper[2567]: I0707 15:06:57.900486    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5df69cc7c9-xdxbd_ec46e625-a505-4243-97cd-b319c114f668/router/0.log"