Jul 09 18:39:21.306699 ip-10-0-141-47 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 18:39:21.306715 ip-10-0-141-47 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 18:39:21.306724 ip-10-0-141-47 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 18:39:21.307048 ip-10-0-141-47 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 18:39:30.866939 ip-10-0-141-47 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 18:39:30.866952 ip-10-0-141-47 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0cf66233f9f543cc99ce751786822b98 --
Jul 09 18:41:03.816788 ip-10-0-141-47 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 18:41:04.243765 ip-10-0-141-47 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:41:04.243765 ip-10-0-141-47 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 18:41:04.243765 ip-10-0-141-47 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:41:04.243765 ip-10-0-141-47 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 18:41:04.243765 ip-10-0-141-47 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 18:41:04.244971 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.244879    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 18:41:04.249269 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249251    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:41:04.249269 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249268    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:41:04.249269 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249272    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249281    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249288    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249293    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249297    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249300    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249304    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249308    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249312    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249315    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249319    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249323    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249328    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249332    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249337    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249341    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249345    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249349    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249354    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:41:04.249450 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249359    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249362    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249366    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249372    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249376    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249381    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249385    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249389    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249394    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249398    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249402    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249406    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249410    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249414    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249418    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249423    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249428    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249432    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249436    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:41:04.250274 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249440    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249444    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249449    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249453    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249457    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249461    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249465    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249470    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249474    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249495    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249500    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249504    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249508    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249513    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249517    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249521    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249528    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249534    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249538    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249542    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:41:04.251093 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249547    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249551    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249556    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249561    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249566    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249570    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249575    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249581    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249586    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249591    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249595    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249603    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249608    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249613    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249618    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249622    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249626    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249631    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249635    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:41:04.251959 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249639    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249643    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249647    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249651    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249655    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249659    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249664    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249668    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249672    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249676    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249680    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249685    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249689    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249693    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249697    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249702    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249705    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249710    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249714    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.249718    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:41:04.252414 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250863    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250873    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250877    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250881    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250885    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250891    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250895    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250900    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250904    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250908    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250912    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250916    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250921    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250924    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250929    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250933    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250937    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250942    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250946    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250950    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:41:04.253013 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250954    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250958    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250962    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250966    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250970    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250974    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250978    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250983    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250987    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250991    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250995    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.250999    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251004    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251008    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251012    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251016    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251020    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251024    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251029    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251034    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:41:04.253886 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251038    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251042    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251046    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251050    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251054    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251060    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251068    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251072    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251077    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251081    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251085    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251089    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251094    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251098    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251101    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251105    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251109    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251113    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251117    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:41:04.254806 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251122    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251126    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251131    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251135    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251140    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251144    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251148    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251152    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251156    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251160    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251164    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251168    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251173    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251177    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251181    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251185    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251189    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251193    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251197    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251202    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:41:04.255318 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251206    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251210    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251214    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251222    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251228    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251232    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251236    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251240    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251244    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251248    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251253    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251257    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251261    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251265    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251269    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251275    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251281    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251286    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:41:04.255900 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251291    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.251295    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252907    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252918    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252923    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252927    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252935    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252940    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252946    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252950    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252957    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252963    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252968    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252973    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252977    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252982    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252986    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252990    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.252996    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:41:04.256439 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253002    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253006    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253010    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253014    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253018    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253022    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253026    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253029    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253034    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253038    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253043    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253048    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253052    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253056    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253061    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253065    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253069    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253073    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253080    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:41:04.257055 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253085    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253091    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253096    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253102    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253108    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253112    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253117    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253121    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253126    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253130    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253134    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253139    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253143    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253147    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253151    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253154    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253159    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253163    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253168    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253171    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:41:04.257536 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253175    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253180    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253184    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253189    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253194    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253200    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253204    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253208    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253212    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253217    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253221    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253225    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253229    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253233    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253237    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253242    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253246    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253250    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253254    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253258    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:41:04.258119 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253262    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253266    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253270    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253274    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253278    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253282    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253286    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253290    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253295    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253299    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253303    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253307    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253311    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253316    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253319    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253323    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253328    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253332    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253336    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253340    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:41:04.258622 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253344    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253348    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.253352    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253440    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253450    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253459    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253466    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253474    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253497    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253504    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253510    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253515    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253520    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253524    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253530    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253535    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253540    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253545    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253549    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253554    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253562    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253569    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253574    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253579    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 18:41:04.259107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253584    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253589    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253595    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253599    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253609    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253614    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253619    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253624    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253628    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253633    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253637    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253644    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253649    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253653    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253658    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253663    2562 flags.go:64] FLAG: --enable-server="true"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253668    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253675    2562 flags.go:64] FLAG: --event-burst="100"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253679    2562 flags.go:64] FLAG: --event-qps="50"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253684    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253688    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253693    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253699    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253703    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253708    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 18:41:04.259686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253713    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253717    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253722    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253728    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253732    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253737    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253741    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253745    2562 flags.go:64] FLAG: --feature-gates=""
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253751    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253756    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253760    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253767    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253772    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253777    2562 flags.go:64] FLAG: --help="false"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253781    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253786    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253790    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253795    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253800    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253806    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253810    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253815    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253819    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 18:41:04.260279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253824    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253829    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253834    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253838    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253843    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253847    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253852    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253856    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253861    2562 flags.go:64] FLAG: --lock-file=""
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253865    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253870    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253874    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253884    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253888    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253892    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253896    2562 flags.go:64] FLAG: --logging-format="text"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253900    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253905    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253909    2562 flags.go:64] FLAG: --manifest-url=""
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253914    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253922    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253927    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253933    2562 flags.go:64] FLAG: --max-pods="110"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253937    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253942    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 18:41:04.260946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253947    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253951    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253956    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253960    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253965    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253976    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253980    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253985    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253989    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.253994    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254003    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254007    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254012    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254017    2562 flags.go:64] FLAG: --port="10250"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254021    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254026    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02b63ee8c2aa66b68"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254031    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254036    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254040    2562 flags.go:64] FLAG: --register-node="true"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254044    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254052    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254057    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254061    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254065    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254071    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 18:41:04.261573 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254076    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254081    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254087    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254091    2562 flags.go:64] FLAG: --runonce="false"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254096    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254101    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254105    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254110    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254114    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254118    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254123    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254128    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254132    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254137    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254141    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254146    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254151    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254157    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254162    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254171    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254176    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254180    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254186    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254191    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254195    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 18:41:04.262181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254200    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254204    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254210    2562 flags.go:64] FLAG: --v="2"
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254216    2562 flags.go:64] FLAG: --version="false"
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254223    2562 flags.go:64] FLAG: --vmodule=""
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254229    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.254234    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254438    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254445    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254453    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254457    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254461    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254466    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254470    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254474    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254499    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254503    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254508    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254511    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254515    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254520    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:41:04.262798 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254524    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254528    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254532    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254536    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254541    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254546    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254550    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254554    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254559    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254563    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254567    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254571    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254575    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254582    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254586    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254590    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254595    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254598    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254603    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254607    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:41:04.263305 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254613    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254617    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254621    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254625    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254629    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254633    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254637    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254642    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254646    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254650    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254654    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254658    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254662    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254666    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254670    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254674    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254681    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254688    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254693    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:41:04.263844 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254698    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254702    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254707    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254711    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254715    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254719    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254725    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254729    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254735    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254739    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254744    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254747    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254751    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254757    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254761    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254765    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254769    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254773    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254778    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254781    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:41:04.264342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254785    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254789    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254793    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254798    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254801    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254805    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254809    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254812    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254816    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254820    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254823    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254828    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254832    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254837    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254841    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254845    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254849    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254853    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254858    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254862    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:41:04.264948 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254865    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:41:04.265780 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254870    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:41:04.265780 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254873    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:41:04.265780 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254877    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:41:04.265780 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254884    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:41:04.265780 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.254890    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:41:04.265780 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.255656    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:41:04.265780 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.262312    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 18:41:04.265780 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.262326    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 18:41:04.265780 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.262983    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 18:41:04.265780 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.262990    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 18:41:04.265780 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263044    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:41:04.265780 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263049    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:41:04.265780 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263053    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:41:04.265780 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263055    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263058    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263060    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263064    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263067    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263071    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263074    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263077    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263080    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263084    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263086    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263089    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263091    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263094    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263097    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263099    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263102    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263104    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263107    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263110    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:41:04.266297 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263113    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263115    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263118    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263120    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263123    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263125    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263128    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263131    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263134    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263136    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263139    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263141    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263144    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263147    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263149    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263151    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263154    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263156    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263159    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263161    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:41:04.266830 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263164    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263166    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263169    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263172    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263174    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263177    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263179    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263183    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263186    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263189    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263192    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263195    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263198    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263200    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263203    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263205    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263208    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263210    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263213    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:41:04.267315 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263216    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263218    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263221    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263223    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263225    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263228    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263230    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263232    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263235    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263237    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263240    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263242    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263244    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263246    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263249    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263251    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263254    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263257    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263259    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263261    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:41:04.267792 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263264    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:41:04.268310 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263266    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:41:04.268310 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263269    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:41:04.268310 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263271    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:41:04.268310 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263274    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:41:04.268310 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263277    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:41:04.268310 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263279    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:41:04.268310 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263281    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:41:04.268310 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263284    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:41:04.268310 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263286    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:41:04.268310 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263290    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:41:04.268310 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263293    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:41:04.268310 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263296    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:41:04.268310 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263299    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:41:04.268310 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263302    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:41:04.268310 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263305    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:41:04.268310 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263307    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:41:04.268728 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.263312    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:41:04.268728 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263418    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 18:41:04.268728 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263423    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 18:41:04.268728 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263425    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 18:41:04.268728 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263428    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 18:41:04.268728 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263431    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 18:41:04.268728 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263433    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 18:41:04.268728 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263436    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 18:41:04.268728 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263438    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 18:41:04.268728 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263441    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 18:41:04.268728 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263443    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 18:41:04.268728 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263445    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 18:41:04.268728 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263449    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 18:41:04.268728 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263452    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 18:41:04.268728 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263454    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263457    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263459    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263461    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263465    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263467    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263470    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263472    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263475    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263477    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263491    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263494    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263497    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263499    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263502    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263504    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263507    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263509    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263512    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 18:41:04.269099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263515    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263519    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263522    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263524    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263527    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263529    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263532    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263534    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263537    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263539    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263542    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263544    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263547    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263550    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263552    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263555    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263557    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263560    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263563    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263565    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 18:41:04.269567 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263567    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263570    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263572    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263575    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263577    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263579    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263582    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263584    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263586    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263589    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263591    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263593    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263596    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263598    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263601    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263605    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263607    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263610    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263612    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 18:41:04.270031 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263616    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263619    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263622    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263625    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263627    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263630    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263633    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263635    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263638    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263640    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263643    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263645    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263647    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263650    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263652    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263655    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263657    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263659    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263662    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263664    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 18:41:04.270623 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263667    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 18:41:04.271095 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263669    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 18:41:04.271095 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263672    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 18:41:04.271095 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263674    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 18:41:04.271095 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263677    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 18:41:04.271095 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263679    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 18:41:04.271095 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263681    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 18:41:04.271095 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:04.263684    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 18:41:04.271095 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.263688    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 18:41:04.271095 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.263780    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 18:41:04.271095 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.268685    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 18:41:04.271095 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.270084    2562 server.go:1019] "Starting client certificate rotation"
Jul 09 18:41:04.271095 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.270191    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 18:41:04.271095 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.270231    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 18:41:04.272354 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.272339    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 18:41:04.275464 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.275450    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 18:41:04.287967 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.287949    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 09 18:41:04.290455 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.290441    2562 log.go:25] "Validated CRI v1 image API"
Jul 09 18:41:04.291242 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.291229    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 18:41:04.294065 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.294048    2562 fs.go:135] Filesystem UUIDs: map[08a6627d-0ba9-46b5-9ae1-ace6a4b489a4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e68bd208-2f4d-481a-b24a-7838fffccf0a:/dev/nvme0n1p3]
Jul 09 18:41:04.294114 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.294065    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 18:41:04.299994 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.299896    2562 manager.go:216] Machine: {Timestamp:2026-07-09 18:41:04.298605035 +0000 UTC m=+0.360410053 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098629 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23acbe942ccb9e840b45fb5e7090d5 SystemUUID:ec23acbe-942c-cb9e-840b-45fb5e7090d5 BootID:0cf66233-f9f5-43cc-99ce-751786822b98 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4e:b3:19:ba:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4e:b3:19:ba:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:91:ba:9a:f6:40 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 18:41:04.299994 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.299987    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 18:41:04.300142 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.300099    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 18:41:04.300314 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.300298    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 18:41:04.303891 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.303864    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 18:41:04.304027 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.303895    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-47.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 18:41:04.304850 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.304599    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 18:41:04.304850 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.304837    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 18:41:04.304955 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.304853    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 18:41:04.305842 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.305708    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 18:41:04.307282 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.307269    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 18:41:04.310870 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.310858    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 18:41:04.311123 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.311113    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 18:41:04.311158 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.311143    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 18:41:04.311158 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.311153    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 18:41:04.311211 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.311163    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 18:41:04.311211 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.311173    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 09 18:41:04.311211 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.311181    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 18:41:04.311548 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.311534    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 18:41:04.311548 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.311555    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 18:41:04.316591 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.316435    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 18:41:04.318335 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.318319    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 18:41:04.318425 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.318361    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 18:41:04.319195 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.319181    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 18:41:04.319259 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.319203    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 18:41:04.319259 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.319211    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 18:41:04.319259 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.319219    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 18:41:04.319259 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.319232    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 18:41:04.319259 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.319240    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 18:41:04.319259 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.319251    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 18:41:04.319259 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.319260    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 18:41:04.319499 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.319271    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 18:41:04.319499 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.319280    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 18:41:04.319499 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.319293    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 18:41:04.319499 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.319302    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 18:41:04.320969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.320956    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 18:41:04.321038 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.320972    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 18:41:04.324025 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.324011    2562 server.go:1268] "Started kubelet"
Jul 09 18:41:04.324706 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.324374    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 18:41:04.324706 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.324283    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 18:41:04.324706 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.324662    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 18:41:04.324757 ip-10-0-141-47 systemd[1]: Started Kubernetes Kubelet.
Jul 09 18:41:04.325872 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.325851    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 18:41:04.327098 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.327071    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-47.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 18:41:04.327098 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.327066    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 18:41:04.327246 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.327184    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-47.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 18:41:04.327565 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.327552    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 18:41:04.331496 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.331464    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 18:41:04.331591 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.331503    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 18:41:04.331591 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.331510    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 18:41:04.331591 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.331573    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 09 18:41:04.332235 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.332218    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 18:41:04.332317 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.332232    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 18:41:04.332317 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.332296    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 18:41:04.332417 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.332328    2562 factory.go:55] Registering systemd factory
Jul 09 18:41:04.332417 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.332344    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 09 18:41:04.332417 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.332390    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 18:41:04.332417 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.332399    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 18:41:04.332572 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.332540    2562 factory.go:153] Registering CRI-O factory
Jul 09 18:41:04.332572 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.332554    2562 factory.go:223] Registration of the crio container factory successfully
Jul 09 18:41:04.332641 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.332607    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 18:41:04.332641 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.332633    2562 factory.go:103] Registering Raw factory
Jul 09 18:41:04.332706 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.332650    2562 manager.go:1196] Started watching for new ooms in manager
Jul 09 18:41:04.333078 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.333064    2562 manager.go:349] Starting recovery of all containers
Jul 09 18:41:04.338801 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.333404    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-47.ec2.internal.18c0b32e67700b82  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-47.ec2.internal,UID:ip-10-0-141-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-47.ec2.internal,},FirstTimestamp:2026-07-09 18:41:04.323980162 +0000 UTC m=+0.385785182,LastTimestamp:2026-07-09 18:41:04.323980162 +0000 UTC m=+0.385785182,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-47.ec2.internal,}"
Jul 09 18:41:04.342044 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.342013    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 18:41:04.342170 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.342146    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-47.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 18:41:04.348700 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.348684    2562 manager.go:354] Recovery completed
Jul 09 18:41:04.350939 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.350922    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-znbsp"
Jul 09 18:41:04.352734 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.352722    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:41:04.354719 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.354704    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:41:04.354784 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.354732    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:41:04.354784 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.354744    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:41:04.355204 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.355191    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 18:41:04.355204 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.355203    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 18:41:04.355310 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.355217    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 18:41:04.355310 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.355197    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:41:04.356020 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.356006    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:41:04.356100 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.356031    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:41:04.356100 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.356041    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:41:04.357099 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.357082    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-znbsp"
Jul 09 18:41:04.357099 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.357047    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-47.ec2.internal.18c0b32e69451300  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-47.ec2.internal,UID:ip-10-0-141-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-47.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-47.ec2.internal,},FirstTimestamp:2026-07-09 18:41:04.354718464 +0000 UTC m=+0.416523482,LastTimestamp:2026-07-09 18:41:04.354718464 +0000 UTC m=+0.416523482,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-47.ec2.internal,}"
Jul 09 18:41:04.357362 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.357350    2562 policy_none.go:49] "None policy: Start"
Jul 09 18:41:04.357394 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.357366    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 18:41:04.357394 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.357377    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 18:41:04.359281 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.359270    2562 policy_none.go:47] "Start"
Jul 09 18:41:04.406362 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.406346    2562 manager.go:337] "Starting Device Plugin manager"
Jul 09 18:41:04.406442 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.406411    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 18:41:04.406442 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.406425    2562 server.go:87] "Starting device plugin registration server"
Jul 09 18:41:04.406874 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.406680    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 18:41:04.406874 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.406695    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 18:41:04.406874 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.406749    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 18:41:04.406874 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.406817    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 18:41:04.406874 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.406827    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 18:41:04.430907 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.407323    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 18:41:04.430907 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.407363    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 09 18:41:04.445025 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.444999    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 18:41:04.446242 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.446226    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 18:41:04.446321 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.446275    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 18:41:04.446321 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.446300    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 18:41:04.446417 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.446338    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 18:41:04.448739 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.448723    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:41:04.507841 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.507787    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:41:04.508953 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.508934    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:41:04.509038 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.508968    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:41:04.509038 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.508979    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:41:04.509038 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.508999    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.518959 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.518937    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.519046 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.518965    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-47.ec2.internal\": node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 09 18:41:04.542698 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.542682    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 09 18:41:04.546736 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.546714    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal"]
Jul 09 18:41:04.546813 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.546783    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:41:04.547538 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.547524    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:41:04.547646 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.547590    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:41:04.547646 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.547605    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:41:04.549632 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.549618    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:41:04.549755 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.549733    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.549804 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.549770    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:41:04.550376 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.550358    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:41:04.550376 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.550373    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:41:04.550514 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.550387    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:41:04.550514 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.550395    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:41:04.550514 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.550400    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:41:04.550514 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.550411    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:41:04.552842 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.552827    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.552893 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.552851    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 18:41:04.553618 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.553600    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 18:41:04.553675 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.553637    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 18:41:04.553675 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.553653    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeHasSufficientPID"
Jul 09 18:41:04.581119 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.581097    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-47.ec2.internal\" not found" node="ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.585350 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.585336    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-47.ec2.internal\" not found" node="ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.643751 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.643729    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 09 18:41:04.733834 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.733814    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa2436aae3e2c2acd74ee4735978d53f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal\" (UID: \"aa2436aae3e2c2acd74ee4735978d53f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.733912 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.733842    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa2436aae3e2c2acd74ee4735978d53f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal\" (UID: \"aa2436aae3e2c2acd74ee4735978d53f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.733912 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.733859    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d53067e3c408632770d4f8c1feeef25-config\") pod \"kube-apiserver-proxy-ip-10-0-141-47.ec2.internal\" (UID: \"9d53067e3c408632770d4f8c1feeef25\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.743843 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.743828    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 09 18:41:04.834497 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.834430    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa2436aae3e2c2acd74ee4735978d53f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal\" (UID: \"aa2436aae3e2c2acd74ee4735978d53f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.834497 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.834453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa2436aae3e2c2acd74ee4735978d53f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal\" (UID: \"aa2436aae3e2c2acd74ee4735978d53f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.834497 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.834469    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d53067e3c408632770d4f8c1feeef25-config\") pod \"kube-apiserver-proxy-ip-10-0-141-47.ec2.internal\" (UID: \"9d53067e3c408632770d4f8c1feeef25\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.834636 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.834520    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa2436aae3e2c2acd74ee4735978d53f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal\" (UID: \"aa2436aae3e2c2acd74ee4735978d53f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.834636 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.834540    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9d53067e3c408632770d4f8c1feeef25-config\") pod \"kube-apiserver-proxy-ip-10-0-141-47.ec2.internal\" (UID: \"9d53067e3c408632770d4f8c1feeef25\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.834636 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.834520    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aa2436aae3e2c2acd74ee4735978d53f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal\" (UID: \"aa2436aae3e2c2acd74ee4735978d53f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.844548 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.844532    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 09 18:41:04.882658 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.882642    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.888331 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:04.888313    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal"
Jul 09 18:41:04.945552 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:04.945520    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 09 18:41:05.046006 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:05.045978    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 09 18:41:05.146566 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:05.146503    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-47.ec2.internal\" not found"
Jul 09 18:41:05.153998 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.153980    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:41:05.232273 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.232251    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal"
Jul 09 18:41:05.243264 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.243239    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 18:41:05.245585 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.245572    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal"
Jul 09 18:41:05.259114 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.259097    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 18:41:05.269246 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.269229    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 18:41:05.269356 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.269337    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 18:41:05.269401 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.269382    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 18:41:05.311500 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.311466    2562 apiserver.go:52] "Watching apiserver"
Jul 09 18:41:05.332494 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.332462    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 18:41:05.334250 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.334232    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:41:05.334334 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.334298    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 18:41:05.334604 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.334583    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-smq6d","kube-system/konnectivity-agent-lfhlt","kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x","openshift-cluster-node-tuning-operator/tuned-t58ks","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal","openshift-multus/multus-74ps2","openshift-multus/multus-additional-cni-plugins-6zm9b","openshift-dns/node-resolver-m7pwm","openshift-image-registry/node-ca-qg8vv","openshift-multus/network-metrics-daemon-44bfx","openshift-network-diagnostics/network-check-target-cl4vn","openshift-network-operator/iptables-alerter-7sfg4","openshift-ovn-kubernetes/ovnkube-node-zrbn6"]
Jul 09 18:41:05.336921 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.336906    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:05.336987 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:05.336964    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:05.338813 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.338799    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lfhlt"
Jul 09 18:41:05.340876 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.340856    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.341147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.341129    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 18:41:05.341214 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.341133    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 18:41:05.341214 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.341165    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-592xc\""
Jul 09 18:41:05.342889 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.342874    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.343381 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.343367    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 18:41:05.343842 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.343828    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 18:41:05.343914 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.343899    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 18:41:05.343971 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.343944    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qckbz\""
Jul 09 18:41:05.344872 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.344858    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.346240 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.346223    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:41:05.347057 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.346706    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 18:41:05.347057 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.346861    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g2ltf\""
Jul 09 18:41:05.347317 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.347299    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.347807 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.347783    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 18:41:05.348150 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.348131    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 18:41:05.348228 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.348213    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 18:41:05.348403 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.348387    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4phjb\""
Jul 09 18:41:05.348553 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.348395    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 18:41:05.349210 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.349191    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 18:41:05.349919 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.349894    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m7pwm"
Jul 09 18:41:05.349919 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.349909    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 18:41:05.350098 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.349909    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7lqqx\""
Jul 09 18:41:05.350287 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.350270    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 18:41:05.352047 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.352017    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qg8vv"
Jul 09 18:41:05.352330 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.352316    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zrm68\""
Jul 09 18:41:05.352833 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.352821    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 18:41:05.353132 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.353115    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 18:41:05.354169 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.354150    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:05.354253 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:05.354224    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:05.354443 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.354430    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 18:41:05.354559 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.354544    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 18:41:05.354786 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.354773    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 18:41:05.354853 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.354839    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vjzxm\""
Jul 09 18:41:05.356284 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.356265    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:05.356370 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:05.356337    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:05.358265 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.358251    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7sfg4"
Jul 09 18:41:05.360442 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.360409    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 18:36:06 +0000 UTC" deadline="2027-12-28 11:14:38.794051558 +0000 UTC"
Jul 09 18:41:05.360442 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.360441    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12880h33m33.433612929s"
Jul 09 18:41:05.360549 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.360475    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.361025 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.361008    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 18:41:05.361114 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.361033    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 18:41:05.361114 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.361039    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xdsq6\""
Jul 09 18:41:05.361114 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.361009    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:41:05.364685 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.364670    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 18:41:05.364773 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.364686    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 18:41:05.364773 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.364700    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 18:41:05.364773 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.364709    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 18:41:05.364773 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.364763    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jgnzc\""
Jul 09 18:41:05.364942 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.364669    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 18:41:05.364942 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.364790    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 18:41:05.433105 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.433083    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 18:41:05.438741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.436944    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-multus-conf-dir\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.438741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c72544e1-a4e6-445c-8f79-5cc0aa9073fb-iptables-alerter-script\") pod \"iptables-alerter-7sfg4\" (UID: \"c72544e1-a4e6-445c-8f79-5cc0aa9073fb\") " pod="openshift-network-operator/iptables-alerter-7sfg4"
Jul 09 18:41:05.438741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.438741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-run-k8s-cni-cncf-io\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.438741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-run-multus-certs\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.438741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nt7s\" (UniqueName: \"kubernetes.io/projected/634b3428-ece4-44e5-918d-a676e5c475d3-kube-api-access-6nt7s\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.438741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/287d24b2-f189-4492-bd7f-cfbd8eccf639-host\") pod \"node-ca-qg8vv\" (UID: \"287d24b2-f189-4492-bd7f-cfbd8eccf639\") " pod="openshift-image-registry/node-ca-qg8vv"
Jul 09 18:41:05.438741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437206    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-run\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.438741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt4xh\" (UniqueName: \"kubernetes.io/projected/336b9318-00cd-482e-9705-569526f009d1-kube-api-access-mt4xh\") pod \"node-resolver-m7pwm\" (UID: \"336b9318-00cd-482e-9705-569526f009d1\") " pod="openshift-dns/node-resolver-m7pwm"
Jul 09 18:41:05.438741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437265    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-cni-netd\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.438741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437287    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-system-cni-dir\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.438741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a73a913c-bf13-428b-a876-8dfc0375a31e-cni-binary-copy\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.438741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437347    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.438741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437377    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-hostroot\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.438741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437404    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/336b9318-00cd-482e-9705-569526f009d1-tmp-dir\") pod \"node-resolver-m7pwm\" (UID: \"336b9318-00cd-482e-9705-569526f009d1\") " pod="openshift-dns/node-resolver-m7pwm"
Jul 09 18:41:05.438741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437441    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjpk9\" (UniqueName: \"kubernetes.io/projected/c72544e1-a4e6-445c-8f79-5cc0aa9073fb-kube-api-access-vjpk9\") pod \"iptables-alerter-7sfg4\" (UID: \"c72544e1-a4e6-445c-8f79-5cc0aa9073fb\") " pod="openshift-network-operator/iptables-alerter-7sfg4"
Jul 09 18:41:05.439402 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437470    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-kubelet\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.439402 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437520    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret\") pod \"global-pull-secret-syncer-smq6d\" (UID: \"0dd7d302-1a20-4cda-9624-0ca2fcf630c2\") " pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:05.439402 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-var-lib-cni-bin\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.439402 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437581    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a73a913c-bf13-428b-a876-8dfc0375a31e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.439402 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437641    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-etc-openvswitch\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.439402 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-cnibin\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.439402 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437695    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-os-release\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.439402 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437751    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-sysctl-d\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.439402 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-tuned\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.439402 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437807    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-run-ovn\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.439402 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437829    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/905732ad-cc05-4aab-8221-55a67a47993b-agent-certs\") pod \"konnectivity-agent-lfhlt\" (UID: \"905732ad-cc05-4aab-8221-55a67a47993b\") " pod="kube-system/konnectivity-agent-lfhlt"
Jul 09 18:41:05.439402 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437856    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-socket-dir\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.439402 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-run-systemd\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.439402 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437919    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.439402 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvcdq\" (UniqueName: \"kubernetes.io/projected/a73a913c-bf13-428b-a876-8dfc0375a31e-kube-api-access-zvcdq\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.439402 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.437993    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/287d24b2-f189-4492-bd7f-cfbd8eccf639-serviceca\") pod \"node-ca-qg8vv\" (UID: \"287d24b2-f189-4492-bd7f-cfbd8eccf639\") " pod="openshift-image-registry/node-ca-qg8vv"
Jul 09 18:41:05.440016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-lib-modules\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.440016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438053    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x28ss\" (UniqueName: \"kubernetes.io/projected/937f81e1-d44b-4678-bcd7-82659b01b28b-kube-api-access-x28ss\") pod \"network-metrics-daemon-44bfx\" (UID: \"937f81e1-d44b-4678-bcd7-82659b01b28b\") " pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:05.440016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438081    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-run-netns\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.440016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438137    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-run-openvswitch\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.440016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-node-log\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.440016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438189    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-env-overrides\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.440016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438218    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a73a913c-bf13-428b-a876-8dfc0375a31e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.440016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-device-dir\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.440016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-multus-socket-dir-parent\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.440016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438311    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-etc-kubernetes\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.440016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a73a913c-bf13-428b-a876-8dfc0375a31e-os-release\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.440016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438362    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-systemd\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.440016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw8xm\" (UniqueName: \"kubernetes.io/projected/fbd5d31d-39b7-478d-bb05-59da207c5158-kube-api-access-sw8xm\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.440016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438422    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/336b9318-00cd-482e-9705-569526f009d1-hosts-file\") pod \"node-resolver-m7pwm\" (UID: \"336b9318-00cd-482e-9705-569526f009d1\") " pod="openshift-dns/node-resolver-m7pwm"
Jul 09 18:41:05.440016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438446    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fgp4\" (UniqueName: \"kubernetes.io/projected/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-kube-api-access-7fgp4\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.440016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-dbus\") pod \"global-pull-secret-syncer-smq6d\" (UID: \"0dd7d302-1a20-4cda-9624-0ca2fcf630c2\") " pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:05.440578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-run-netns\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.440578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438570    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs\") pod \"network-metrics-daemon-44bfx\" (UID: \"937f81e1-d44b-4678-bcd7-82659b01b28b\") " pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:05.440578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438616    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-ovn-node-metrics-cert\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.440578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-multus-cni-dir\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.440578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.438692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-sys-fs\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.440578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-modprobe-d\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.440578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-sys\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.440578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439174    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-var-lib-openvswitch\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.440578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439500    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-log-socket\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.440578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439531    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-cni-bin\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.440578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a73a913c-bf13-428b-a876-8dfc0375a31e-system-cni-dir\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.440578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439576    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a73a913c-bf13-428b-a876-8dfc0375a31e-cnibin\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.440578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439599    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-systemd-units\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.440578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-ovnkube-script-lib\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.440578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439643    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-kubelet-config\") pod \"global-pull-secret-syncer-smq6d\" (UID: \"0dd7d302-1a20-4cda-9624-0ca2fcf630c2\") " pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:05.440578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5nwh\" (UniqueName: \"kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh\") pod \"network-check-target-cl4vn\" (UID: \"f3f3ace4-f8ed-4ee3-9713-3ec58d65a167\") " pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:05.441039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439680    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-sysctl-conf\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.441039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439705    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-host\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.441039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439725    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-slash\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.441039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439739    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-ovnkube-config\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.441039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439752    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/634b3428-ece4-44e5-918d-a676e5c475d3-cni-binary-copy\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.441039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439781    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/634b3428-ece4-44e5-918d-a676e5c475d3-multus-daemon-config\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.441039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439802    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-kubernetes\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.441039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439815    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-var-lib-kubelet\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.441039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439844    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbd5d31d-39b7-478d-bb05-59da207c5158-tmp\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.441039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439878    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-var-lib-cni-multus\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.441039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439900    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-var-lib-kubelet\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.441039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a73a913c-bf13-428b-a876-8dfc0375a31e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.441039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439942    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48tsx\" (UniqueName: \"kubernetes.io/projected/287d24b2-f189-4492-bd7f-cfbd8eccf639-kube-api-access-48tsx\") pod \"node-ca-qg8vv\" (UID: \"287d24b2-f189-4492-bd7f-cfbd8eccf639\") " pod="openshift-image-registry/node-ca-qg8vv"
Jul 09 18:41:05.441039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.439972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/905732ad-cc05-4aab-8221-55a67a47993b-konnectivity-ca\") pod \"konnectivity-agent-lfhlt\" (UID: \"905732ad-cc05-4aab-8221-55a67a47993b\") " pod="kube-system/konnectivity-agent-lfhlt"
Jul 09 18:41:05.441039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.440005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.441039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.440031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-registration-dir\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.441542 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.440064    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjdg8\" (UniqueName: \"kubernetes.io/projected/8141b265-74c4-419a-b292-f7f60c4124a8-kube-api-access-sjdg8\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.441542 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.440083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-sysconfig\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.441542 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.440096    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c72544e1-a4e6-445c-8f79-5cc0aa9073fb-host-slash\") pod \"iptables-alerter-7sfg4\" (UID: \"c72544e1-a4e6-445c-8f79-5cc0aa9073fb\") " pod="openshift-network-operator/iptables-alerter-7sfg4"
Jul 09 18:41:05.441542 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.440193    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-blh82"
Jul 09 18:41:05.448260 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.448233    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-blh82"
Jul 09 18:41:05.540502 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-etc-kubernetes\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.540690 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540506    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a73a913c-bf13-428b-a876-8dfc0375a31e-os-release\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.540690 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-systemd\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.540690 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540542    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-etc-kubernetes\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.540690 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540557    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw8xm\" (UniqueName: \"kubernetes.io/projected/fbd5d31d-39b7-478d-bb05-59da207c5158-kube-api-access-sw8xm\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.540690 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540581    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/336b9318-00cd-482e-9705-569526f009d1-hosts-file\") pod \"node-resolver-m7pwm\" (UID: \"336b9318-00cd-482e-9705-569526f009d1\") " pod="openshift-dns/node-resolver-m7pwm"
Jul 09 18:41:05.540690 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540625    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a73a913c-bf13-428b-a876-8dfc0375a31e-os-release\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.540690 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fgp4\" (UniqueName: \"kubernetes.io/projected/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-kube-api-access-7fgp4\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.540690 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-dbus\") pod \"global-pull-secret-syncer-smq6d\" (UID: \"0dd7d302-1a20-4cda-9624-0ca2fcf630c2\") " pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:05.540690 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540637    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-systemd\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.540690 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540689    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-run-netns\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540672    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/336b9318-00cd-482e-9705-569526f009d1-hosts-file\") pod \"node-resolver-m7pwm\" (UID: \"336b9318-00cd-482e-9705-569526f009d1\") " pod="openshift-dns/node-resolver-m7pwm"
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs\") pod \"network-metrics-daemon-44bfx\" (UID: \"937f81e1-d44b-4678-bcd7-82659b01b28b\") " pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-ovn-node-metrics-cert\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540744    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-multus-cni-dir\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540743    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-run-netns\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540812    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-dbus\") pod \"global-pull-secret-syncer-smq6d\" (UID: \"0dd7d302-1a20-4cda-9624-0ca2fcf630c2\") " pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540812    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-multus-cni-dir\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:05.540820    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-sys-fs\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540877    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-modprobe-d\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:05.540924    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs podName:937f81e1-d44b-4678-bcd7-82659b01b28b nodeName:}" failed. No retries permitted until 2026-07-09 18:41:06.040888875 +0000 UTC m=+2.102693886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs") pod "network-metrics-daemon-44bfx" (UID: "937f81e1-d44b-4678-bcd7-82659b01b28b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540941    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-sys\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540917    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-sys-fs\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540967    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-modprobe-d\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540969    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-var-lib-openvswitch\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.540998    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-log-socket\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541007    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-sys\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.541151 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541017    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541047    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-var-lib-openvswitch\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541051    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-cni-bin\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-cni-bin\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541078    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-log-socket\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541089    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a73a913c-bf13-428b-a876-8dfc0375a31e-system-cni-dir\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541108    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a73a913c-bf13-428b-a876-8dfc0375a31e-cnibin\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-systemd-units\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541154    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a73a913c-bf13-428b-a876-8dfc0375a31e-system-cni-dir\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541151    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-ovnkube-script-lib\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541186    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-systemd-units\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-kubelet-config\") pod \"global-pull-secret-syncer-smq6d\" (UID: \"0dd7d302-1a20-4cda-9624-0ca2fcf630c2\") " pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541216    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a73a913c-bf13-428b-a876-8dfc0375a31e-cnibin\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541220    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nwh\" (UniqueName: \"kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh\") pod \"network-check-target-cl4vn\" (UID: \"f3f3ace4-f8ed-4ee3-9713-3ec58d65a167\") " pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541224    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-kubelet-config\") pod \"global-pull-secret-syncer-smq6d\" (UID: \"0dd7d302-1a20-4cda-9624-0ca2fcf630c2\") " pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541348    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-sysctl-conf\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-host\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.541969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541406    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-slash\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541425    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-ovnkube-config\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541459    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/634b3428-ece4-44e5-918d-a676e5c475d3-cni-binary-copy\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541502    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-sysctl-conf\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541508    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/634b3428-ece4-44e5-918d-a676e5c475d3-multus-daemon-config\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541513    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-slash\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-kubernetes\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541564    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-var-lib-kubelet\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541574    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-host\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541588    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbd5d31d-39b7-478d-bb05-59da207c5158-tmp\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541596    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-kubernetes\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541614    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-var-lib-cni-multus\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541662    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-ovnkube-script-lib\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541670    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-var-lib-kubelet\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541707    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-var-lib-kubelet\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541747    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-var-lib-cni-multus\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541752    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a73a913c-bf13-428b-a876-8dfc0375a31e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541782    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48tsx\" (UniqueName: \"kubernetes.io/projected/287d24b2-f189-4492-bd7f-cfbd8eccf639-kube-api-access-48tsx\") pod \"node-ca-qg8vv\" (UID: \"287d24b2-f189-4492-bd7f-cfbd8eccf639\") " pod="openshift-image-registry/node-ca-qg8vv"
Jul 09 18:41:05.542855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541786    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-var-lib-kubelet\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/905732ad-cc05-4aab-8221-55a67a47993b-konnectivity-ca\") pod \"konnectivity-agent-lfhlt\" (UID: \"905732ad-cc05-4aab-8221-55a67a47993b\") " pod="kube-system/konnectivity-agent-lfhlt"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-registration-dir\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541884    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjdg8\" (UniqueName: \"kubernetes.io/projected/8141b265-74c4-419a-b292-f7f60c4124a8-kube-api-access-sjdg8\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-sysconfig\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541929    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c72544e1-a4e6-445c-8f79-5cc0aa9073fb-host-slash\") pod \"iptables-alerter-7sfg4\" (UID: \"c72544e1-a4e6-445c-8f79-5cc0aa9073fb\") " pod="openshift-network-operator/iptables-alerter-7sfg4"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541954    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-multus-conf-dir\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.541977    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c72544e1-a4e6-445c-8f79-5cc0aa9073fb-iptables-alerter-script\") pod \"iptables-alerter-7sfg4\" (UID: \"c72544e1-a4e6-445c-8f79-5cc0aa9073fb\") " pod="openshift-network-operator/iptables-alerter-7sfg4"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-run-k8s-cni-cncf-io\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-run-multus-certs\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542071    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nt7s\" (UniqueName: \"kubernetes.io/projected/634b3428-ece4-44e5-918d-a676e5c475d3-kube-api-access-6nt7s\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542092    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/287d24b2-f189-4492-bd7f-cfbd8eccf639-host\") pod \"node-ca-qg8vv\" (UID: \"287d24b2-f189-4492-bd7f-cfbd8eccf639\") " pod="openshift-image-registry/node-ca-qg8vv"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542115    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-run\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542121    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-ovnkube-config\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542140    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt4xh\" (UniqueName: \"kubernetes.io/projected/336b9318-00cd-482e-9705-569526f009d1-kube-api-access-mt4xh\") pod \"node-resolver-m7pwm\" (UID: \"336b9318-00cd-482e-9705-569526f009d1\") " pod="openshift-dns/node-resolver-m7pwm"
Jul 09 18:41:05.543741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542143    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/634b3428-ece4-44e5-918d-a676e5c475d3-cni-binary-copy\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542198    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/634b3428-ece4-44e5-918d-a676e5c475d3-multus-daemon-config\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542244    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-registration-dir\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542264    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542293    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-run-k8s-cni-cncf-io\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542294    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a73a913c-bf13-428b-a876-8dfc0375a31e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542348    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-run-multus-certs\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542396    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c72544e1-a4e6-445c-8f79-5cc0aa9073fb-host-slash\") pod \"iptables-alerter-7sfg4\" (UID: \"c72544e1-a4e6-445c-8f79-5cc0aa9073fb\") " pod="openshift-network-operator/iptables-alerter-7sfg4"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542402    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-sysconfig\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542446    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/287d24b2-f189-4492-bd7f-cfbd8eccf639-host\") pod \"node-ca-qg8vv\" (UID: \"287d24b2-f189-4492-bd7f-cfbd8eccf639\") " pod="openshift-image-registry/node-ca-qg8vv"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542444    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-cni-netd\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542518    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-run\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542520    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-multus-conf-dir\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542558    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-system-cni-dir\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542570    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542587    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a73a913c-bf13-428b-a876-8dfc0375a31e-cni-binary-copy\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542610    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-cni-netd\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.544533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542628    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-system-cni-dir\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542674    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542730    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-hostroot\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542749    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542756    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/336b9318-00cd-482e-9705-569526f009d1-tmp-dir\") pod \"node-resolver-m7pwm\" (UID: \"336b9318-00cd-482e-9705-569526f009d1\") " pod="openshift-dns/node-resolver-m7pwm"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542782    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjpk9\" (UniqueName: \"kubernetes.io/projected/c72544e1-a4e6-445c-8f79-5cc0aa9073fb-kube-api-access-vjpk9\") pod \"iptables-alerter-7sfg4\" (UID: \"c72544e1-a4e6-445c-8f79-5cc0aa9073fb\") " pod="openshift-network-operator/iptables-alerter-7sfg4"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542791    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-hostroot\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-kubelet\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542830    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret\") pod \"global-pull-secret-syncer-smq6d\" (UID: \"0dd7d302-1a20-4cda-9624-0ca2fcf630c2\") " pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-var-lib-cni-bin\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a73a913c-bf13-428b-a876-8dfc0375a31e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542902    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-etc-openvswitch\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-cnibin\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542927    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c72544e1-a4e6-445c-8f79-5cc0aa9073fb-iptables-alerter-script\") pod \"iptables-alerter-7sfg4\" (UID: \"c72544e1-a4e6-445c-8f79-5cc0aa9073fb\") " pod="openshift-network-operator/iptables-alerter-7sfg4"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-os-release\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542969    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-sysctl-d\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542981    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-host-var-lib-cni-bin\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.542990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-tuned\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.545104 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543012    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/905732ad-cc05-4aab-8221-55a67a47993b-konnectivity-ca\") pod \"konnectivity-agent-lfhlt\" (UID: \"905732ad-cc05-4aab-8221-55a67a47993b\") " pod="kube-system/konnectivity-agent-lfhlt"
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543019    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-run-ovn\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543043    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/905732ad-cc05-4aab-8221-55a67a47993b-agent-certs\") pod \"konnectivity-agent-lfhlt\" (UID: \"905732ad-cc05-4aab-8221-55a67a47993b\") " pod="kube-system/konnectivity-agent-lfhlt"
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543066    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-socket-dir\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543071    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-kubelet\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543079    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a73a913c-bf13-428b-a876-8dfc0375a31e-cni-binary-copy\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543108    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/336b9318-00cd-482e-9705-569526f009d1-tmp-dir\") pod \"node-resolver-m7pwm\" (UID: \"336b9318-00cd-482e-9705-569526f009d1\") " pod="openshift-dns/node-resolver-m7pwm"
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543132    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-cnibin\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543126    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-etc-openvswitch\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543174    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-run-systemd\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:05.543196    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543200    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-os-release\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543205    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvcdq\" (UniqueName: \"kubernetes.io/projected/a73a913c-bf13-428b-a876-8dfc0375a31e-kube-api-access-zvcdq\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543243    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a73a913c-bf13-428b-a876-8dfc0375a31e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:05.543251    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret podName:0dd7d302-1a20-4cda-9624-0ca2fcf630c2 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:06.043234242 +0000 UTC m=+2.105039251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret") pod "global-pull-secret-syncer-smq6d" (UID: "0dd7d302-1a20-4cda-9624-0ca2fcf630c2") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/287d24b2-f189-4492-bd7f-cfbd8eccf639-serviceca\") pod \"node-ca-qg8vv\" (UID: \"287d24b2-f189-4492-bd7f-cfbd8eccf639\") " pod="openshift-image-registry/node-ca-qg8vv"
Jul 09 18:41:05.545624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543309    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-lib-modules\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543335    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-socket-dir\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x28ss\" (UniqueName: \"kubernetes.io/projected/937f81e1-d44b-4678-bcd7-82659b01b28b-kube-api-access-x28ss\") pod \"network-metrics-daemon-44bfx\" (UID: \"937f81e1-d44b-4678-bcd7-82659b01b28b\") " pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543600    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-lib-modules\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543605    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-run-netns\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543509    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-sysctl-d\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543538    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-run-systemd\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543433    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-run-ovn-kubernetes\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543456    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-run-ovn\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-run-openvswitch\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-node-log\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543678    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-host-run-netns\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543688    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-env-overrides\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543711    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a73a913c-bf13-428b-a876-8dfc0375a31e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543727    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-run-openvswitch\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543733    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-device-dir\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-multus-socket-dir-parent\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.546147 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543830    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/634b3428-ece4-44e5-918d-a676e5c475d3-multus-socket-dir-parent\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.546636 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543858    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/287d24b2-f189-4492-bd7f-cfbd8eccf639-serviceca\") pod \"node-ca-qg8vv\" (UID: \"287d24b2-f189-4492-bd7f-cfbd8eccf639\") " pod="openshift-image-registry/node-ca-qg8vv"
Jul 09 18:41:05.546636 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.543964    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8141b265-74c4-419a-b292-f7f60c4124a8-device-dir\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.546636 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.544002    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-node-log\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.546636 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.544095    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-env-overrides\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.546636 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.544444    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-ovn-node-metrics-cert\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.546636 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.544476    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a73a913c-bf13-428b-a876-8dfc0375a31e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.546636 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.544990    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbd5d31d-39b7-478d-bb05-59da207c5158-tmp\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.546636 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.545847    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbd5d31d-39b7-478d-bb05-59da207c5158-etc-tuned\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.546636 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.546252    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/905732ad-cc05-4aab-8221-55a67a47993b-agent-certs\") pod \"konnectivity-agent-lfhlt\" (UID: \"905732ad-cc05-4aab-8221-55a67a47993b\") " pod="kube-system/konnectivity-agent-lfhlt"
Jul 09 18:41:05.552299 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:05.552281    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:41:05.552408 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:05.552305    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:41:05.552408 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:05.552319    2562 projected.go:196] Error preparing data for projected volume kube-api-access-j5nwh for pod openshift-network-diagnostics/network-check-target-cl4vn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:05.552408 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:05.552372    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh podName:f3f3ace4-f8ed-4ee3-9713-3ec58d65a167 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:06.052353163 +0000 UTC m=+2.114158190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j5nwh" (UniqueName: "kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh") pod "network-check-target-cl4vn" (UID: "f3f3ace4-f8ed-4ee3-9713-3ec58d65a167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:05.553345 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.553323    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw8xm\" (UniqueName: \"kubernetes.io/projected/fbd5d31d-39b7-478d-bb05-59da207c5158-kube-api-access-sw8xm\") pod \"tuned-t58ks\" (UID: \"fbd5d31d-39b7-478d-bb05-59da207c5158\") " pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.555884 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.555838    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48tsx\" (UniqueName: \"kubernetes.io/projected/287d24b2-f189-4492-bd7f-cfbd8eccf639-kube-api-access-48tsx\") pod \"node-ca-qg8vv\" (UID: \"287d24b2-f189-4492-bd7f-cfbd8eccf639\") " pod="openshift-image-registry/node-ca-qg8vv"
Jul 09 18:41:05.556086 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.556046    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjdg8\" (UniqueName: \"kubernetes.io/projected/8141b265-74c4-419a-b292-f7f60c4124a8-kube-api-access-sjdg8\") pod \"aws-ebs-csi-driver-node-87n2x\" (UID: \"8141b265-74c4-419a-b292-f7f60c4124a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.556373 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.556318    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nt7s\" (UniqueName: \"kubernetes.io/projected/634b3428-ece4-44e5-918d-a676e5c475d3-kube-api-access-6nt7s\") pod \"multus-74ps2\" (UID: \"634b3428-ece4-44e5-918d-a676e5c475d3\") " pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.556545 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.556458    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt4xh\" (UniqueName: \"kubernetes.io/projected/336b9318-00cd-482e-9705-569526f009d1-kube-api-access-mt4xh\") pod \"node-resolver-m7pwm\" (UID: \"336b9318-00cd-482e-9705-569526f009d1\") " pod="openshift-dns/node-resolver-m7pwm"
Jul 09 18:41:05.556610 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.556545    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvcdq\" (UniqueName: \"kubernetes.io/projected/a73a913c-bf13-428b-a876-8dfc0375a31e-kube-api-access-zvcdq\") pod \"multus-additional-cni-plugins-6zm9b\" (UID: \"a73a913c-bf13-428b-a876-8dfc0375a31e\") " pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.557212 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.557193    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjpk9\" (UniqueName: \"kubernetes.io/projected/c72544e1-a4e6-445c-8f79-5cc0aa9073fb-kube-api-access-vjpk9\") pod \"iptables-alerter-7sfg4\" (UID: \"c72544e1-a4e6-445c-8f79-5cc0aa9073fb\") " pod="openshift-network-operator/iptables-alerter-7sfg4"
Jul 09 18:41:05.557606 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.557586    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x28ss\" (UniqueName: \"kubernetes.io/projected/937f81e1-d44b-4678-bcd7-82659b01b28b-kube-api-access-x28ss\") pod \"network-metrics-daemon-44bfx\" (UID: \"937f81e1-d44b-4678-bcd7-82659b01b28b\") " pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:05.557983 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.557964    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fgp4\" (UniqueName: \"kubernetes.io/projected/e0e5ba40-3cfa-43fc-920f-b8257e57f5d5-kube-api-access-7fgp4\") pod \"ovnkube-node-zrbn6\" (UID: \"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.584542 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:05.584501    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa2436aae3e2c2acd74ee4735978d53f.slice/crio-cd1b6654ecfb5d1d17007e293aeedeb330f28c6efaf1970f9e9f88fa0328cf52 WatchSource:0}: Error finding container cd1b6654ecfb5d1d17007e293aeedeb330f28c6efaf1970f9e9f88fa0328cf52: Status 404 returned error can't find the container with id cd1b6654ecfb5d1d17007e293aeedeb330f28c6efaf1970f9e9f88fa0328cf52
Jul 09 18:41:05.585022 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:05.585001    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d53067e3c408632770d4f8c1feeef25.slice/crio-2fc75e0ad9fcaac5528bb6a21adea7716075c6aa695ec2f7a9c9cf2e7d53b8ec WatchSource:0}: Error finding container 2fc75e0ad9fcaac5528bb6a21adea7716075c6aa695ec2f7a9c9cf2e7d53b8ec: Status 404 returned error can't find the container with id 2fc75e0ad9fcaac5528bb6a21adea7716075c6aa695ec2f7a9c9cf2e7d53b8ec
Jul 09 18:41:05.590000 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.589986    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:41:05.670401 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.670322    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lfhlt"
Jul 09 18:41:05.674018 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.674000    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x"
Jul 09 18:41:05.678169 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.678148    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:41:05.680633 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:05.680605    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905732ad_cc05_4aab_8221_55a67a47993b.slice/crio-ca35cd52bd6a25b17df71ad35c721d963c410dd5ee2ba12e57efcd7b2ce243cc WatchSource:0}: Error finding container ca35cd52bd6a25b17df71ad35c721d963c410dd5ee2ba12e57efcd7b2ce243cc: Status 404 returned error can't find the container with id ca35cd52bd6a25b17df71ad35c721d963c410dd5ee2ba12e57efcd7b2ce243cc
Jul 09 18:41:05.682182 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:05.682141    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8141b265_74c4_419a_b292_f7f60c4124a8.slice/crio-158f42d861facfa54b7d0b568e1ea9308e792905bc826b940bd952ce1295303d WatchSource:0}: Error finding container 158f42d861facfa54b7d0b568e1ea9308e792905bc826b940bd952ce1295303d: Status 404 returned error can't find the container with id 158f42d861facfa54b7d0b568e1ea9308e792905bc826b940bd952ce1295303d
Jul 09 18:41:05.694924 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.694901    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t58ks"
Jul 09 18:41:05.704974 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:05.704957    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd5d31d_39b7_478d_bb05_59da207c5158.slice/crio-e5d07c227eb7cc22f71c5855ddb7494edf887b38ffade5850543382303f6a352 WatchSource:0}: Error finding container e5d07c227eb7cc22f71c5855ddb7494edf887b38ffade5850543382303f6a352: Status 404 returned error can't find the container with id e5d07c227eb7cc22f71c5855ddb7494edf887b38ffade5850543382303f6a352
Jul 09 18:41:05.709831 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.709815    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-74ps2"
Jul 09 18:41:05.713141 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.713124    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6zm9b"
Jul 09 18:41:05.717327 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:05.717306    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634b3428_ece4_44e5_918d_a676e5c475d3.slice/crio-a97c9f85fac2729a55d6e8fe92121ba4aae3e23eb6127c4a31073ddd87dcc3c1 WatchSource:0}: Error finding container a97c9f85fac2729a55d6e8fe92121ba4aae3e23eb6127c4a31073ddd87dcc3c1: Status 404 returned error can't find the container with id a97c9f85fac2729a55d6e8fe92121ba4aae3e23eb6127c4a31073ddd87dcc3c1
Jul 09 18:41:05.720795 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:05.720778    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda73a913c_bf13_428b_a876_8dfc0375a31e.slice/crio-3e918298207bce7e543507f0748e1e4f7ae40f8c1d13af1fd3c94cbb6cfa2b53 WatchSource:0}: Error finding container 3e918298207bce7e543507f0748e1e4f7ae40f8c1d13af1fd3c94cbb6cfa2b53: Status 404 returned error can't find the container with id 3e918298207bce7e543507f0748e1e4f7ae40f8c1d13af1fd3c94cbb6cfa2b53
Jul 09 18:41:05.731510 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.731471    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m7pwm"
Jul 09 18:41:05.737146 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.737131    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qg8vv"
Jul 09 18:41:05.741841 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:05.741824    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod336b9318_00cd_482e_9705_569526f009d1.slice/crio-9b62912b4c9a18e68fbfba72ff495a4526523e367bef58ef61925f772b48983e WatchSource:0}: Error finding container 9b62912b4c9a18e68fbfba72ff495a4526523e367bef58ef61925f772b48983e: Status 404 returned error can't find the container with id 9b62912b4c9a18e68fbfba72ff495a4526523e367bef58ef61925f772b48983e
Jul 09 18:41:05.746239 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:05.746221    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287d24b2_f189_4492_bd7f_cfbd8eccf639.slice/crio-9077b84326910efcba2b0a64a8a57d7453e3b3b842ffd834a11dc120e7c298ba WatchSource:0}: Error finding container 9077b84326910efcba2b0a64a8a57d7453e3b3b842ffd834a11dc120e7c298ba: Status 404 returned error can't find the container with id 9077b84326910efcba2b0a64a8a57d7453e3b3b842ffd834a11dc120e7c298ba
Jul 09 18:41:05.770457 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.770438    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7sfg4"
Jul 09 18:41:05.775047 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:05.775035    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:05.778588 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:05.778569    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc72544e1_a4e6_445c_8f79_5cc0aa9073fb.slice/crio-6f8fc2fe1f03b6880d0f87294c7df0669b476b0b78a93b5eaba5488a501006d3 WatchSource:0}: Error finding container 6f8fc2fe1f03b6880d0f87294c7df0669b476b0b78a93b5eaba5488a501006d3: Status 404 returned error can't find the container with id 6f8fc2fe1f03b6880d0f87294c7df0669b476b0b78a93b5eaba5488a501006d3
Jul 09 18:41:05.783081 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:05.783066    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e5ba40_3cfa_43fc_920f_b8257e57f5d5.slice/crio-92e58497045fa7ef9211b61a5210426111b9edf9472b4db21e22817cfee530e2 WatchSource:0}: Error finding container 92e58497045fa7ef9211b61a5210426111b9edf9472b4db21e22817cfee530e2: Status 404 returned error can't find the container with id 92e58497045fa7ef9211b61a5210426111b9edf9472b4db21e22817cfee530e2
Jul 09 18:41:05.784535 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:05.784515    2562 kuberuntime_manager.go:1459] "Unhandled Error" err="container ovn-controller start failed in pod ovnkube-node-zrbn6_openshift-ovn-kubernetes(e0e5ba40-3cfa-43fc-920f-b8257e57f5d5): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 09 18:41:05.785647 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:05.785630    2562 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-rbac-proxy-node start failed in pod ovnkube-node-zrbn6_openshift-ovn-kubernetes(e0e5ba40-3cfa-43fc-920f-b8257e57f5d5): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 09 18:41:05.788660 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:05.788619    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ErrImagePull: \"pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9d1573db16143027c8ffaf46a01ce12f2bcd89c15410c42ca54be4b3b1ddfdd6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6" podUID="e0e5ba40-3cfa-43fc-920f-b8257e57f5d5"
Jul 09 18:41:06.047686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:06.047608    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret\") pod \"global-pull-secret-syncer-smq6d\" (UID: \"0dd7d302-1a20-4cda-9624-0ca2fcf630c2\") " pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:06.047686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:06.047648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs\") pod \"network-metrics-daemon-44bfx\" (UID: \"937f81e1-d44b-4678-bcd7-82659b01b28b\") " pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:06.047866 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:06.047734    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:06.047866 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:06.047738    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:06.047866 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:06.047780    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs podName:937f81e1-d44b-4678-bcd7-82659b01b28b nodeName:}" failed. No retries permitted until 2026-07-09 18:41:07.047767967 +0000 UTC m=+3.109572973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs") pod "network-metrics-daemon-44bfx" (UID: "937f81e1-d44b-4678-bcd7-82659b01b28b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:06.047866 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:06.047792    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret podName:0dd7d302-1a20-4cda-9624-0ca2fcf630c2 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:07.047786569 +0000 UTC m=+3.109591575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret") pod "global-pull-secret-syncer-smq6d" (UID: "0dd7d302-1a20-4cda-9624-0ca2fcf630c2") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:07.849070 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:07.849036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nwh\" (UniqueName: \"kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh\") pod \"network-check-target-cl4vn\" (UID: \"f3f3ace4-f8ed-4ee3-9713-3ec58d65a167\") " pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:07.849252 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:07.849232    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:41:07.849312 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:07.849259    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:41:07.849312 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:07.849270    2562 projected.go:196] Error preparing data for projected volume kube-api-access-j5nwh for pod openshift-network-diagnostics/network-check-target-cl4vn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:07.849388 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:07.849339    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh podName:f3f3ace4-f8ed-4ee3-9713-3ec58d65a167 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:08.849324043 +0000 UTC m=+3.210471200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5nwh" (UniqueName: "kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh") pod "network-check-target-cl4vn" (UID: "f3f3ace4-f8ed-4ee3-9713-3ec58d65a167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:08.044599 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.044527    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:41:08.148765 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.148732    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:08.148958 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:08.148868    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:08.160483 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.160210    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:36:07 +0000 UTC" deadline="2028-03-23 12:50:20.70856383 +0000 UTC"
Jul 09 18:41:08.160483 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.160242    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14946h9m12.548326387s"
Jul 09 18:41:08.173904 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.173844    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qg8vv" event={"ID":"287d24b2-f189-4492-bd7f-cfbd8eccf639","Type":"ContainerStarted","Data":"9077b84326910efcba2b0a64a8a57d7453e3b3b842ffd834a11dc120e7c298ba"}
Jul 09 18:41:08.183630 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.183556    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m7pwm" event={"ID":"336b9318-00cd-482e-9705-569526f009d1","Type":"ContainerStarted","Data":"9b62912b4c9a18e68fbfba72ff495a4526523e367bef58ef61925f772b48983e"}
Jul 09 18:41:08.188489 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.188460    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x" event={"ID":"8141b265-74c4-419a-b292-f7f60c4124a8","Type":"ContainerStarted","Data":"158f42d861facfa54b7d0b568e1ea9308e792905bc826b940bd952ce1295303d"}
Jul 09 18:41:08.195599 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.195572    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lfhlt" event={"ID":"905732ad-cc05-4aab-8221-55a67a47993b","Type":"ContainerStarted","Data":"ca35cd52bd6a25b17df71ad35c721d963c410dd5ee2ba12e57efcd7b2ce243cc"}
Jul 09 18:41:08.203714 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.203689    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal" event={"ID":"aa2436aae3e2c2acd74ee4735978d53f","Type":"ContainerStarted","Data":"cd1b6654ecfb5d1d17007e293aeedeb330f28c6efaf1970f9e9f88fa0328cf52"}
Jul 09 18:41:08.211300 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.211275    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal" event={"ID":"9d53067e3c408632770d4f8c1feeef25","Type":"ContainerStarted","Data":"2fc75e0ad9fcaac5528bb6a21adea7716075c6aa695ec2f7a9c9cf2e7d53b8ec"}
Jul 09 18:41:08.215942 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.215918    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6" event={"ID":"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5","Type":"ContainerStarted","Data":"92e58497045fa7ef9211b61a5210426111b9edf9472b4db21e22817cfee530e2"}
Jul 09 18:41:08.226451 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.226423    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7sfg4" event={"ID":"c72544e1-a4e6-445c-8f79-5cc0aa9073fb","Type":"ContainerStarted","Data":"6f8fc2fe1f03b6880d0f87294c7df0669b476b0b78a93b5eaba5488a501006d3"}
Jul 09 18:41:08.230196 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.230170    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zm9b" event={"ID":"a73a913c-bf13-428b-a876-8dfc0375a31e","Type":"ContainerStarted","Data":"3e918298207bce7e543507f0748e1e4f7ae40f8c1d13af1fd3c94cbb6cfa2b53"}
Jul 09 18:41:08.242264 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:08.242204    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="[failed to \"StartContainer\" for \"ovn-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovn-acl-logging\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-node\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9d1573db16143027c8ffaf46a01ce12f2bcd89c15410c42ca54be4b3b1ddfdd6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"kube-rbac-proxy-ovn-metrics\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:9d1573db16143027c8ffaf46a01ce12f2bcd89c15410c42ca54be4b3b1ddfdd6\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"northd\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"nbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"sbdb\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\", failed to \"StartContainer\" for \"ovnkube-controller\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:fc4c36822d1ce0f4acab78208d171b757bca1285f69c9653d5a959fa853d8470\\\": ErrImagePull: pull QPS exceeded\"]" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6" podUID="e0e5ba40-3cfa-43fc-920f-b8257e57f5d5"
Jul 09 18:41:08.242427 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.242405    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-74ps2" event={"ID":"634b3428-ece4-44e5-918d-a676e5c475d3","Type":"ContainerStarted","Data":"a97c9f85fac2729a55d6e8fe92121ba4aae3e23eb6127c4a31073ddd87dcc3c1"}
Jul 09 18:41:08.246739 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.246674    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t58ks" event={"ID":"fbd5d31d-39b7-478d-bb05-59da207c5158","Type":"ContainerStarted","Data":"e5d07c227eb7cc22f71c5855ddb7494edf887b38ffade5850543382303f6a352"}
Jul 09 18:41:08.607060 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.606857    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 18:41:08.764831 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.764796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret\") pod \"global-pull-secret-syncer-smq6d\" (UID: \"0dd7d302-1a20-4cda-9624-0ca2fcf630c2\") " pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:08.765010 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.764860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs\") pod \"network-metrics-daemon-44bfx\" (UID: \"937f81e1-d44b-4678-bcd7-82659b01b28b\") " pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:08.765010 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:08.765001    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:08.765110 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:08.765060    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs podName:937f81e1-d44b-4678-bcd7-82659b01b28b nodeName:}" failed. No retries permitted until 2026-07-09 18:41:10.765042509 +0000 UTC m=+5.126189680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs") pod "network-metrics-daemon-44bfx" (UID: "937f81e1-d44b-4678-bcd7-82659b01b28b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:08.765211 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:08.765117    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:08.765211 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:08.765163    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret podName:0dd7d302-1a20-4cda-9624-0ca2fcf630c2 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:10.76513623 +0000 UTC m=+5.126283388 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret") pod "global-pull-secret-syncer-smq6d" (UID: "0dd7d302-1a20-4cda-9624-0ca2fcf630c2") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:08.865532 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:08.865452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nwh\" (UniqueName: \"kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh\") pod \"network-check-target-cl4vn\" (UID: \"f3f3ace4-f8ed-4ee3-9713-3ec58d65a167\") " pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:08.865696 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:08.865662    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:41:08.865696 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:08.865683    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:41:08.865696 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:08.865696    2562 projected.go:196] Error preparing data for projected volume kube-api-access-j5nwh for pod openshift-network-diagnostics/network-check-target-cl4vn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:08.865859 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:08.865749    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh podName:f3f3ace4-f8ed-4ee3-9713-3ec58d65a167 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:10.865731682 +0000 UTC m=+5.226878857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5nwh" (UniqueName: "kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh") pod "network-check-target-cl4vn" (UID: "f3f3ace4-f8ed-4ee3-9713-3ec58d65a167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:09.148179 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:09.148080    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:09.148615 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:09.148228    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:09.148676 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:09.148621    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:09.148990 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:09.148751    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:09.160453 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:09.160375    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 18:36:07 +0000 UTC" deadline="2028-02-16 00:17:25.203135598 +0000 UTC"
Jul 09 18:41:09.160453 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:09.160429    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14069h36m16.042711202s"
Jul 09 18:41:10.150013 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:10.149985    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:10.150422 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:10.150114    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:10.782420 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:10.782384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret\") pod \"global-pull-secret-syncer-smq6d\" (UID: \"0dd7d302-1a20-4cda-9624-0ca2fcf630c2\") " pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:10.782578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:10.782438    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs\") pod \"network-metrics-daemon-44bfx\" (UID: \"937f81e1-d44b-4678-bcd7-82659b01b28b\") " pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:10.782578 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:10.782561    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:10.782578 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:10.782560    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:10.782715 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:10.782627    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs podName:937f81e1-d44b-4678-bcd7-82659b01b28b nodeName:}" failed. No retries permitted until 2026-07-09 18:41:14.782607159 +0000 UTC m=+9.143754326 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs") pod "network-metrics-daemon-44bfx" (UID: "937f81e1-d44b-4678-bcd7-82659b01b28b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:10.782715 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:10.782643    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret podName:0dd7d302-1a20-4cda-9624-0ca2fcf630c2 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:14.782637324 +0000 UTC m=+9.143784485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret") pod "global-pull-secret-syncer-smq6d" (UID: "0dd7d302-1a20-4cda-9624-0ca2fcf630c2") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:10.883734 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:10.883692    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nwh\" (UniqueName: \"kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh\") pod \"network-check-target-cl4vn\" (UID: \"f3f3ace4-f8ed-4ee3-9713-3ec58d65a167\") " pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:10.883914 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:10.883896    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:41:10.883975 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:10.883924    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:41:10.883975 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:10.883939    2562 projected.go:196] Error preparing data for projected volume kube-api-access-j5nwh for pod openshift-network-diagnostics/network-check-target-cl4vn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:10.884074 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:10.884000    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh podName:f3f3ace4-f8ed-4ee3-9713-3ec58d65a167 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:14.883980162 +0000 UTC m=+9.245127324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5nwh" (UniqueName: "kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh") pod "network-check-target-cl4vn" (UID: "f3f3ace4-f8ed-4ee3-9713-3ec58d65a167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:11.147659 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:11.147572    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:11.147659 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:11.147617    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:11.147868 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:11.147721    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:11.147868 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:11.147838    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:12.150071 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:12.150033    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:12.150536 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:12.150181    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:13.147568 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:13.147536    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:13.147737 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:13.147550    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:13.147737 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:13.147651    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:13.147835 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:13.147764    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:14.148152 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:14.147724    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:14.148152 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:14.147850    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:14.811969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:14.811878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret\") pod \"global-pull-secret-syncer-smq6d\" (UID: \"0dd7d302-1a20-4cda-9624-0ca2fcf630c2\") " pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:14.811969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:14.811950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs\") pod \"network-metrics-daemon-44bfx\" (UID: \"937f81e1-d44b-4678-bcd7-82659b01b28b\") " pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:14.812220 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:14.812039    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:14.812220 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:14.812057    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:14.812220 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:14.812114    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret podName:0dd7d302-1a20-4cda-9624-0ca2fcf630c2 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:22.812098126 +0000 UTC m=+17.173245287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret") pod "global-pull-secret-syncer-smq6d" (UID: "0dd7d302-1a20-4cda-9624-0ca2fcf630c2") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:14.812220 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:14.812131    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs podName:937f81e1-d44b-4678-bcd7-82659b01b28b nodeName:}" failed. No retries permitted until 2026-07-09 18:41:22.812123855 +0000 UTC m=+17.173271013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs") pod "network-metrics-daemon-44bfx" (UID: "937f81e1-d44b-4678-bcd7-82659b01b28b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:14.912733 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:14.912660    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nwh\" (UniqueName: \"kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh\") pod \"network-check-target-cl4vn\" (UID: \"f3f3ace4-f8ed-4ee3-9713-3ec58d65a167\") " pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:14.912914 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:14.912895    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:41:14.912981 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:14.912919    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:41:14.913029 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:14.912982    2562 projected.go:196] Error preparing data for projected volume kube-api-access-j5nwh for pod openshift-network-diagnostics/network-check-target-cl4vn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:14.913083 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:14.913057    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh podName:f3f3ace4-f8ed-4ee3-9713-3ec58d65a167 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:22.913035409 +0000 UTC m=+17.274182590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5nwh" (UniqueName: "kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh") pod "network-check-target-cl4vn" (UID: "f3f3ace4-f8ed-4ee3-9713-3ec58d65a167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:15.147602 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:15.147523    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:15.147602 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:15.147565    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:15.147819 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:15.147634    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:15.147819 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:15.147760    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:16.147871 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:16.147839    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:16.148276 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:16.147936    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:17.147741 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.147525    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:17.147870 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.147587    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:17.147870 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:17.147785    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:17.147870 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:17.147852    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:17.270465 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.270369    2562 generic.go:356] "Generic (PLEG): container finished" podID="a73a913c-bf13-428b-a876-8dfc0375a31e" containerID="f1a4500a15333931b889482242cc1a0eaa202dfeef866856ebebe8ab5a48aff9" exitCode=0
Jul 09 18:41:17.270608 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.270457    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zm9b" event={"ID":"a73a913c-bf13-428b-a876-8dfc0375a31e","Type":"ContainerDied","Data":"f1a4500a15333931b889482242cc1a0eaa202dfeef866856ebebe8ab5a48aff9"}
Jul 09 18:41:17.272093 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.272073    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t58ks" event={"ID":"fbd5d31d-39b7-478d-bb05-59da207c5158","Type":"ContainerStarted","Data":"9c7708af3cfc1f1ef46f01fd55deb3e5c13eb833cccfdf34beb53aced65087fe"}
Jul 09 18:41:17.273556 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.273536    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qg8vv" event={"ID":"287d24b2-f189-4492-bd7f-cfbd8eccf639","Type":"ContainerStarted","Data":"c03ad5e6551820e96b4dcefffe20f677b0d84aea2145bd982b39675caf84bf14"}
Jul 09 18:41:17.275064 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.275047    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m7pwm" event={"ID":"336b9318-00cd-482e-9705-569526f009d1","Type":"ContainerStarted","Data":"d6e72f4ca91fa84863bf4a0edccae0f52d1a53cc87600ceedad6d6e6bb56c8c7"}
Jul 09 18:41:17.276281 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.276265    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x" event={"ID":"8141b265-74c4-419a-b292-f7f60c4124a8","Type":"ContainerStarted","Data":"1e8857b78eb1edf5799ced84cd44cf63e0fbe092711928e36b509c384e0d4bdc"}
Jul 09 18:41:17.277592 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.277568    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lfhlt" event={"ID":"905732ad-cc05-4aab-8221-55a67a47993b","Type":"ContainerStarted","Data":"81435c9aad125376ae73d2d61f8de1e652242acb36a2d08ac38fc7d0ad2cbdcb"}
Jul 09 18:41:17.278907 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.278889    2562 generic.go:356] "Generic (PLEG): container finished" podID="aa2436aae3e2c2acd74ee4735978d53f" containerID="6226e32d53640482284c9755d4315f287ebd6d77bedda07eda594e7eb0455d09" exitCode=0
Jul 09 18:41:17.278985 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.278954    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal" event={"ID":"aa2436aae3e2c2acd74ee4735978d53f","Type":"ContainerDied","Data":"6226e32d53640482284c9755d4315f287ebd6d77bedda07eda594e7eb0455d09"}
Jul 09 18:41:17.280408 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.280389    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal" event={"ID":"9d53067e3c408632770d4f8c1feeef25","Type":"ContainerStarted","Data":"2351b55774974e03c0e1ed9e16c9a04a8f2b146998a51deee174b6907ea4c4a2"}
Jul 09 18:41:17.398875 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.398789    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-47.ec2.internal" podStartSLOduration=11.39877447 podStartE2EDuration="11.39877447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:17.379182023 +0000 UTC m=+11.740329203" watchObservedRunningTime="2026-07-09 18:41:17.39877447 +0000 UTC m=+11.759921707"
Jul 09 18:41:17.399118 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.399096    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m7pwm" podStartSLOduration=2.283661511 podStartE2EDuration="11.399087921s" totalImagesPullingTime="9.11542641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:17.39891471 +0000 UTC m=+11.760061912" watchObservedRunningTime="2026-07-09 18:41:17.399087921 +0000 UTC m=+11.760235100"
Jul 09 18:41:17.435801 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.435759    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qg8vv" podStartSLOduration=2.330982318 podStartE2EDuration="11.435741863s" totalImagesPullingTime="9.104759545s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:17.414821049 +0000 UTC m=+11.775968229" watchObservedRunningTime="2026-07-09 18:41:17.435741863 +0000 UTC m=+11.796889042"
Jul 09 18:41:17.457875 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.457829    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lfhlt" podStartSLOduration=2.291360636 podStartE2EDuration="11.45781619s" totalImagesPullingTime="9.166455554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:17.435399272 +0000 UTC m=+11.796546453" watchObservedRunningTime="2026-07-09 18:41:17.45781619 +0000 UTC m=+11.818963374"
Jul 09 18:41:17.458025 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:17.458001    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t58ks" podStartSLOduration=2.207262581 podStartE2EDuration="11.457991743s" totalImagesPullingTime="9.250729162s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:17.457052583 +0000 UTC m=+11.818199772" watchObservedRunningTime="2026-07-09 18:41:17.457991743 +0000 UTC m=+11.819138924"
Jul 09 18:41:18.065957 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:18.065730    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 18:41:18.114146 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:18.114043    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T18:41:18.0659549Z","UUID":"2b7af36d-d257-4aa5-ab39-c48bcfaaacdd","Handler":null,"Name":"","Endpoint":""}
Jul 09 18:41:18.115217 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:18.115199    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 18:41:18.115286 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:18.115233    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 18:41:18.125068 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:18.125050    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lfhlt"
Jul 09 18:41:18.125531 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:18.125517    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lfhlt"
Jul 09 18:41:18.148020 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:18.147969    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:18.148464 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:18.148075    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:18.283516 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:18.283486    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x" event={"ID":"8141b265-74c4-419a-b292-f7f60c4124a8","Type":"ContainerStarted","Data":"bcafaa36f0fbb20bda144a3f267f1a2a9b54b1a137324437f2d2383080ee716d"}
Jul 09 18:41:18.285135 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:18.285110    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal" event={"ID":"aa2436aae3e2c2acd74ee4735978d53f","Type":"ContainerStarted","Data":"a05bc3d1bb55eda3cea0fa0974c5d188275c8f67c927b063062ab6ca314a1681"}
Jul 09 18:41:18.286542 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:18.286518    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7sfg4" event={"ID":"c72544e1-a4e6-445c-8f79-5cc0aa9073fb","Type":"ContainerStarted","Data":"250837c6028b27ca2ff8750e0516e9626641dc5034af549bfe882867f59f1f88"}
Jul 09 18:41:18.302205 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:18.302162    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-47.ec2.internal" podStartSLOduration=12.302126844 podStartE2EDuration="12.302126844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:18.301854835 +0000 UTC m=+12.663002015" watchObservedRunningTime="2026-07-09 18:41:18.302126844 +0000 UTC m=+12.663274024"
Jul 09 18:41:18.318907 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:18.318872    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7sfg4" podStartSLOduration=3.246272017 podStartE2EDuration="12.318860235s" totalImagesPullingTime="9.072588218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:18.318588825 +0000 UTC m=+12.679736004" watchObservedRunningTime="2026-07-09 18:41:18.318860235 +0000 UTC m=+12.680007415"
Jul 09 18:41:19.147273 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:19.147252    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:19.147360 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:19.147345    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:19.147429 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:19.147402    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:19.147529 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:19.147502    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:19.290473 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:19.290439    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x" event={"ID":"8141b265-74c4-419a-b292-f7f60c4124a8","Type":"ContainerStarted","Data":"f52b044f19a2dfb10ec402b3916b7e5fe874e09f27480b4e003905eefb314655"}
Jul 09 18:41:19.290473 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:19.290473    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 18:41:19.312050 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:19.312011    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87n2x" podStartSLOduration=1.994134659 podStartE2EDuration="13.311999012s" totalImagesPullingTime="11.317864353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:19.311789525 +0000 UTC m=+13.672936704" watchObservedRunningTime="2026-07-09 18:41:19.311999012 +0000 UTC m=+13.673146229"
Jul 09 18:41:20.147597 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:20.147562    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:20.147785 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:20.147706    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:21.148156 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:21.148105    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:21.148619 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:21.148232    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:21.148619 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:21.148255    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:21.148619 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:21.148524    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:22.148268 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:22.148234    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:22.148728 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:22.148365    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:22.870822 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:22.870778    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret\") pod \"global-pull-secret-syncer-smq6d\" (UID: \"0dd7d302-1a20-4cda-9624-0ca2fcf630c2\") " pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:22.871008 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:22.870842    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs\") pod \"network-metrics-daemon-44bfx\" (UID: \"937f81e1-d44b-4678-bcd7-82659b01b28b\") " pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:22.871008 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:22.870952    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:22.871008 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:22.870980    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:22.871192 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:22.871029    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret podName:0dd7d302-1a20-4cda-9624-0ca2fcf630c2 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:38.871006978 +0000 UTC m=+33.232154157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret") pod "global-pull-secret-syncer-smq6d" (UID: "0dd7d302-1a20-4cda-9624-0ca2fcf630c2") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:22.871192 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:22.871049    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs podName:937f81e1-d44b-4678-bcd7-82659b01b28b nodeName:}" failed. No retries permitted until 2026-07-09 18:41:38.871040181 +0000 UTC m=+33.232187341 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs") pod "network-metrics-daemon-44bfx" (UID: "937f81e1-d44b-4678-bcd7-82659b01b28b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:22.971351 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:22.971317    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nwh\" (UniqueName: \"kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh\") pod \"network-check-target-cl4vn\" (UID: \"f3f3ace4-f8ed-4ee3-9713-3ec58d65a167\") " pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:22.971509 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:22.971448    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:41:22.971509 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:22.971465    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:41:22.971509 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:22.971474    2562 projected.go:196] Error preparing data for projected volume kube-api-access-j5nwh for pod openshift-network-diagnostics/network-check-target-cl4vn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:22.971634 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:22.971526    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh podName:f3f3ace4-f8ed-4ee3-9713-3ec58d65a167 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:38.97150799 +0000 UTC m=+33.332655147 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5nwh" (UniqueName: "kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh") pod "network-check-target-cl4vn" (UID: "f3f3ace4-f8ed-4ee3-9713-3ec58d65a167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:23.148203 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:23.147620    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:23.148203 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:23.147763    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:23.148203 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:23.147803    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:23.148203 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:23.147870    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:24.149108 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:24.149078    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:24.149685 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:24.149224    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:25.147287 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:25.147259    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:25.147470 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:25.147268    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:25.147470 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:25.147371    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:25.147470 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:25.147452    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:25.261546 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:25.261516    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lfhlt"
Jul 09 18:41:25.261967 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:25.261650    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 18:41:25.262214 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:25.262199    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lfhlt"
Jul 09 18:41:26.148178 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:26.148152    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:26.148363 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:26.148335    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:27.147334 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:27.147305    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:27.147334 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:27.147328    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:27.147709 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:27.147419    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:27.147709 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:27.147534    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:27.309383 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:27.309330    2562 generic.go:356] "Generic (PLEG): container finished" podID="a73a913c-bf13-428b-a876-8dfc0375a31e" containerID="466ba727ca7ad1b0c0f7fc22fb41cd1198c8c2e43d9058f82b9a5596d3f48bc5" exitCode=0
Jul 09 18:41:27.309597 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:27.309420    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zm9b" event={"ID":"a73a913c-bf13-428b-a876-8dfc0375a31e","Type":"ContainerDied","Data":"466ba727ca7ad1b0c0f7fc22fb41cd1198c8c2e43d9058f82b9a5596d3f48bc5"}
Jul 09 18:41:27.311039 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:27.311011    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-74ps2" event={"ID":"634b3428-ece4-44e5-918d-a676e5c475d3","Type":"ContainerStarted","Data":"fb3418b67da9e74bc75ee1ad7940061602aec88fcb7bfa6a18df346844f6ec89"}
Jul 09 18:41:27.397597 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:27.397519    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-74ps2" podStartSLOduration=2.44839507 podStartE2EDuration="21.397505144s" totalImagesPullingTime="18.949110074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:27.397437098 +0000 UTC m=+21.758584278" watchObservedRunningTime="2026-07-09 18:41:27.397505144 +0000 UTC m=+21.758652323"
Jul 09 18:41:28.147853 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:28.147830    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:28.148220 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:28.147959    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:28.314271 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:28.314241    2562 generic.go:356] "Generic (PLEG): container finished" podID="a73a913c-bf13-428b-a876-8dfc0375a31e" containerID="5c5abf652f5f9710c5b4f43668be12702e0d6060bd1cb460d6313f4ac8d71b38" exitCode=0
Jul 09 18:41:28.314374 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:28.314321    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zm9b" event={"ID":"a73a913c-bf13-428b-a876-8dfc0375a31e","Type":"ContainerDied","Data":"5c5abf652f5f9710c5b4f43668be12702e0d6060bd1cb460d6313f4ac8d71b38"}
Jul 09 18:41:29.147374 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:29.147347    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:29.147472 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:29.147360    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:29.147472 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:29.147461    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:29.147611 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:29.147570    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:29.318327 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:29.318260    2562 generic.go:356] "Generic (PLEG): container finished" podID="a73a913c-bf13-428b-a876-8dfc0375a31e" containerID="8080ff3aff741a8a997bec890111842f534ac11a61521e8d93560e6cac846639" exitCode=0
Jul 09 18:41:29.318327 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:29.318309    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zm9b" event={"ID":"a73a913c-bf13-428b-a876-8dfc0375a31e","Type":"ContainerDied","Data":"8080ff3aff741a8a997bec890111842f534ac11a61521e8d93560e6cac846639"}
Jul 09 18:41:30.147979 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:30.147791    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:30.148134 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:30.148066    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:31.147842 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:31.147811    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:31.148316 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:31.147814    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:31.148316 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:31.147908    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:31.148316 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:31.148008    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:32.147352 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:32.147319    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:32.147510 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:32.147445    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:33.147495 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:33.147466    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:33.147906 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:33.147583    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:33.147906 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:33.147638    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:33.147906 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:33.147728    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:34.147293 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:34.147257    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:34.147479 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:34.147442    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:35.147416 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:35.147387    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:35.147839 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:35.147513    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:35.147839 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:35.147559    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:35.147839 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:35.147654    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:36.148073 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:36.148044    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:36.148522 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:36.148215    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:37.147466 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:37.147433    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:37.147466 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:37.147453    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:37.147668 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:37.147527    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:37.147668 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:37.147622    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:38.147494 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:38.147467    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:38.147899 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:38.147587    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:38.894193 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:38.894157    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs\") pod \"network-metrics-daemon-44bfx\" (UID: \"937f81e1-d44b-4678-bcd7-82659b01b28b\") " pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:38.894386 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:38.894254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret\") pod \"global-pull-secret-syncer-smq6d\" (UID: \"0dd7d302-1a20-4cda-9624-0ca2fcf630c2\") " pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:38.894386 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:38.894327    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:38.894386 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:38.894324    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:38.894540 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:38.894391    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret podName:0dd7d302-1a20-4cda-9624-0ca2fcf630c2 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:10.894373838 +0000 UTC m=+65.255520998 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret") pod "global-pull-secret-syncer-smq6d" (UID: "0dd7d302-1a20-4cda-9624-0ca2fcf630c2") : object "kube-system"/"original-pull-secret" not registered
Jul 09 18:41:38.894540 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:38.894405    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs podName:937f81e1-d44b-4678-bcd7-82659b01b28b nodeName:}" failed. No retries permitted until 2026-07-09 18:42:10.894399152 +0000 UTC m=+65.255546310 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs") pod "network-metrics-daemon-44bfx" (UID: "937f81e1-d44b-4678-bcd7-82659b01b28b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 18:41:38.995050 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:38.995015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nwh\" (UniqueName: \"kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh\") pod \"network-check-target-cl4vn\" (UID: \"f3f3ace4-f8ed-4ee3-9713-3ec58d65a167\") " pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:38.995233 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:38.995177    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 18:41:38.995233 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:38.995196    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 18:41:38.995233 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:38.995209    2562 projected.go:196] Error preparing data for projected volume kube-api-access-j5nwh for pod openshift-network-diagnostics/network-check-target-cl4vn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:38.995402 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:38.995265    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh podName:f3f3ace4-f8ed-4ee3-9713-3ec58d65a167 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:10.995247396 +0000 UTC m=+65.356394576 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j5nwh" (UniqueName: "kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh") pod "network-check-target-cl4vn" (UID: "f3f3ace4-f8ed-4ee3-9713-3ec58d65a167") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 18:41:39.147822 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:39.147759    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:39.148199 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:39.147861    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:39.148199 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:39.147922    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:39.148199 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:39.148036    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:40.154404 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:40.154300    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:40.154836 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:40.154470    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:40.343517 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:40.343497    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 18:41:40.343837 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:40.343819    2562 generic.go:356] "Generic (PLEG): container finished" podID="e0e5ba40-3cfa-43fc-920f-b8257e57f5d5" containerID="f14839db20afbef4cf26657f1fe2bd5b5eabc9f5515430422b92f2d84d30d5ce" exitCode=1
Jul 09 18:41:40.343914 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:40.343891    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6" event={"ID":"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5","Type":"ContainerStarted","Data":"3d9aa0d494d681e761625227f565644882dea6aaa3b2e4a3876a36e157d70ef9"}
Jul 09 18:41:40.343993 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:40.343980    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6" event={"ID":"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5","Type":"ContainerStarted","Data":"b0ddec55d18dcd2700e2273ce7b818fbc2ac56cb906c628026d59d6c2791de23"}
Jul 09 18:41:40.344050 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:40.344035    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6" event={"ID":"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5","Type":"ContainerStarted","Data":"53e03bd83d6d8c3ff645caba5c448baceb19d034abe4d89fa0104537efe7fc58"}
Jul 09 18:41:40.344106 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:40.344082    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6" event={"ID":"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5","Type":"ContainerStarted","Data":"f1e0912ec4be97edb090f7b8ff865c8c8c87b070891ed1261a48bf1f2e1802be"}
Jul 09 18:41:40.344174 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:40.344133    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6" event={"ID":"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5","Type":"ContainerDied","Data":"f14839db20afbef4cf26657f1fe2bd5b5eabc9f5515430422b92f2d84d30d5ce"}
Jul 09 18:41:40.344225 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:40.344210    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6" event={"ID":"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5","Type":"ContainerStarted","Data":"ea6508bd9bd8a8201a6fb2be2723a02a8d4fa4a22563682bc6e91fe7ba89f2b6"}
Jul 09 18:41:40.346540 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:40.346520    2562 generic.go:356] "Generic (PLEG): container finished" podID="a73a913c-bf13-428b-a876-8dfc0375a31e" containerID="20e979d99bc85534cfcd06c2a61c8c402ee9d870f4f344345400081be73228ce" exitCode=0
Jul 09 18:41:40.346624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:40.346554    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zm9b" event={"ID":"a73a913c-bf13-428b-a876-8dfc0375a31e","Type":"ContainerDied","Data":"20e979d99bc85534cfcd06c2a61c8c402ee9d870f4f344345400081be73228ce"}
Jul 09 18:41:41.147305 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:41.147279    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:41.147519 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:41.147283    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:41.147519 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:41.147368    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:41.147519 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:41.147461    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:41.351183 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:41.351135    2562 generic.go:356] "Generic (PLEG): container finished" podID="a73a913c-bf13-428b-a876-8dfc0375a31e" containerID="3ddf77f422c144b09e7f8dddbb5707b59b076dc60be9bf3c86146b0b22a533f5" exitCode=0
Jul 09 18:41:41.351518 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:41.351195    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zm9b" event={"ID":"a73a913c-bf13-428b-a876-8dfc0375a31e","Type":"ContainerDied","Data":"3ddf77f422c144b09e7f8dddbb5707b59b076dc60be9bf3c86146b0b22a533f5"}
Jul 09 18:41:42.147261 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:42.147234    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:42.147504 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:42.147336    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:42.356417 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:42.356390    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6zm9b" event={"ID":"a73a913c-bf13-428b-a876-8dfc0375a31e","Type":"ContainerStarted","Data":"75479a6d4002111c9319ddea15bbbeb4b8d04070ca3a5405170ff53dc9f96275"}
Jul 09 18:41:42.387731 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:42.387686    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6zm9b" podStartSLOduration=10.814322095 podStartE2EDuration="36.387670924s" totalImagesPullingTime="25.573348829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:42.387253678 +0000 UTC m=+36.748400860" watchObservedRunningTime="2026-07-09 18:41:42.387670924 +0000 UTC m=+36.748818103"
Jul 09 18:41:43.147691 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:43.147628    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:43.147870 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:43.147629    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:43.147870 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:43.147779    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:43.147870 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:43.147808    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:43.361620 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:43.361594    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 18:41:43.362001 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:43.361981    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6" event={"ID":"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5","Type":"ContainerStarted","Data":"9ec48198ef636bfbb10303e3e52455c2dbf0b194e01118b1bf906cad2f27faea"}
Jul 09 18:41:44.147705 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:44.147679    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:44.147862 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:44.147777    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:45.147559 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:45.147528    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:45.147971 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:45.147528    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:45.147971 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:45.147653    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:45.147971 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:45.147701    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:45.369887 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:45.369861    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 18:41:45.370271 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:45.370250    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6" event={"ID":"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5","Type":"ContainerStarted","Data":"b38e6949cd22bf0b16adb932451720ebcbcf7c59efcc6102f2eb5b7405bfe1df"}
Jul 09 18:41:45.370546 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:45.370513    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:45.370617 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:45.370603    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:45.370712 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:45.370697    2562 scope.go:117] "RemoveContainer" containerID="f14839db20afbef4cf26657f1fe2bd5b5eabc9f5515430422b92f2d84d30d5ce"
Jul 09 18:41:45.387551 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:45.387413    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:46.148292 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:46.148260    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:46.148774 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:46.148344    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:46.375360 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:46.375332    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 18:41:46.375680 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:46.375662    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6" event={"ID":"e0e5ba40-3cfa-43fc-920f-b8257e57f5d5","Type":"ContainerStarted","Data":"8926c078de503121ce1075e9e3a78f85da56489633479e5e5c0f2030f5e7a2c4"}
Jul 09 18:41:46.375903 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:46.375889    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:46.391281 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:46.391257    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:41:46.409354 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:46.409280    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6" podStartSLOduration=8.148992961 podStartE2EDuration="40.409268712s" totalImagesPullingTime="32.260275751s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=2 observedRunningTime="2026-07-09 18:41:46.40772083 +0000 UTC m=+40.768868009" watchObservedRunningTime="2026-07-09 18:41:46.409268712 +0000 UTC m=+40.770415922"
Jul 09 18:41:47.147164 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:47.147118    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:47.147319 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:47.147269    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:47.147319 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:47.147309    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:47.147443 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:47.147391    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:47.211714 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:47.211683    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-smq6d"]
Jul 09 18:41:47.212264 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:47.211766    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:47.212264 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:47.211841    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:47.212478 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:47.212458    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cl4vn"]
Jul 09 18:41:47.228249 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:47.228225    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-44bfx"]
Jul 09 18:41:47.378009 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:47.377981    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:47.378174 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:47.377990    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:47.378174 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:47.378081    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:47.378249 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:47.378175    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:49.147938 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:49.147911    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:49.147938 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:49.147927    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:49.148565 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:49.147911    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:49.148565 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:49.148020    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:49.148565 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:49.148082    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:49.148565 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:49.148168    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:51.147859 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:51.147829    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:51.148358 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:51.147864    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:51.148358 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:51.147939    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:51.148358 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:51.147944    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-smq6d" podUID="0dd7d302-1a20-4cda-9624-0ca2fcf630c2"
Jul 09 18:41:51.148358 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:51.148047    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cl4vn" podUID="f3f3ace4-f8ed-4ee3-9713-3ec58d65a167"
Jul 09 18:41:51.148358 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:51.148122    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-44bfx" podUID="937f81e1-d44b-4678-bcd7-82659b01b28b"
Jul 09 18:41:52.958764 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:52.958738    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-47.ec2.internal" event="NodeReady"
Jul 09 18:41:52.959109 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:52.958851    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 18:41:52.995279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:52.995238    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"]
Jul 09 18:41:53.010543 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.010489    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8fz5c"]
Jul 09 18:41:53.010652 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.010605    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.014063 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.014034    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 18:41:53.014063 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.014045    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 18:41:53.014345 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.014092    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 18:41:53.014345 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.014048    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xwt7z\""
Jul 09 18:41:53.020703 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.020505    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 18:41:53.021091 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.021061    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:41:53.024251 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.024230    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wm22z\""
Jul 09 18:41:53.024620 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.024600    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 18:41:53.025205 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.020734    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"]
Jul 09 18:41:53.025370 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.025351    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cbcpb"]
Jul 09 18:41:53.025667 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.025643    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 18:41:53.036647 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.036627    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8fz5c"]
Jul 09 18:41:53.036751 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.036667    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cbcpb"]
Jul 09 18:41:53.036810 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.036754    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cbcpb"
Jul 09 18:41:53.039328 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.039313    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 18:41:53.039617 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.039590    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9cbfv\""
Jul 09 18:41:53.039617 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.039609    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 18:41:53.039749 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.039621    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 18:41:53.110904 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.110883    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29a841a1-eb99-4d6d-9b45-3b3c9a179692-tmp-dir\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:41:53.110995 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.110931    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgdr8\" (UniqueName: \"kubernetes.io/projected/3d4366a5-595b-4864-8916-55bf0b2e8fa7-kube-api-access-zgdr8\") pod \"ingress-canary-cbcpb\" (UID: \"3d4366a5-595b-4864-8916-55bf0b2e8fa7\") " pod="openshift-ingress-canary/ingress-canary-cbcpb"
Jul 09 18:41:53.111034 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.111001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnt7n\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-kube-api-access-hnt7n\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.111034 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.111029    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5ghv\" (UniqueName: \"kubernetes.io/projected/29a841a1-eb99-4d6d-9b45-3b3c9a179692-kube-api-access-k5ghv\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:41:53.111100 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.111046    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-image-registry-private-configuration\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.111100 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.111065    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-ca-trust-extracted\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.111100 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.111087    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.111262 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.111103    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-certificates\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.111262 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.111121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:41:53.111262 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.111203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-trusted-ca\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.111262 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.111242    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-bound-sa-token\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.111443 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.111304    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/29a841a1-eb99-4d6d-9b45-3b3c9a179692-config-volume\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:41:53.111443 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.111331    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-installation-pull-secrets\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.111443 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.111359    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d4366a5-595b-4864-8916-55bf0b2e8fa7-cert\") pod \"ingress-canary-cbcpb\" (UID: \"3d4366a5-595b-4864-8916-55bf0b2e8fa7\") " pod="openshift-ingress-canary/ingress-canary-cbcpb"
Jul 09 18:41:53.147270 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.147249    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:41:53.147353 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.147249    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:41:53.147430 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.147253    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:41:53.150544 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.150526    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 18:41:53.150655 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.150527    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ppzx8\""
Jul 09 18:41:53.150655 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.150527    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cz2v8\""
Jul 09 18:41:53.150655 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.150571    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 18:41:53.150655 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.150596    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 18:41:53.150655 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.150602    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 18:41:53.212344 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.212322    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d4366a5-595b-4864-8916-55bf0b2e8fa7-cert\") pod \"ingress-canary-cbcpb\" (UID: \"3d4366a5-595b-4864-8916-55bf0b2e8fa7\") " pod="openshift-ingress-canary/ingress-canary-cbcpb"
Jul 09 18:41:53.212436 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.212347    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29a841a1-eb99-4d6d-9b45-3b3c9a179692-tmp-dir\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:41:53.212436 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.212383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgdr8\" (UniqueName: \"kubernetes.io/projected/3d4366a5-595b-4864-8916-55bf0b2e8fa7-kube-api-access-zgdr8\") pod \"ingress-canary-cbcpb\" (UID: \"3d4366a5-595b-4864-8916-55bf0b2e8fa7\") " pod="openshift-ingress-canary/ingress-canary-cbcpb"
Jul 09 18:41:53.212436 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.212417    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnt7n\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-kube-api-access-hnt7n\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.212594 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.212441    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5ghv\" (UniqueName: \"kubernetes.io/projected/29a841a1-eb99-4d6d-9b45-3b3c9a179692-kube-api-access-k5ghv\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:41:53.212594 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.212465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-image-registry-private-configuration\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.212594 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.212494    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-ca-trust-extracted\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.212594 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.212528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.212594 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.212550    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-certificates\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.212594 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.212577    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:41:53.212880 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.212600    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-trusted-ca\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.212880 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.212624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-bound-sa-token\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.212880 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.212661    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/29a841a1-eb99-4d6d-9b45-3b3c9a179692-config-volume\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:41:53.212880 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.212673    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29a841a1-eb99-4d6d-9b45-3b3c9a179692-tmp-dir\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:41:53.212880 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.212694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-installation-pull-secrets\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.212880 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:53.212811    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:41:53.212880 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:53.212827    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbdc9bfd8-gvq25: secret "image-registry-tls" not found
Jul 09 18:41:53.212880 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:53.212877    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls podName:4a2b3d30-bc5b-48e8-8af1-9dd3c586022d nodeName:}" failed. No retries permitted until 2026-07-09 18:41:53.712858718 +0000 UTC m=+48.074005882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls") pod "image-registry-6fbdc9bfd8-gvq25" (UID: "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d") : secret "image-registry-tls" not found
Jul 09 18:41:53.213227 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:53.212966    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:41:53.213227 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.213000    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-ca-trust-extracted\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.213227 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:53.213015    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls podName:29a841a1-eb99-4d6d-9b45-3b3c9a179692 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:53.712996482 +0000 UTC m=+48.074143654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls") pod "dns-default-8fz5c" (UID: "29a841a1-eb99-4d6d-9b45-3b3c9a179692") : secret "dns-default-metrics-tls" not found
Jul 09 18:41:53.213542 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.213520    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-certificates\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.213589 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.213549    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/29a841a1-eb99-4d6d-9b45-3b3c9a179692-config-volume\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:41:53.214029 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.214009    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-trusted-ca\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.216385 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.216368    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-installation-pull-secrets\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.216459 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.216413    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d4366a5-595b-4864-8916-55bf0b2e8fa7-cert\") pod \"ingress-canary-cbcpb\" (UID: \"3d4366a5-595b-4864-8916-55bf0b2e8fa7\") " pod="openshift-ingress-canary/ingress-canary-cbcpb"
Jul 09 18:41:53.216499 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.216477    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-image-registry-private-configuration\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.223991 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.223968    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5ghv\" (UniqueName: \"kubernetes.io/projected/29a841a1-eb99-4d6d-9b45-3b3c9a179692-kube-api-access-k5ghv\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:41:53.224280 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.224264    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-bound-sa-token\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.224423 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.224404    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnt7n\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-kube-api-access-hnt7n\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.224471 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.224422    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgdr8\" (UniqueName: \"kubernetes.io/projected/3d4366a5-595b-4864-8916-55bf0b2e8fa7-kube-api-access-zgdr8\") pod \"ingress-canary-cbcpb\" (UID: \"3d4366a5-595b-4864-8916-55bf0b2e8fa7\") " pod="openshift-ingress-canary/ingress-canary-cbcpb"
Jul 09 18:41:53.345328 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.345256    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cbcpb"
Jul 09 18:41:53.475886 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.475856    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cbcpb"]
Jul 09 18:41:53.480471 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:41:53.480445    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d4366a5_595b_4864_8916_55bf0b2e8fa7.slice/crio-f63e435002ebc8a43a2b451db3ea1dff2ad2b97f63e3455c6cc8baea3a106493 WatchSource:0}: Error finding container f63e435002ebc8a43a2b451db3ea1dff2ad2b97f63e3455c6cc8baea3a106493: Status 404 returned error can't find the container with id f63e435002ebc8a43a2b451db3ea1dff2ad2b97f63e3455c6cc8baea3a106493
Jul 09 18:41:53.716542 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.716466    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:53.716542 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:53.716509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:41:53.716712 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:53.716619    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:41:53.716712 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:53.716624    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:41:53.716712 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:53.716639    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbdc9bfd8-gvq25: secret "image-registry-tls" not found
Jul 09 18:41:53.716712 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:53.716690    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls podName:29a841a1-eb99-4d6d-9b45-3b3c9a179692 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:54.716664597 +0000 UTC m=+49.077811759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls") pod "dns-default-8fz5c" (UID: "29a841a1-eb99-4d6d-9b45-3b3c9a179692") : secret "dns-default-metrics-tls" not found
Jul 09 18:41:53.716712 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:53.716706    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls podName:4a2b3d30-bc5b-48e8-8af1-9dd3c586022d nodeName:}" failed. No retries permitted until 2026-07-09 18:41:54.716699051 +0000 UTC m=+49.077846210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls") pod "image-registry-6fbdc9bfd8-gvq25" (UID: "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d") : secret "image-registry-tls" not found
Jul 09 18:41:54.394740 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:54.394695    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cbcpb" event={"ID":"3d4366a5-595b-4864-8916-55bf0b2e8fa7","Type":"ContainerStarted","Data":"f63e435002ebc8a43a2b451db3ea1dff2ad2b97f63e3455c6cc8baea3a106493"}
Jul 09 18:41:54.723223 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:54.723091    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:41:54.723433 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:54.723252    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:41:54.723433 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:54.723326    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls podName:29a841a1-eb99-4d6d-9b45-3b3c9a179692 nodeName:}" failed. No retries permitted until 2026-07-09 18:41:56.72330243 +0000 UTC m=+51.084449599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls") pod "dns-default-8fz5c" (UID: "29a841a1-eb99-4d6d-9b45-3b3c9a179692") : secret "dns-default-metrics-tls" not found
Jul 09 18:41:54.723433 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:54.723253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:54.723433 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:54.723339    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:41:54.723433 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:54.723354    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbdc9bfd8-gvq25: secret "image-registry-tls" not found
Jul 09 18:41:54.723433 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:54.723399    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls podName:4a2b3d30-bc5b-48e8-8af1-9dd3c586022d nodeName:}" failed. No retries permitted until 2026-07-09 18:41:56.723385707 +0000 UTC m=+51.084532865 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls") pod "image-registry-6fbdc9bfd8-gvq25" (UID: "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d") : secret "image-registry-tls" not found
Jul 09 18:41:56.401077 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:56.401045    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cbcpb" event={"ID":"3d4366a5-595b-4864-8916-55bf0b2e8fa7","Type":"ContainerStarted","Data":"4099cb56be34693b8b30fe83378849b2db20cc56320efb8de37b510ab72fb508"}
Jul 09 18:41:56.420212 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:56.420168    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cbcpb" podStartSLOduration=1.651529591 podStartE2EDuration="4.420131523s" totalImagesPullingTime="2.768601932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:41:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:41:56.42003672 +0000 UTC m=+50.781183904" watchObservedRunningTime="2026-07-09 18:41:56.420131523 +0000 UTC m=+50.781278701"
Jul 09 18:41:56.737766 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:56.737732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:41:56.737766 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:41:56.737778    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:41:56.738004 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:56.737886    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:41:56.738004 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:56.737888    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:41:56.738004 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:56.737911    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbdc9bfd8-gvq25: secret "image-registry-tls" not found
Jul 09 18:41:56.738004 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:56.737951    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls podName:29a841a1-eb99-4d6d-9b45-3b3c9a179692 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:00.73793331 +0000 UTC m=+55.099080482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls") pod "dns-default-8fz5c" (UID: "29a841a1-eb99-4d6d-9b45-3b3c9a179692") : secret "dns-default-metrics-tls" not found
Jul 09 18:41:56.738004 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:41:56.737969    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls podName:4a2b3d30-bc5b-48e8-8af1-9dd3c586022d nodeName:}" failed. No retries permitted until 2026-07-09 18:42:00.737959953 +0000 UTC m=+55.099107116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls") pod "image-registry-6fbdc9bfd8-gvq25" (UID: "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d") : secret "image-registry-tls" not found
Jul 09 18:42:00.764106 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:00.764059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:42:00.764106 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:00.764109    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:42:00.764583 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:00.764238    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:42:00.764583 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:00.764239    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:42:00.764583 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:00.764259    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbdc9bfd8-gvq25: secret "image-registry-tls" not found
Jul 09 18:42:00.764583 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:00.764305    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls podName:4a2b3d30-bc5b-48e8-8af1-9dd3c586022d nodeName:}" failed. No retries permitted until 2026-07-09 18:42:08.764286704 +0000 UTC m=+63.125433879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls") pod "image-registry-6fbdc9bfd8-gvq25" (UID: "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d") : secret "image-registry-tls" not found
Jul 09 18:42:00.764583 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:00.764320    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls podName:29a841a1-eb99-4d6d-9b45-3b3c9a179692 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:08.764312903 +0000 UTC m=+63.125460060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls") pod "dns-default-8fz5c" (UID: "29a841a1-eb99-4d6d-9b45-3b3c9a179692") : secret "dns-default-metrics-tls" not found
Jul 09 18:42:08.818321 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:08.818274    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:42:08.818321 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:08.818327    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:42:08.818835 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:08.818437    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 09 18:42:08.818835 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:08.818456    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fbdc9bfd8-gvq25: secret "image-registry-tls" not found
Jul 09 18:42:08.818835 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:08.818467    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 18:42:08.818835 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:08.818516    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls podName:4a2b3d30-bc5b-48e8-8af1-9dd3c586022d nodeName:}" failed. No retries permitted until 2026-07-09 18:42:24.818501927 +0000 UTC m=+79.179649085 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls") pod "image-registry-6fbdc9bfd8-gvq25" (UID: "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d") : secret "image-registry-tls" not found
Jul 09 18:42:08.818835 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:08.818531    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls podName:29a841a1-eb99-4d6d-9b45-3b3c9a179692 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:24.818525756 +0000 UTC m=+79.179672914 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls") pod "dns-default-8fz5c" (UID: "29a841a1-eb99-4d6d-9b45-3b3c9a179692") : secret "dns-default-metrics-tls" not found
Jul 09 18:42:10.809971 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:10.809941    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx"]
Jul 09 18:42:10.840671 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:10.840645    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx"
Jul 09 18:42:10.840825 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:10.840652    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx"]
Jul 09 18:42:10.857779 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:10.857759    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 09 18:42:10.859187 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:10.859172    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 09 18:42:10.861082 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:10.861067    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 09 18:42:10.865180 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:10.865165    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-txg5j\""
Jul 09 18:42:10.867817 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:10.867804    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:42:10.932412 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:10.932394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-z2mjx\" (UID: \"f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx"
Jul 09 18:42:10.932532 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:10.932426    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs\") pod \"network-metrics-daemon-44bfx\" (UID: \"937f81e1-d44b-4678-bcd7-82659b01b28b\") " pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:42:10.932532 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:10.932443    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-z2mjx\" (UID: \"f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx"
Jul 09 18:42:10.932626 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:10.932565    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9gkn\" (UniqueName: \"kubernetes.io/projected/f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6-kube-api-access-j9gkn\") pod \"kube-storage-version-migrator-operator-799cb7f958-z2mjx\" (UID: \"f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx"
Jul 09 18:42:10.932626 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:10.932606    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret\") pod \"global-pull-secret-syncer-smq6d\" (UID: \"0dd7d302-1a20-4cda-9624-0ca2fcf630c2\") " pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:42:10.935325 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:10.935307    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 18:42:10.935477 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:10.935461    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 18:42:10.942722 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:10.942707    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 18:42:10.942785 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:10.942768    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs podName:937f81e1-d44b-4678-bcd7-82659b01b28b nodeName:}" failed. No retries permitted until 2026-07-09 18:43:14.942752471 +0000 UTC m=+129.303899629 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs") pod "network-metrics-daemon-44bfx" (UID: "937f81e1-d44b-4678-bcd7-82659b01b28b") : secret "metrics-daemon-secret" not found
Jul 09 18:42:10.945513 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:10.945496    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0dd7d302-1a20-4cda-9624-0ca2fcf630c2-original-pull-secret\") pod \"global-pull-secret-syncer-smq6d\" (UID: \"0dd7d302-1a20-4cda-9624-0ca2fcf630c2\") " pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:42:11.010411 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.010384    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-r86dw"]
Jul 09 18:42:11.032340 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.032304    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p"]
Jul 09 18:42:11.032444 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.032380    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r86dw"
Jul 09 18:42:11.033087 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.033058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-z2mjx\" (UID: \"f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx"
Jul 09 18:42:11.033217 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.033119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-z2mjx\" (UID: \"f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx"
Jul 09 18:42:11.033217 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.033187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5nwh\" (UniqueName: \"kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh\") pod \"network-check-target-cl4vn\" (UID: \"f3f3ace4-f8ed-4ee3-9713-3ec58d65a167\") " pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:42:11.033331 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.033258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9gkn\" (UniqueName: \"kubernetes.io/projected/f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6-kube-api-access-j9gkn\") pod \"kube-storage-version-migrator-operator-799cb7f958-z2mjx\" (UID: \"f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx"
Jul 09 18:42:11.034005 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.033985    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-z2mjx\" (UID: \"f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx"
Jul 09 18:42:11.035246 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.035221    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ncd25\""
Jul 09 18:42:11.035938 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.035591    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-z2mjx\" (UID: \"f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx"
Jul 09 18:42:11.035938 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.035598    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 18:42:11.046727 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.046710    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 18:42:11.052473 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.052457    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p"]
Jul 09 18:42:11.052538 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.052487    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-r86dw"]
Jul 09 18:42:11.052574 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.052552    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p"
Jul 09 18:42:11.056719 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.056691    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5nwh\" (UniqueName: \"kubernetes.io/projected/f3f3ace4-f8ed-4ee3-9713-3ec58d65a167-kube-api-access-j5nwh\") pod \"network-check-target-cl4vn\" (UID: \"f3f3ace4-f8ed-4ee3-9713-3ec58d65a167\") " pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:42:11.057688 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.057668    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 09 18:42:11.057807 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.057672    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bqgbl\""
Jul 09 18:42:11.057940 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.057922    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:42:11.058066 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.058049    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9gkn\" (UniqueName: \"kubernetes.io/projected/f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6-kube-api-access-j9gkn\") pod \"kube-storage-version-migrator-operator-799cb7f958-z2mjx\" (UID: \"f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx"
Jul 09 18:42:11.058529 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.058512    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 09 18:42:11.134024 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.134000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t9l7p\" (UID: \"7e33c227-294c-4a33-8404-16b6a5ce8746\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p"
Jul 09 18:42:11.134126 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.134028    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzrnx\" (UniqueName: \"kubernetes.io/projected/7e33c227-294c-4a33-8404-16b6a5ce8746-kube-api-access-bzrnx\") pod \"cluster-samples-operator-65db858894-t9l7p\" (UID: \"7e33c227-294c-4a33-8404-16b6a5ce8746\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p"
Jul 09 18:42:11.134126 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.134047    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cmxx\" (UniqueName: \"kubernetes.io/projected/5f5adcba-b531-4575-84a8-820a1ebc7462-kube-api-access-4cmxx\") pod \"network-check-source-869dcfcdcd-r86dw\" (UID: \"5f5adcba-b531-4575-84a8-820a1ebc7462\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r86dw"
Jul 09 18:42:11.149128 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.149110    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx"
Jul 09 18:42:11.156262 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.156246    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-smq6d"
Jul 09 18:42:11.169499 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.169481    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cz2v8\""
Jul 09 18:42:11.177184 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.177170    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:42:11.237256 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.236537    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t9l7p\" (UID: \"7e33c227-294c-4a33-8404-16b6a5ce8746\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p"
Jul 09 18:42:11.237256 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.236581    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzrnx\" (UniqueName: \"kubernetes.io/projected/7e33c227-294c-4a33-8404-16b6a5ce8746-kube-api-access-bzrnx\") pod \"cluster-samples-operator-65db858894-t9l7p\" (UID: \"7e33c227-294c-4a33-8404-16b6a5ce8746\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p"
Jul 09 18:42:11.237256 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.236642    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cmxx\" (UniqueName: \"kubernetes.io/projected/5f5adcba-b531-4575-84a8-820a1ebc7462-kube-api-access-4cmxx\") pod \"network-check-source-869dcfcdcd-r86dw\" (UID: \"5f5adcba-b531-4575-84a8-820a1ebc7462\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r86dw"
Jul 09 18:42:11.237256 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:11.237206    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 18:42:11.237688 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:11.237292    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls podName:7e33c227-294c-4a33-8404-16b6a5ce8746 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:11.737274172 +0000 UTC m=+66.098421330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls") pod "cluster-samples-operator-65db858894-t9l7p" (UID: "7e33c227-294c-4a33-8404-16b6a5ce8746") : secret "samples-operator-tls" not found
Jul 09 18:42:11.252958 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.251835    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cmxx\" (UniqueName: \"kubernetes.io/projected/5f5adcba-b531-4575-84a8-820a1ebc7462-kube-api-access-4cmxx\") pod \"network-check-source-869dcfcdcd-r86dw\" (UID: \"5f5adcba-b531-4575-84a8-820a1ebc7462\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r86dw"
Jul 09 18:42:11.256818 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.256757    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzrnx\" (UniqueName: \"kubernetes.io/projected/7e33c227-294c-4a33-8404-16b6a5ce8746-kube-api-access-bzrnx\") pod \"cluster-samples-operator-65db858894-t9l7p\" (UID: \"7e33c227-294c-4a33-8404-16b6a5ce8746\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p"
Jul 09 18:42:11.341219 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.341193    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx"]
Jul 09 18:42:11.345105 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:42:11.345078    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf09921b9_de59_41bb_bf2f_9e9d6dd5d4b6.slice/crio-3cf00407f9cc74dd721a74ee6e826535d048de50d0b6f02f0f542eca76a16c4e WatchSource:0}: Error finding container 3cf00407f9cc74dd721a74ee6e826535d048de50d0b6f02f0f542eca76a16c4e: Status 404 returned error can't find the container with id 3cf00407f9cc74dd721a74ee6e826535d048de50d0b6f02f0f542eca76a16c4e
Jul 09 18:42:11.345231 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.345130    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r86dw"
Jul 09 18:42:11.348377 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.348356    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-smq6d"]
Jul 09 18:42:11.350606 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:42:11.350584    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dd7d302_1a20_4cda_9624_0ca2fcf630c2.slice/crio-cac422c872652f56bf753cd947eb95b02b44e798a25aaeacaf320f5649e684c9 WatchSource:0}: Error finding container cac422c872652f56bf753cd947eb95b02b44e798a25aaeacaf320f5649e684c9: Status 404 returned error can't find the container with id cac422c872652f56bf753cd947eb95b02b44e798a25aaeacaf320f5649e684c9
Jul 09 18:42:11.370940 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.370912    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cl4vn"]
Jul 09 18:42:11.374264 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:42:11.374241    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3f3ace4_f8ed_4ee3_9713_3ec58d65a167.slice/crio-9c9aade2eff149670da845ca1692eff978a76fcd6640b2019fec330298d047e8 WatchSource:0}: Error finding container 9c9aade2eff149670da845ca1692eff978a76fcd6640b2019fec330298d047e8: Status 404 returned error can't find the container with id 9c9aade2eff149670da845ca1692eff978a76fcd6640b2019fec330298d047e8
Jul 09 18:42:11.435578 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.435548    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-smq6d" event={"ID":"0dd7d302-1a20-4cda-9624-0ca2fcf630c2","Type":"ContainerStarted","Data":"cac422c872652f56bf753cd947eb95b02b44e798a25aaeacaf320f5649e684c9"}
Jul 09 18:42:11.436688 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.436656    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cl4vn" event={"ID":"f3f3ace4-f8ed-4ee3-9713-3ec58d65a167","Type":"ContainerStarted","Data":"9c9aade2eff149670da845ca1692eff978a76fcd6640b2019fec330298d047e8"}
Jul 09 18:42:11.437756 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.437719    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx" event={"ID":"f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6","Type":"ContainerStarted","Data":"3cf00407f9cc74dd721a74ee6e826535d048de50d0b6f02f0f542eca76a16c4e"}
Jul 09 18:42:11.488198 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.488167    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-r86dw"]
Jul 09 18:42:11.491395 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:42:11.491364    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f5adcba_b531_4575_84a8_820a1ebc7462.slice/crio-e8535b01dcea76da19b1420d3e88b6c790ed768fc121d2b500b0037792c64044 WatchSource:0}: Error finding container e8535b01dcea76da19b1420d3e88b6c790ed768fc121d2b500b0037792c64044: Status 404 returned error can't find the container with id e8535b01dcea76da19b1420d3e88b6c790ed768fc121d2b500b0037792c64044
Jul 09 18:42:11.739411 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:11.739338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t9l7p\" (UID: \"7e33c227-294c-4a33-8404-16b6a5ce8746\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p"
Jul 09 18:42:11.739544 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:11.739459    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 18:42:11.739544 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:11.739513    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls podName:7e33c227-294c-4a33-8404-16b6a5ce8746 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:12.739499025 +0000 UTC m=+67.100646183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls") pod "cluster-samples-operator-65db858894-t9l7p" (UID: "7e33c227-294c-4a33-8404-16b6a5ce8746") : secret "samples-operator-tls" not found
Jul 09 18:42:12.443706 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:12.443642    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r86dw" event={"ID":"5f5adcba-b531-4575-84a8-820a1ebc7462","Type":"ContainerStarted","Data":"e8535b01dcea76da19b1420d3e88b6c790ed768fc121d2b500b0037792c64044"}
Jul 09 18:42:12.747886 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:12.747850    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t9l7p\" (UID: \"7e33c227-294c-4a33-8404-16b6a5ce8746\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p"
Jul 09 18:42:12.748075 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:12.748054    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 18:42:12.748172 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:12.748130    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls podName:7e33c227-294c-4a33-8404-16b6a5ce8746 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:14.748111792 +0000 UTC m=+69.109258951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls") pod "cluster-samples-operator-65db858894-t9l7p" (UID: "7e33c227-294c-4a33-8404-16b6a5ce8746") : secret "samples-operator-tls" not found
Jul 09 18:42:14.765992 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:14.765952    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t9l7p\" (UID: \"7e33c227-294c-4a33-8404-16b6a5ce8746\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p"
Jul 09 18:42:14.766527 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:14.766127    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 18:42:14.766527 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:14.766228    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls podName:7e33c227-294c-4a33-8404-16b6a5ce8746 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:18.766205242 +0000 UTC m=+73.127352402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls") pod "cluster-samples-operator-65db858894-t9l7p" (UID: "7e33c227-294c-4a33-8404-16b6a5ce8746") : secret "samples-operator-tls" not found
Jul 09 18:42:15.936706 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:15.936668    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hjrpq"]
Jul 09 18:42:15.948342 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:15.948320    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:15.951624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:15.951586    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 18:42:15.952596 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:15.952576    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z2rdm\""
Jul 09 18:42:15.952719 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:15.952607    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 18:42:15.952787 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:15.952614    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 18:42:15.952787 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:15.952743    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 18:42:15.958015 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:15.957948    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hjrpq"]
Jul 09 18:42:16.074886 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:16.074857    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7aa21fba-2be2-47eb-b842-788e9df26b67-data-volume\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:16.075077 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:16.074904    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7aa21fba-2be2-47eb-b842-788e9df26b67-crio-socket\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:16.075077 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:16.074938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:16.075077 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:16.075001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:16.075077 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:16.075048    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcjgf\" (UniqueName: \"kubernetes.io/projected/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-api-access-xcjgf\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:16.176286 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:16.176256    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7aa21fba-2be2-47eb-b842-788e9df26b67-crio-socket\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:16.176462 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:16.176297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:16.176462 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:16.176337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:16.176462 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:16.176353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcjgf\" (UniqueName: \"kubernetes.io/projected/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-api-access-xcjgf\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:16.176462 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:16.176427    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7aa21fba-2be2-47eb-b842-788e9df26b67-data-volume\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:16.176692 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:16.176468    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:42:16.176692 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:16.176484    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7aa21fba-2be2-47eb-b842-788e9df26b67-crio-socket\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:16.176692 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:16.176532    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm podName:7aa21fba-2be2-47eb-b842-788e9df26b67 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:16.676513603 +0000 UTC m=+71.037660781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjrpq" (UID: "7aa21fba-2be2-47eb-b842-788e9df26b67") : configmap "kube-rbac-proxy" not found
Jul 09 18:42:16.176692 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:16.176584    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:16.176692 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:16.176628    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls podName:7aa21fba-2be2-47eb-b842-788e9df26b67 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:16.676614713 +0000 UTC m=+71.037761883 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjrpq" (UID: "7aa21fba-2be2-47eb-b842-788e9df26b67") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:16.176961 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:16.176753    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7aa21fba-2be2-47eb-b842-788e9df26b67-data-volume\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:16.187179 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:16.187098    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcjgf\" (UniqueName: \"kubernetes.io/projected/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-api-access-xcjgf\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:16.680854 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:16.680822    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:16.681022 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:16.680877    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:16.681022 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:16.680946    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:42:16.681022 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:16.680999    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:16.681022 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:16.681022    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm podName:7aa21fba-2be2-47eb-b842-788e9df26b67 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:17.681005262 +0000 UTC m=+72.042152420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjrpq" (UID: "7aa21fba-2be2-47eb-b842-788e9df26b67") : configmap "kube-rbac-proxy" not found
Jul 09 18:42:16.681217 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:16.681042    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls podName:7aa21fba-2be2-47eb-b842-788e9df26b67 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:17.681031484 +0000 UTC m=+72.042178641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjrpq" (UID: "7aa21fba-2be2-47eb-b842-788e9df26b67") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:17.691015 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:17.690994    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:17.691352 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:17.691039    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:17.691352 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:17.691121    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:17.691352 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:17.691132    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:42:17.691352 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:17.691189    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls podName:7aa21fba-2be2-47eb-b842-788e9df26b67 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:19.691176377 +0000 UTC m=+74.052323539 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjrpq" (UID: "7aa21fba-2be2-47eb-b842-788e9df26b67") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:17.691352 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:17.691212    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm podName:7aa21fba-2be2-47eb-b842-788e9df26b67 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:19.691205253 +0000 UTC m=+74.052352411 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjrpq" (UID: "7aa21fba-2be2-47eb-b842-788e9df26b67") : configmap "kube-rbac-proxy" not found
Jul 09 18:42:17.728917 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:17.728896    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m7pwm_336b9318-00cd-482e-9705-569526f009d1/dns-node-resolver/0.log"
Jul 09 18:42:18.400691 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:18.400655    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zrbn6"
Jul 09 18:42:18.464006 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:18.463967    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cl4vn" event={"ID":"f3f3ace4-f8ed-4ee3-9713-3ec58d65a167","Type":"ContainerStarted","Data":"3790cf47cc3568fb7fd8192922ec66c1e22e44ef16095bbf1f3117641ea27e4e"}
Jul 09 18:42:18.464218 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:18.464113    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:42:18.465698 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:18.465672    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx" event={"ID":"f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6","Type":"ContainerStarted","Data":"a10266bb09cf65ffdc82b216e1fa467ba047b9295da719b190a39d8b62531345"}
Jul 09 18:42:18.467166 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:18.467127    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-smq6d" event={"ID":"0dd7d302-1a20-4cda-9624-0ca2fcf630c2","Type":"ContainerStarted","Data":"ba98e533b74002c951d8f4dde39c5921756c88bab12b6b3438acb046b8ae2d4a"}
Jul 09 18:42:18.468692 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:18.468660    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r86dw" event={"ID":"5f5adcba-b531-4575-84a8-820a1ebc7462","Type":"ContainerStarted","Data":"58161a3917b7ef5dcf56dd2ccbb86cad5256d40b0111793fd96e7fd4142ce08c"}
Jul 09 18:42:18.481040 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:18.481006    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cl4vn" podStartSLOduration=66.160632022 podStartE2EDuration="1m12.480994018s" totalImagesPullingTime="6.320361996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:18.480598938 +0000 UTC m=+72.841746118" watchObservedRunningTime="2026-07-09 18:42:18.480994018 +0000 UTC m=+72.842141197"
Jul 09 18:42:18.496312 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:18.496276    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-smq6d" podStartSLOduration=66.139768006 podStartE2EDuration="1m12.496263897s" totalImagesPullingTime="6.356495891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:18.495484531 +0000 UTC m=+72.856631715" watchObservedRunningTime="2026-07-09 18:42:18.496263897 +0000 UTC m=+72.857411125"
Jul 09 18:42:18.513007 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:18.512967    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r86dw" podStartSLOduration=2.308924958 podStartE2EDuration="8.512951126s" totalImagesPullingTime="6.204026168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:18.512434809 +0000 UTC m=+72.873581988" watchObservedRunningTime="2026-07-09 18:42:18.512951126 +0000 UTC m=+72.874098307"
Jul 09 18:42:18.532394 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:18.532356    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx" podStartSLOduration=2.200592637 podStartE2EDuration="8.532345685s" totalImagesPullingTime="6.331753048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:18.531992364 +0000 UTC m=+72.893139551" watchObservedRunningTime="2026-07-09 18:42:18.532345685 +0000 UTC m=+72.893492865"
Jul 09 18:42:18.801369 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:18.801337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t9l7p\" (UID: \"7e33c227-294c-4a33-8404-16b6a5ce8746\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p"
Jul 09 18:42:18.801726 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:18.801484    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 09 18:42:18.801726 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:18.801548    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls podName:7e33c227-294c-4a33-8404-16b6a5ce8746 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:26.801529444 +0000 UTC m=+81.162676602 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls") pod "cluster-samples-operator-65db858894-t9l7p" (UID: "7e33c227-294c-4a33-8404-16b6a5ce8746") : secret "samples-operator-tls" not found
Jul 09 18:42:18.934380 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:18.934350    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qg8vv_287d24b2-f189-4492-bd7f-cfbd8eccf639/node-ca/0.log"
Jul 09 18:42:19.708553 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:19.708524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:19.708751 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:19.708582    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:19.708751 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:19.708634    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:42:19.708751 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:19.708698    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm podName:7aa21fba-2be2-47eb-b842-788e9df26b67 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:23.708676288 +0000 UTC m=+78.069823445 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjrpq" (UID: "7aa21fba-2be2-47eb-b842-788e9df26b67") : configmap "kube-rbac-proxy" not found
Jul 09 18:42:19.708751 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:19.708737    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:19.708931 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:19.708799    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls podName:7aa21fba-2be2-47eb-b842-788e9df26b67 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:23.708782667 +0000 UTC m=+78.069929825 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjrpq" (UID: "7aa21fba-2be2-47eb-b842-788e9df26b67") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:19.734062 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:19.734042    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cbcpb_3d4366a5-595b-4864-8916-55bf0b2e8fa7/serve-healthcheck-canary/0.log"
Jul 09 18:42:23.738467 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:23.738433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:23.738853 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:23.738480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:23.738853 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:23.738547    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 18:42:23.738853 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:23.738571    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:23.738853 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:23.738604    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm podName:7aa21fba-2be2-47eb-b842-788e9df26b67 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:31.738590298 +0000 UTC m=+86.099737455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hjrpq" (UID: "7aa21fba-2be2-47eb-b842-788e9df26b67") : configmap "kube-rbac-proxy" not found
Jul 09 18:42:23.738853 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:42:23.738619    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls podName:7aa21fba-2be2-47eb-b842-788e9df26b67 nodeName:}" failed. No retries permitted until 2026-07-09 18:42:31.738613091 +0000 UTC m=+86.099760248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hjrpq" (UID: "7aa21fba-2be2-47eb-b842-788e9df26b67") : secret "insights-runtime-extractor-tls" not found
Jul 09 18:42:24.847558 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:24.847524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:42:24.847558 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:24.847559    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:42:24.849964 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:24.849937    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/29a841a1-eb99-4d6d-9b45-3b3c9a179692-metrics-tls\") pod \"dns-default-8fz5c\" (UID: \"29a841a1-eb99-4d6d-9b45-3b3c9a179692\") " pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:42:24.850098 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:24.850073    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls\") pod \"image-registry-6fbdc9bfd8-gvq25\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") " pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:42:25.125682 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:25.125594    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xwt7z\""
Jul 09 18:42:25.133978 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:25.133953    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:42:25.136982 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:25.136964    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wm22z\""
Jul 09 18:42:25.144657 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:25.144639    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:42:25.273848 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:25.273821    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"]
Jul 09 18:42:25.276803 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:42:25.276777    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a2b3d30_bc5b_48e8_8af1_9dd3c586022d.slice/crio-8420fcce277bc2a23bdbf6c0c4dd87f44e40dfeab1c73f3ca6358dc4ef5c6b27 WatchSource:0}: Error finding container 8420fcce277bc2a23bdbf6c0c4dd87f44e40dfeab1c73f3ca6358dc4ef5c6b27: Status 404 returned error can't find the container with id 8420fcce277bc2a23bdbf6c0c4dd87f44e40dfeab1c73f3ca6358dc4ef5c6b27
Jul 09 18:42:25.288474 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:25.288451    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8fz5c"]
Jul 09 18:42:25.290677 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:42:25.290655    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a841a1_eb99_4d6d_9b45_3b3c9a179692.slice/crio-b25fe1fa616337390f519536513255eaae92079079e2b0041ebcd3d0ae6cb380 WatchSource:0}: Error finding container b25fe1fa616337390f519536513255eaae92079079e2b0041ebcd3d0ae6cb380: Status 404 returned error can't find the container with id b25fe1fa616337390f519536513255eaae92079079e2b0041ebcd3d0ae6cb380
Jul 09 18:42:25.491735 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:25.491638    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25" event={"ID":"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d","Type":"ContainerStarted","Data":"e16631f17fc867d661b52a1972e0dd001b294dfcd2a58b598f4b10cce22efd7d"}
Jul 09 18:42:25.491735 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:25.491698    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25" event={"ID":"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d","Type":"ContainerStarted","Data":"8420fcce277bc2a23bdbf6c0c4dd87f44e40dfeab1c73f3ca6358dc4ef5c6b27"}
Jul 09 18:42:25.491933 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:25.491751    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:42:25.492863 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:25.492842    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8fz5c" event={"ID":"29a841a1-eb99-4d6d-9b45-3b3c9a179692","Type":"ContainerStarted","Data":"b25fe1fa616337390f519536513255eaae92079079e2b0041ebcd3d0ae6cb380"}
Jul 09 18:42:25.516096 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:25.516048    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25" podStartSLOduration=79.516030416 podStartE2EDuration="1m19.516030416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:41:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:25.514436087 +0000 UTC m=+79.875583272" watchObservedRunningTime="2026-07-09 18:42:25.516030416 +0000 UTC m=+79.877177598"
Jul 09 18:42:26.865496 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:26.865456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t9l7p\" (UID: \"7e33c227-294c-4a33-8404-16b6a5ce8746\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p"
Jul 09 18:42:26.868085 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:26.868052    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e33c227-294c-4a33-8404-16b6a5ce8746-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-t9l7p\" (UID: \"7e33c227-294c-4a33-8404-16b6a5ce8746\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p"
Jul 09 18:42:26.969240 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:26.969201    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p"
Jul 09 18:42:27.330712 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:27.330684    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p"]
Jul 09 18:42:27.501107 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:27.501074    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8fz5c" event={"ID":"29a841a1-eb99-4d6d-9b45-3b3c9a179692","Type":"ContainerStarted","Data":"98e46e85f1bbfe762232d6fa2ee4ce2c7908e2391872dbdd71bf3d6479684db2"}
Jul 09 18:42:27.501295 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:27.501128    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8fz5c" event={"ID":"29a841a1-eb99-4d6d-9b45-3b3c9a179692","Type":"ContainerStarted","Data":"0ce20b4690a7c208cb8ab3e1b569a899dfa11576a8fb31fb6e6a44055d89741b"}
Jul 09 18:42:27.501295 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:27.501193    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:42:27.502220 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:27.502199    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p" event={"ID":"7e33c227-294c-4a33-8404-16b6a5ce8746","Type":"ContainerStarted","Data":"c84701552fac3284553193022a7c3640bbb330f93b3a8da2aa4c493e1ca9bcaf"}
Jul 09 18:42:27.520605 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:27.520568    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8fz5c" podStartSLOduration=33.586974524 podStartE2EDuration="35.520557774s" totalImagesPullingTime="1.93358325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:41:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:27.519000026 +0000 UTC m=+81.880147205" watchObservedRunningTime="2026-07-09 18:42:27.520557774 +0000 UTC m=+81.881704953"
Jul 09 18:42:29.511855 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:29.511818    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p" event={"ID":"7e33c227-294c-4a33-8404-16b6a5ce8746","Type":"ContainerStarted","Data":"ff5ea5398b36faf921f1872684fbac8f4cd17c4c595937a6cad2e9a3b332c2e1"}
Jul 09 18:42:29.512231 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:29.511902    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p" event={"ID":"7e33c227-294c-4a33-8404-16b6a5ce8746","Type":"ContainerStarted","Data":"d860f0e32159cec4df55e5f47b7fc2ec704efdc9298438fbdb0fc52a0b915c7b"}
Jul 09 18:42:29.537879 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:29.537839    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-t9l7p" podStartSLOduration=17.566634078 podStartE2EDuration="19.537826883s" totalImagesPullingTime="1.971192805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:29.536437782 +0000 UTC m=+83.897584960" watchObservedRunningTime="2026-07-09 18:42:29.537826883 +0000 UTC m=+83.898974062"
Jul 09 18:42:31.803552 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:31.803520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:31.804005 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:31.803569    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:31.804046 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:31.804006    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7aa21fba-2be2-47eb-b842-788e9df26b67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:31.805915 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:31.805897    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7aa21fba-2be2-47eb-b842-788e9df26b67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hjrpq\" (UID: \"7aa21fba-2be2-47eb-b842-788e9df26b67\") " pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:31.859714 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:31.859683    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hjrpq"
Jul 09 18:42:31.984550 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:31.984517    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hjrpq"]
Jul 09 18:42:31.987275 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:42:31.987251    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aa21fba_2be2_47eb_b842_788e9df26b67.slice/crio-798b585c782115a3e152a2bb9b015d8d1b16c2583197da211d3b6747e983dd9c WatchSource:0}: Error finding container 798b585c782115a3e152a2bb9b015d8d1b16c2583197da211d3b6747e983dd9c: Status 404 returned error can't find the container with id 798b585c782115a3e152a2bb9b015d8d1b16c2583197da211d3b6747e983dd9c
Jul 09 18:42:32.523992 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:32.523957    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hjrpq" event={"ID":"7aa21fba-2be2-47eb-b842-788e9df26b67","Type":"ContainerStarted","Data":"798b585c782115a3e152a2bb9b015d8d1b16c2583197da211d3b6747e983dd9c"}
Jul 09 18:42:36.539135 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.539062    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hjrpq" event={"ID":"7aa21fba-2be2-47eb-b842-788e9df26b67","Type":"ContainerStarted","Data":"e54f44cb08bc73e50cab0617cda10fdbfef124f7820355028c56f8e4740e6de8"}
Jul 09 18:42:36.539135 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.539117    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hjrpq" event={"ID":"7aa21fba-2be2-47eb-b842-788e9df26b67","Type":"ContainerStarted","Data":"03d0e06aabba82087ded3f4ce92c7753dc0559a3b234c9defe35ce2718d52f4c"}
Jul 09 18:42:36.805106 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.805023    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658fb84698-xct2d"]
Jul 09 18:42:36.808163 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.808126    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658fb84698-xct2d"
Jul 09 18:42:36.808882 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.808859    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"]
Jul 09 18:42:36.812012 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.811995    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:36.817498 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.817176    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 18:42:36.817498 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.817336    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 09 18:42:36.817498 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.817386    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 18:42:36.818200 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.818178    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 09 18:42:36.831543 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.831522    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 18:42:36.832842 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.832789    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 09 18:42:36.833265 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.833215    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-66hwg\""
Jul 09 18:42:36.833359 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.833294    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 09 18:42:36.833857 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.833510    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 09 18:42:36.835017 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.834983    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658fb84698-xct2d"]
Jul 09 18:42:36.842361 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.842322    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"]
Jul 09 18:42:36.943338 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.943300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:36.943338 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.943345    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37d1b3c9-04f4-4aa3-b8aa-dfb8ae891d8c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-658fb84698-xct2d\" (UID: \"37d1b3c9-04f4-4aa3-b8aa-dfb8ae891d8c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658fb84698-xct2d"
Jul 09 18:42:36.943585 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.943370    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-ca\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:36.943585 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.943494    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-hub\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:36.943585 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.943536    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:36.943585 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.943558    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2w82\" (UniqueName: \"kubernetes.io/projected/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-kube-api-access-j2w82\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:36.943822 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.943587    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:36.943822 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:36.943647    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqbxd\" (UniqueName: \"kubernetes.io/projected/37d1b3c9-04f4-4aa3-b8aa-dfb8ae891d8c-kube-api-access-sqbxd\") pod \"managed-serviceaccount-addon-agent-658fb84698-xct2d\" (UID: \"37d1b3c9-04f4-4aa3-b8aa-dfb8ae891d8c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658fb84698-xct2d"
Jul 09 18:42:37.045062 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.045019    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:37.045062 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.045066    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37d1b3c9-04f4-4aa3-b8aa-dfb8ae891d8c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-658fb84698-xct2d\" (UID: \"37d1b3c9-04f4-4aa3-b8aa-dfb8ae891d8c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658fb84698-xct2d"
Jul 09 18:42:37.045317 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.045107    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-ca\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:37.045317 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.045159    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-hub\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:37.045317 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.045248    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:37.045317 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.045275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2w82\" (UniqueName: \"kubernetes.io/projected/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-kube-api-access-j2w82\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:37.045317 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.045310    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:37.045498 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.045341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqbxd\" (UniqueName: \"kubernetes.io/projected/37d1b3c9-04f4-4aa3-b8aa-dfb8ae891d8c-kube-api-access-sqbxd\") pod \"managed-serviceaccount-addon-agent-658fb84698-xct2d\" (UID: \"37d1b3c9-04f4-4aa3-b8aa-dfb8ae891d8c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658fb84698-xct2d"
Jul 09 18:42:37.045889 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.045824    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:37.048164 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.048114    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-ca\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:37.048829 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.048440    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/37d1b3c9-04f4-4aa3-b8aa-dfb8ae891d8c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-658fb84698-xct2d\" (UID: \"37d1b3c9-04f4-4aa3-b8aa-dfb8ae891d8c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658fb84698-xct2d"
Jul 09 18:42:37.048829 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.048672    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:37.048829 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.048775    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:37.049036 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.049013    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-hub\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:37.056726 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.056658    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2w82\" (UniqueName: \"kubernetes.io/projected/1dd9f9cc-72c6-4846-8ceb-5c3078901ffd-kube-api-access-j2w82\") pod \"cluster-proxy-proxy-agent-594b977956-6g7xl\" (UID: \"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:37.059756 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.059713    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqbxd\" (UniqueName: \"kubernetes.io/projected/37d1b3c9-04f4-4aa3-b8aa-dfb8ae891d8c-kube-api-access-sqbxd\") pod \"managed-serviceaccount-addon-agent-658fb84698-xct2d\" (UID: \"37d1b3c9-04f4-4aa3-b8aa-dfb8ae891d8c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658fb84698-xct2d"
Jul 09 18:42:37.129269 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.129235    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658fb84698-xct2d"
Jul 09 18:42:37.137442 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.137421    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"
Jul 09 18:42:37.283296 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.283095    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658fb84698-xct2d"]
Jul 09 18:42:37.286244 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:42:37.286220    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37d1b3c9_04f4_4aa3_b8aa_dfb8ae891d8c.slice/crio-a6c57b8da413539ef8c3e0fdf662d05f59486b246d7372a0551fc48e33e66634 WatchSource:0}: Error finding container a6c57b8da413539ef8c3e0fdf662d05f59486b246d7372a0551fc48e33e66634: Status 404 returned error can't find the container with id a6c57b8da413539ef8c3e0fdf662d05f59486b246d7372a0551fc48e33e66634
Jul 09 18:42:37.301539 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.301092    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl"]
Jul 09 18:42:37.304872 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:42:37.304849    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dd9f9cc_72c6_4846_8ceb_5c3078901ffd.slice/crio-d2f0d3205868d7d4e0ccad71dc31d51a20df918ab9ad95440e2a4aeafcd1d886 WatchSource:0}: Error finding container d2f0d3205868d7d4e0ccad71dc31d51a20df918ab9ad95440e2a4aeafcd1d886: Status 404 returned error can't find the container with id d2f0d3205868d7d4e0ccad71dc31d51a20df918ab9ad95440e2a4aeafcd1d886
Jul 09 18:42:37.509486 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.509455    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8fz5c"
Jul 09 18:42:37.543817 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.543770    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl" event={"ID":"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd","Type":"ContainerStarted","Data":"d2f0d3205868d7d4e0ccad71dc31d51a20df918ab9ad95440e2a4aeafcd1d886"}
Jul 09 18:42:37.544984 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:37.544948    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658fb84698-xct2d" event={"ID":"37d1b3c9-04f4-4aa3-b8aa-dfb8ae891d8c","Type":"ContainerStarted","Data":"a6c57b8da413539ef8c3e0fdf662d05f59486b246d7372a0551fc48e33e66634"}
Jul 09 18:42:39.556383 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:39.556335    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hjrpq" event={"ID":"7aa21fba-2be2-47eb-b842-788e9df26b67","Type":"ContainerStarted","Data":"9ea5adfb158c8a0ee822fd68fc5a087fc164625a5df06b16e1ee331652bbf1b1"}
Jul 09 18:42:39.576916 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:39.576861    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hjrpq" podStartSLOduration=17.865110267 podStartE2EDuration="24.576841111s" totalImagesPullingTime="6.711730844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:42:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:39.576664269 +0000 UTC m=+93.937811449" watchObservedRunningTime="2026-07-09 18:42:39.576841111 +0000 UTC m=+93.937988292"
Jul 09 18:42:42.569472 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:42.569434    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658fb84698-xct2d" event={"ID":"37d1b3c9-04f4-4aa3-b8aa-dfb8ae891d8c","Type":"ContainerStarted","Data":"9bd13b0f98d3760b2c9bd75e93ef2ae9b3b35f78edf3afbd82d493fd35fc384a"}
Jul 09 18:42:42.571509 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:42.571488    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl" event={"ID":"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd","Type":"ContainerStarted","Data":"e9a9700029e21188657752a846aa1ba581c92498c63dd557c2db32a016fe15ad"}
Jul 09 18:42:42.571604 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:42.571523    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl" event={"ID":"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd","Type":"ContainerStarted","Data":"b11553bf6bf3202af7cdcd594c076ba678a0c901e6ea348fb32a2787ddb9fdb9"}
Jul 09 18:42:42.571604 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:42.571536    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl" event={"ID":"1dd9f9cc-72c6-4846-8ceb-5c3078901ffd","Type":"ContainerStarted","Data":"7d2ad735e04b53de025295273e4385f6286a41da55f3c844119648a7ed6c11b2"}
Jul 09 18:42:42.586867 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:42.586824    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658fb84698-xct2d" podStartSLOduration=1.775778426 podStartE2EDuration="6.586811223s" totalImagesPullingTime="4.811032797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:42.586257323 +0000 UTC m=+96.947404507" watchObservedRunningTime="2026-07-09 18:42:42.586811223 +0000 UTC m=+96.947958402"
Jul 09 18:42:42.604738 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:42.604680    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-594b977956-6g7xl" podStartSLOduration=1.80127305 podStartE2EDuration="6.604663456s" totalImagesPullingTime="4.803390406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:42.604509076 +0000 UTC m=+96.965656256" watchObservedRunningTime="2026-07-09 18:42:42.604663456 +0000 UTC m=+96.965810637"
Jul 09 18:42:45.138724 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:45.138692    2562 patch_prober.go:28] interesting pod/image-registry-6fbdc9bfd8-gvq25 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 09 18:42:45.139121 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:45.138751    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25" podUID="4a2b3d30-bc5b-48e8-8af1-9dd3c586022d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 18:42:46.500340 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:46.500314    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:42:48.915244 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:48.915211    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6qxqh"]
Jul 09 18:42:48.946617 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:48.946592    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:48.961121 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:48.961057    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 18:42:48.963814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:48.963530    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 18:42:48.963814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:48.963758    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 18:42:48.964731 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:48.964299    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 18:42:48.964731 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:48.964582    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-72qx8\""
Jul 09 18:42:48.968691 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:48.968538    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 18:42:48.980935 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:48.980916    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 18:42:49.040368 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.040342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02cd4500-cf5d-4276-a68a-1843a80b4763-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.040471 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.040373    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s59wg\" (UniqueName: \"kubernetes.io/projected/02cd4500-cf5d-4276-a68a-1843a80b4763-kube-api-access-s59wg\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.040471 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.040394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/02cd4500-cf5d-4276-a68a-1843a80b4763-node-exporter-wtmp\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.040471 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.040443    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/02cd4500-cf5d-4276-a68a-1843a80b4763-node-exporter-textfile\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.040606 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.040491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/02cd4500-cf5d-4276-a68a-1843a80b4763-node-exporter-accelerators-collector-config\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.040606 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.040517    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02cd4500-cf5d-4276-a68a-1843a80b4763-metrics-client-ca\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.040606 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.040540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/02cd4500-cf5d-4276-a68a-1843a80b4763-root\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.040606 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.040569    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02cd4500-cf5d-4276-a68a-1843a80b4763-sys\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.040606 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.040586    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/02cd4500-cf5d-4276-a68a-1843a80b4763-node-exporter-tls\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.140881 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.140853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02cd4500-cf5d-4276-a68a-1843a80b4763-sys\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.140881 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.140882    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/02cd4500-cf5d-4276-a68a-1843a80b4763-node-exporter-tls\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.141056 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.140926    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02cd4500-cf5d-4276-a68a-1843a80b4763-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.141056 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.140950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s59wg\" (UniqueName: \"kubernetes.io/projected/02cd4500-cf5d-4276-a68a-1843a80b4763-kube-api-access-s59wg\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.141056 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.140969    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02cd4500-cf5d-4276-a68a-1843a80b4763-sys\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.141056 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.140986    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/02cd4500-cf5d-4276-a68a-1843a80b4763-node-exporter-wtmp\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.141056 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.141029    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/02cd4500-cf5d-4276-a68a-1843a80b4763-node-exporter-textfile\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.141292 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.141060    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/02cd4500-cf5d-4276-a68a-1843a80b4763-node-exporter-accelerators-collector-config\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.141292 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.141097    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02cd4500-cf5d-4276-a68a-1843a80b4763-metrics-client-ca\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.141292 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.141122    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/02cd4500-cf5d-4276-a68a-1843a80b4763-node-exporter-wtmp\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.141292 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.141129    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/02cd4500-cf5d-4276-a68a-1843a80b4763-root\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.141292 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.141190    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/02cd4500-cf5d-4276-a68a-1843a80b4763-root\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.141565 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.141547    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/02cd4500-cf5d-4276-a68a-1843a80b4763-node-exporter-textfile\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.141687 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.141600    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/02cd4500-cf5d-4276-a68a-1843a80b4763-node-exporter-accelerators-collector-config\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.141687 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.141685    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02cd4500-cf5d-4276-a68a-1843a80b4763-metrics-client-ca\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.143461 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.143444    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/02cd4500-cf5d-4276-a68a-1843a80b4763-node-exporter-tls\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.143543 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.143474    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02cd4500-cf5d-4276-a68a-1843a80b4763-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.154682 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.154665    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s59wg\" (UniqueName: \"kubernetes.io/projected/02cd4500-cf5d-4276-a68a-1843a80b4763-kube-api-access-s59wg\") pod \"node-exporter-6qxqh\" (UID: \"02cd4500-cf5d-4276-a68a-1843a80b4763\") " pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.259600 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.259578    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6qxqh"
Jul 09 18:42:49.297172 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:42:49.297129    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02cd4500_cf5d_4276_a68a_1843a80b4763.slice/crio-a277a2bfdd9e1dfab21a28836e647a7a325a5b6cd1544afd671bccad659c73b8 WatchSource:0}: Error finding container a277a2bfdd9e1dfab21a28836e647a7a325a5b6cd1544afd671bccad659c73b8: Status 404 returned error can't find the container with id a277a2bfdd9e1dfab21a28836e647a7a325a5b6cd1544afd671bccad659c73b8
Jul 09 18:42:49.475270 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.475245    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cl4vn"
Jul 09 18:42:49.595064 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:49.594977    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6qxqh" event={"ID":"02cd4500-cf5d-4276-a68a-1843a80b4763","Type":"ContainerStarted","Data":"a277a2bfdd9e1dfab21a28836e647a7a325a5b6cd1544afd671bccad659c73b8"}
Jul 09 18:42:50.599467 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:50.599393    2562 generic.go:356] "Generic (PLEG): container finished" podID="02cd4500-cf5d-4276-a68a-1843a80b4763" containerID="8bae9b3bc7e4f0e4b96acbc5ee3385395cd05daac020ba423f918bb7def6395f" exitCode=0
Jul 09 18:42:50.599467 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:50.599461    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6qxqh" event={"ID":"02cd4500-cf5d-4276-a68a-1843a80b4763","Type":"ContainerDied","Data":"8bae9b3bc7e4f0e4b96acbc5ee3385395cd05daac020ba423f918bb7def6395f"}
Jul 09 18:42:51.604642 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:51.604607    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6qxqh" event={"ID":"02cd4500-cf5d-4276-a68a-1843a80b4763","Type":"ContainerStarted","Data":"94719f703488308124c37ebf59724fdb8b6fb0cda31613f8a0b8e68a25a584d4"}
Jul 09 18:42:51.605031 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:42:51.604659    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6qxqh" event={"ID":"02cd4500-cf5d-4276-a68a-1843a80b4763","Type":"ContainerStarted","Data":"4a296bf8fd7f82a517fc1739d4170405f264559b5dae00f5e696c64293e27e12"}
Jul 09 18:43:00.010388 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:00.010334    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6qxqh" podStartSLOduration=10.901764632 podStartE2EDuration="12.010313812s" totalImagesPullingTime="1.037404822s" totalInitContainerRuntime="71.144358ms" isStatefulPod=true podCreationTimestamp="2026-07-09 18:42:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:42:51.627412153 +0000 UTC m=+105.988559333" watchObservedRunningTime="2026-07-09 18:43:00.010313812 +0000 UTC m=+114.371460993"
Jul 09 18:43:00.011267 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:00.011248    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"]
Jul 09 18:43:02.088066 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.088034    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6499676fdf-prw7x"]
Jul 09 18:43:02.091288 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.091270    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.094445 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.094420    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 18:43:02.094445 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.094429    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 18:43:02.094621 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.094486    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 18:43:02.095767 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.095747    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 18:43:02.095767 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.095761    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 18:43:02.095993 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.095756    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 18:43:02.095993 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.095882    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 18:43:02.096100 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.096080    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bvkvd\""
Jul 09 18:43:02.100883 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.100867    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 18:43:02.106584 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.106568    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6499676fdf-prw7x"]
Jul 09 18:43:02.131524 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.131496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-oauth-serving-cert\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.131644 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.131535    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-serving-cert\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.131644 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.131553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-trusted-ca-bundle\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.131644 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.131574    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qww4g\" (UniqueName: \"kubernetes.io/projected/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-kube-api-access-qww4g\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.131764 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.131645    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-oauth-config\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.131764 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.131684    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-config\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.131764 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.131724    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-service-ca\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.232523 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.232494    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-oauth-config\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.232678 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.232551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-config\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.232678 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.232595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-service-ca\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.232678 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.232622    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-oauth-serving-cert\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.232678 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.232648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-serving-cert\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.232901 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.232694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-trusted-ca-bundle\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.232901 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.232745    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qww4g\" (UniqueName: \"kubernetes.io/projected/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-kube-api-access-qww4g\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.233520 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.233476    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-oauth-serving-cert\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.233658 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.233630    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-config\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.233834 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.233740    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-service-ca\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.233921 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.233879    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-trusted-ca-bundle\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.235220 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.235198    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-oauth-config\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.235298 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.235283    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-serving-cert\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.242671 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.242648    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qww4g\" (UniqueName: \"kubernetes.io/projected/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-kube-api-access-qww4g\") pod \"console-6499676fdf-prw7x\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") " pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.401127 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.401060    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:02.543893 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.543866    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6499676fdf-prw7x"]
Jul 09 18:43:02.546227 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:43:02.546202    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e69b1e_ed56_4bfa_a6a2_6a25bfc9b7c6.slice/crio-290603bfe9c6238788945828226a39a1e14b236b559dec53d5c2b85ffe162afb WatchSource:0}: Error finding container 290603bfe9c6238788945828226a39a1e14b236b559dec53d5c2b85ffe162afb: Status 404 returned error can't find the container with id 290603bfe9c6238788945828226a39a1e14b236b559dec53d5c2b85ffe162afb
Jul 09 18:43:02.642691 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:02.642666    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6499676fdf-prw7x" event={"ID":"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6","Type":"ContainerStarted","Data":"290603bfe9c6238788945828226a39a1e14b236b559dec53d5c2b85ffe162afb"}
Jul 09 18:43:06.656606 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:06.656572    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6499676fdf-prw7x" event={"ID":"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6","Type":"ContainerStarted","Data":"59597c3b22dd259bd1c8772f8a0d9d76f08b9fa0374de41868bd83cf66730f2c"}
Jul 09 18:43:06.678934 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:06.678889    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6499676fdf-prw7x" podStartSLOduration=1.158574898 podStartE2EDuration="4.678874014s" totalImagesPullingTime="3.520299116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:43:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:43:06.677455756 +0000 UTC m=+121.038602940" watchObservedRunningTime="2026-07-09 18:43:06.678874014 +0000 UTC m=+121.040021193"
Jul 09 18:43:12.401187 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:12.401129    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:12.401580 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:12.401215    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:12.406529 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:12.406510    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:12.679679 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:12.679601    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:43:15.026109 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:15.026075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs\") pod \"network-metrics-daemon-44bfx\" (UID: \"937f81e1-d44b-4678-bcd7-82659b01b28b\") " pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:43:15.028557 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:15.028533    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/937f81e1-d44b-4678-bcd7-82659b01b28b-metrics-certs\") pod \"network-metrics-daemon-44bfx\" (UID: \"937f81e1-d44b-4678-bcd7-82659b01b28b\") " pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:43:15.064655 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:15.064626    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ppzx8\""
Jul 09 18:43:15.072984 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:15.072969    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-44bfx"
Jul 09 18:43:15.361791 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:15.361757    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-44bfx"]
Jul 09 18:43:15.364881 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:43:15.364853    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937f81e1_d44b_4678_bcd7_82659b01b28b.slice/crio-8c739320fe1681cbeffc10ea18eaa49e5b0c8516e21869f2922e9b94cbc26c41 WatchSource:0}: Error finding container 8c739320fe1681cbeffc10ea18eaa49e5b0c8516e21869f2922e9b94cbc26c41: Status 404 returned error can't find the container with id 8c739320fe1681cbeffc10ea18eaa49e5b0c8516e21869f2922e9b94cbc26c41
Jul 09 18:43:15.687978 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:15.687895    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-44bfx" event={"ID":"937f81e1-d44b-4678-bcd7-82659b01b28b","Type":"ContainerStarted","Data":"8c739320fe1681cbeffc10ea18eaa49e5b0c8516e21869f2922e9b94cbc26c41"}
Jul 09 18:43:16.693685 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:16.693659    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-44bfx" event={"ID":"937f81e1-d44b-4678-bcd7-82659b01b28b","Type":"ContainerStarted","Data":"8f9846d4367b44fb9989cbaec87aaf6e4691504b086dc1a938c59603b04931c6"}
Jul 09 18:43:16.694077 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:16.693716    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-44bfx" event={"ID":"937f81e1-d44b-4678-bcd7-82659b01b28b","Type":"ContainerStarted","Data":"023aafb0d91e93ca3de8e3e2c0ea77e30968587d1805e6d45867dac09f9d8ff3"}
Jul 09 18:43:16.712323 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:16.712281    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-44bfx" podStartSLOduration=129.56150693 podStartE2EDuration="2m10.71226549s" totalImagesPullingTime="1.15075856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:43:16.71073604 +0000 UTC m=+131.071883214" watchObservedRunningTime="2026-07-09 18:43:16.71226549 +0000 UTC m=+131.073412670"
Jul 09 18:43:25.031932 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.031874    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25" podUID="4a2b3d30-bc5b-48e8-8af1-9dd3c586022d" containerName="registry" containerID="cri-o://e16631f17fc867d661b52a1972e0dd001b294dfcd2a58b598f4b10cce22efd7d" gracePeriod=30
Jul 09 18:43:25.271809 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.271785    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:43:25.402786 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.402716    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnt7n\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-kube-api-access-hnt7n\") pod \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") "
Jul 09 18:43:25.402786 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.402753    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls\") pod \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") "
Jul 09 18:43:25.402956 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.402860    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-ca-trust-extracted\") pod \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") "
Jul 09 18:43:25.402956 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.402915    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-image-registry-private-configuration\") pod \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") "
Jul 09 18:43:25.403046 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.402968    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-installation-pull-secrets\") pod \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") "
Jul 09 18:43:25.403046 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.402998    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-certificates\") pod \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") "
Jul 09 18:43:25.403046 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.403029    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-bound-sa-token\") pod \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") "
Jul 09 18:43:25.403283 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.403074    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-trusted-ca\") pod \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\" (UID: \"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d\") "
Jul 09 18:43:25.403558 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.403502    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d" (UID: "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:43:25.403949 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.403924    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d" (UID: "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:43:25.405379 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.405346    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-kube-api-access-hnt7n" (OuterVolumeSpecName: "kube-api-access-hnt7n") pod "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d" (UID: "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d"). InnerVolumeSpecName "kube-api-access-hnt7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:43:25.405484 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.405405    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d" (UID: "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:43:25.405698 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.405670    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d" (UID: "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:43:25.405773 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.405741    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d" (UID: "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:43:25.405961 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.405940    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d" (UID: "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:43:25.413695 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.413665    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d" (UID: "4a2b3d30-bc5b-48e8-8af1-9dd3c586022d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:43:25.504185 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.504159    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-image-registry-private-configuration\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:43:25.504185 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.504182    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-installation-pull-secrets\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:43:25.504324 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.504192    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-certificates\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:43:25.504324 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.504201    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-bound-sa-token\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:43:25.504324 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.504209    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-trusted-ca\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:43:25.504324 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.504217    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnt7n\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-kube-api-access-hnt7n\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:43:25.504324 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.504224    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-registry-tls\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:43:25.504324 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.504231    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d-ca-trust-extracted\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:43:25.727103 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.727026    2562 generic.go:356] "Generic (PLEG): container finished" podID="4a2b3d30-bc5b-48e8-8af1-9dd3c586022d" containerID="e16631f17fc867d661b52a1972e0dd001b294dfcd2a58b598f4b10cce22efd7d" exitCode=0
Jul 09 18:43:25.727103 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.727071    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25" event={"ID":"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d","Type":"ContainerDied","Data":"e16631f17fc867d661b52a1972e0dd001b294dfcd2a58b598f4b10cce22efd7d"}
Jul 09 18:43:25.727329 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.727107    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25" event={"ID":"4a2b3d30-bc5b-48e8-8af1-9dd3c586022d","Type":"ContainerDied","Data":"8420fcce277bc2a23bdbf6c0c4dd87f44e40dfeab1c73f3ca6358dc4ef5c6b27"}
Jul 09 18:43:25.727329 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.727126    2562 scope.go:117] "RemoveContainer" containerID="e16631f17fc867d661b52a1972e0dd001b294dfcd2a58b598f4b10cce22efd7d"
Jul 09 18:43:25.727329 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.727073    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"
Jul 09 18:43:25.735614 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.735598    2562 scope.go:117] "RemoveContainer" containerID="e16631f17fc867d661b52a1972e0dd001b294dfcd2a58b598f4b10cce22efd7d"
Jul 09 18:43:25.735897 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:43:25.735875    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e16631f17fc867d661b52a1972e0dd001b294dfcd2a58b598f4b10cce22efd7d\": container with ID starting with e16631f17fc867d661b52a1972e0dd001b294dfcd2a58b598f4b10cce22efd7d not found: ID does not exist" containerID="e16631f17fc867d661b52a1972e0dd001b294dfcd2a58b598f4b10cce22efd7d"
Jul 09 18:43:25.735974 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.735907    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e16631f17fc867d661b52a1972e0dd001b294dfcd2a58b598f4b10cce22efd7d"} err="failed to get container status \"e16631f17fc867d661b52a1972e0dd001b294dfcd2a58b598f4b10cce22efd7d\": rpc error: code = NotFound desc = could not find container \"e16631f17fc867d661b52a1972e0dd001b294dfcd2a58b598f4b10cce22efd7d\": container with ID starting with e16631f17fc867d661b52a1972e0dd001b294dfcd2a58b598f4b10cce22efd7d not found: ID does not exist"
Jul 09 18:43:25.750900 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.750878    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"]
Jul 09 18:43:25.755840 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:25.755819    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6fbdc9bfd8-gvq25"]
Jul 09 18:43:26.151764 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:26.151733    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a2b3d30-bc5b-48e8-8af1-9dd3c586022d" path="/var/lib/kubelet/pods/4a2b3d30-bc5b-48e8-8af1-9dd3c586022d/volumes"
Jul 09 18:43:54.828334 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:54.828301    2562 generic.go:356] "Generic (PLEG): container finished" podID="f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6" containerID="a10266bb09cf65ffdc82b216e1fa467ba047b9295da719b190a39d8b62531345" exitCode=0
Jul 09 18:43:54.828721 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:54.828374    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx" event={"ID":"f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6","Type":"ContainerDied","Data":"a10266bb09cf65ffdc82b216e1fa467ba047b9295da719b190a39d8b62531345"}
Jul 09 18:43:54.828721 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:54.828669    2562 scope.go:117] "RemoveContainer" containerID="a10266bb09cf65ffdc82b216e1fa467ba047b9295da719b190a39d8b62531345"
Jul 09 18:43:55.833623 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:43:55.833591    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-z2mjx" event={"ID":"f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6","Type":"ContainerStarted","Data":"632ac924b773e2f40172a7a1180b5fac8bc96e30aee961eb27386563a3313cfb"}
Jul 09 18:44:10.284292 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.284218    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84fb8b5cc6-9hmtm"]
Jul 09 18:44:10.284862 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.284830    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a2b3d30-bc5b-48e8-8af1-9dd3c586022d" containerName="registry"
Jul 09 18:44:10.284862 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.284849    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a2b3d30-bc5b-48e8-8af1-9dd3c586022d" containerName="registry"
Jul 09 18:44:10.285723 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.284975    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a2b3d30-bc5b-48e8-8af1-9dd3c586022d" containerName="registry"
Jul 09 18:44:10.290394 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.290373    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.300688 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.300664    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84fb8b5cc6-9hmtm"]
Jul 09 18:44:10.405963 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.405928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-oauth-config\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.405963 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.405965    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-trusted-ca-bundle\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.406189 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.405989    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rkzs\" (UniqueName: \"kubernetes.io/projected/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-kube-api-access-2rkzs\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.406189 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.406069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-config\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.406189 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.406108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-service-ca\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.406189 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.406161    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-serving-cert\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.406317 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.406229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-oauth-serving-cert\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.506941 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.506905    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rkzs\" (UniqueName: \"kubernetes.io/projected/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-kube-api-access-2rkzs\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.506941 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.506945    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-config\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.507212 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.506967    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-service-ca\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.507212 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.506996    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-serving-cert\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.507212 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.507028    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-oauth-serving-cert\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.507212 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.507056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-oauth-config\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.507212 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.507085    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-trusted-ca-bundle\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.507897 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.507845    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-oauth-serving-cert\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.507897 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.507856    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-service-ca\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.508053 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.507960    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-trusted-ca-bundle\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.508053 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.508015    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-config\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.509740 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.509718    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-oauth-config\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.509847 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.509743    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-serving-cert\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.516358 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.516336    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rkzs\" (UniqueName: \"kubernetes.io/projected/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-kube-api-access-2rkzs\") pod \"console-84fb8b5cc6-9hmtm\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") " pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.599365 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.599278    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:10.734497 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.734370    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84fb8b5cc6-9hmtm"]
Jul 09 18:44:10.737099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:44:10.737067    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528b9df1_a9d2_42cb_b5cf_7af456ad4e7d.slice/crio-20ffa10b200430bf199658db151bd187d73ebe1a8b5746bc3e8985eb3a299cc8 WatchSource:0}: Error finding container 20ffa10b200430bf199658db151bd187d73ebe1a8b5746bc3e8985eb3a299cc8: Status 404 returned error can't find the container with id 20ffa10b200430bf199658db151bd187d73ebe1a8b5746bc3e8985eb3a299cc8
Jul 09 18:44:10.889760 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.889688    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84fb8b5cc6-9hmtm" event={"ID":"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d","Type":"ContainerStarted","Data":"3a48353ca6de0fabe37baa412ffef572f772d416ec7cf019ac91e7440329c616"}
Jul 09 18:44:10.889760 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.889736    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84fb8b5cc6-9hmtm" event={"ID":"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d","Type":"ContainerStarted","Data":"20ffa10b200430bf199658db151bd187d73ebe1a8b5746bc3e8985eb3a299cc8"}
Jul 09 18:44:10.912432 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:10.912382    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84fb8b5cc6-9hmtm" podStartSLOduration=0.912366971 podStartE2EDuration="912.366971ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:44:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:44:10.911585939 +0000 UTC m=+185.272733119" watchObservedRunningTime="2026-07-09 18:44:10.912366971 +0000 UTC m=+185.273514218"
Jul 09 18:44:20.599528 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:20.599489    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:20.600026 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:20.599580    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:20.604227 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:20.604202    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:20.929293 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:20.929214    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:44:21.012265 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:21.012235    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6499676fdf-prw7x"]
Jul 09 18:44:46.032226 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.032184    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6499676fdf-prw7x" podUID="20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6" containerName="console" containerID="cri-o://59597c3b22dd259bd1c8772f8a0d9d76f08b9fa0374de41868bd83cf66730f2c" gracePeriod=15
Jul 09 18:44:46.276625 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.276600    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:44:46.458314 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.458237    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-serving-cert\") pod \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") "
Jul 09 18:44:46.458314 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.458277    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-oauth-config\") pod \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") "
Jul 09 18:44:46.458314 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.458311    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-trusted-ca-bundle\") pod \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") "
Jul 09 18:44:46.458554 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.458355    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-config\") pod \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") "
Jul 09 18:44:46.458554 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.458383    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-oauth-serving-cert\") pod \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") "
Jul 09 18:44:46.458554 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.458409    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qww4g\" (UniqueName: \"kubernetes.io/projected/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-kube-api-access-qww4g\") pod \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") "
Jul 09 18:44:46.458554 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.458429    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-service-ca\") pod \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\" (UID: \"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6\") "
Jul 09 18:44:46.458809 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.458771    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-config" (OuterVolumeSpecName: "console-config") pod "20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6" (UID: "20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:44:46.458809 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.458798    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6" (UID: "20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:44:46.459100 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.458790    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6" (UID: "20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:44:46.459100 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.458821    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-service-ca" (OuterVolumeSpecName: "service-ca") pod "20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6" (UID: "20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:44:46.460542 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.460516    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6" (UID: "20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:44:46.460641 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.460557    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-kube-api-access-qww4g" (OuterVolumeSpecName: "kube-api-access-qww4g") pod "20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6" (UID: "20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6"). InnerVolumeSpecName "kube-api-access-qww4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:44:46.460641 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.460588    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6" (UID: "20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:44:46.558915 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.558895    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-oauth-serving-cert\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:44:46.558915 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.558913    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qww4g\" (UniqueName: \"kubernetes.io/projected/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-kube-api-access-qww4g\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:44:46.559050 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.558933    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-service-ca\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:44:46.559050 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.558942    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-serving-cert\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:44:46.559050 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.558950    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-oauth-config\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:44:46.559050 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.558959    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-trusted-ca-bundle\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:44:46.559050 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:46.558966    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6-console-config\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:44:47.013726 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:47.013690    2562 generic.go:356] "Generic (PLEG): container finished" podID="20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6" containerID="59597c3b22dd259bd1c8772f8a0d9d76f08b9fa0374de41868bd83cf66730f2c" exitCode=0
Jul 09 18:44:47.013902 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:47.013735    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6499676fdf-prw7x"
Jul 09 18:44:47.013902 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:47.013775    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6499676fdf-prw7x" event={"ID":"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6","Type":"ContainerDied","Data":"59597c3b22dd259bd1c8772f8a0d9d76f08b9fa0374de41868bd83cf66730f2c"}
Jul 09 18:44:47.013902 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:47.013824    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6499676fdf-prw7x" event={"ID":"20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6","Type":"ContainerDied","Data":"290603bfe9c6238788945828226a39a1e14b236b559dec53d5c2b85ffe162afb"}
Jul 09 18:44:47.013902 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:47.013845    2562 scope.go:117] "RemoveContainer" containerID="59597c3b22dd259bd1c8772f8a0d9d76f08b9fa0374de41868bd83cf66730f2c"
Jul 09 18:44:47.022736 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:47.022719    2562 scope.go:117] "RemoveContainer" containerID="59597c3b22dd259bd1c8772f8a0d9d76f08b9fa0374de41868bd83cf66730f2c"
Jul 09 18:44:47.022985 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:44:47.022953    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59597c3b22dd259bd1c8772f8a0d9d76f08b9fa0374de41868bd83cf66730f2c\": container with ID starting with 59597c3b22dd259bd1c8772f8a0d9d76f08b9fa0374de41868bd83cf66730f2c not found: ID does not exist" containerID="59597c3b22dd259bd1c8772f8a0d9d76f08b9fa0374de41868bd83cf66730f2c"
Jul 09 18:44:47.023045 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:47.022991    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59597c3b22dd259bd1c8772f8a0d9d76f08b9fa0374de41868bd83cf66730f2c"} err="failed to get container status \"59597c3b22dd259bd1c8772f8a0d9d76f08b9fa0374de41868bd83cf66730f2c\": rpc error: code = NotFound desc = could not find container \"59597c3b22dd259bd1c8772f8a0d9d76f08b9fa0374de41868bd83cf66730f2c\": container with ID starting with 59597c3b22dd259bd1c8772f8a0d9d76f08b9fa0374de41868bd83cf66730f2c not found: ID does not exist"
Jul 09 18:44:47.047032 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:47.047012    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6499676fdf-prw7x"]
Jul 09 18:44:47.056105 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:47.056086    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6499676fdf-prw7x"]
Jul 09 18:44:48.151405 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:44:48.151373    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6" path="/var/lib/kubelet/pods/20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6/volumes"
Jul 09 18:45:10.379474 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.379435    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz"]
Jul 09 18:45:10.379946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.379769    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6" containerName="console"
Jul 09 18:45:10.379946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.379786    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6" containerName="console"
Jul 09 18:45:10.379946 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.379865    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="20e69b1e-ed56-4bfa-a6a2-6a25bfc9b7c6" containerName="console"
Jul 09 18:45:10.383759 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.383738    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz"
Jul 09 18:45:10.386764 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.386736    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 18:45:10.386877 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.386782    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5pb92\""
Jul 09 18:45:10.388018 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.388000    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 18:45:10.392976 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.392959    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz"]
Jul 09 18:45:10.415841 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.415812    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6252620d-67af-4938-8ea7-954cf9d6811d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz\" (UID: \"6252620d-67af-4938-8ea7-954cf9d6811d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz"
Jul 09 18:45:10.415941 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.415848    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6252620d-67af-4938-8ea7-954cf9d6811d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz\" (UID: \"6252620d-67af-4938-8ea7-954cf9d6811d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz"
Jul 09 18:45:10.415941 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.415881    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62svw\" (UniqueName: \"kubernetes.io/projected/6252620d-67af-4938-8ea7-954cf9d6811d-kube-api-access-62svw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz\" (UID: \"6252620d-67af-4938-8ea7-954cf9d6811d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz"
Jul 09 18:45:10.516681 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.516654    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6252620d-67af-4938-8ea7-954cf9d6811d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz\" (UID: \"6252620d-67af-4938-8ea7-954cf9d6811d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz"
Jul 09 18:45:10.516811 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.516687    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6252620d-67af-4938-8ea7-954cf9d6811d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz\" (UID: \"6252620d-67af-4938-8ea7-954cf9d6811d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz"
Jul 09 18:45:10.516811 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.516709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62svw\" (UniqueName: \"kubernetes.io/projected/6252620d-67af-4938-8ea7-954cf9d6811d-kube-api-access-62svw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz\" (UID: \"6252620d-67af-4938-8ea7-954cf9d6811d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz"
Jul 09 18:45:10.517095 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.517074    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6252620d-67af-4938-8ea7-954cf9d6811d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz\" (UID: \"6252620d-67af-4938-8ea7-954cf9d6811d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz"
Jul 09 18:45:10.517157 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.517085    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6252620d-67af-4938-8ea7-954cf9d6811d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz\" (UID: \"6252620d-67af-4938-8ea7-954cf9d6811d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz"
Jul 09 18:45:10.526972 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.526942    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62svw\" (UniqueName: \"kubernetes.io/projected/6252620d-67af-4938-8ea7-954cf9d6811d-kube-api-access-62svw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz\" (UID: \"6252620d-67af-4938-8ea7-954cf9d6811d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz"
Jul 09 18:45:10.692320 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.692248    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz"
Jul 09 18:45:10.820168 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:10.820089    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz"]
Jul 09 18:45:10.822525 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:45:10.822494    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6252620d_67af_4938_8ea7_954cf9d6811d.slice/crio-fe22ed7745dfdcbe595175406a374e80f01289d1d31960941a7ee7570cf459e5 WatchSource:0}: Error finding container fe22ed7745dfdcbe595175406a374e80f01289d1d31960941a7ee7570cf459e5: Status 404 returned error can't find the container with id fe22ed7745dfdcbe595175406a374e80f01289d1d31960941a7ee7570cf459e5
Jul 09 18:45:11.098651 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:11.098616    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz" event={"ID":"6252620d-67af-4938-8ea7-954cf9d6811d","Type":"ContainerStarted","Data":"fe22ed7745dfdcbe595175406a374e80f01289d1d31960941a7ee7570cf459e5"}
Jul 09 18:45:19.127796 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:19.127712    2562 generic.go:356] "Generic (PLEG): container finished" podID="6252620d-67af-4938-8ea7-954cf9d6811d" containerID="a8b20d9438db160f59503acc53e6e9084b9182203e798843c13741b2987c0f94" exitCode=0
Jul 09 18:45:19.128207 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:19.127796    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz" event={"ID":"6252620d-67af-4938-8ea7-954cf9d6811d","Type":"ContainerDied","Data":"a8b20d9438db160f59503acc53e6e9084b9182203e798843c13741b2987c0f94"}
Jul 09 18:45:21.136372 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:21.136338    2562 generic.go:356] "Generic (PLEG): container finished" podID="6252620d-67af-4938-8ea7-954cf9d6811d" containerID="cabbea99c1bd481c958150c9cdfbdd9abfffe0953430e8d56398e9e9bb281b9b" exitCode=0
Jul 09 18:45:21.136727 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:21.136425    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz" event={"ID":"6252620d-67af-4938-8ea7-954cf9d6811d","Type":"ContainerDied","Data":"cabbea99c1bd481c958150c9cdfbdd9abfffe0953430e8d56398e9e9bb281b9b"}
Jul 09 18:45:30.169551 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:30.169476    2562 generic.go:356] "Generic (PLEG): container finished" podID="6252620d-67af-4938-8ea7-954cf9d6811d" containerID="cccbfc900bc94fac8e133175f65c2005a8ed4b9677ba031a9af6b8e82a4ceabe" exitCode=0
Jul 09 18:45:30.169551 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:30.169539    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz" event={"ID":"6252620d-67af-4938-8ea7-954cf9d6811d","Type":"ContainerDied","Data":"cccbfc900bc94fac8e133175f65c2005a8ed4b9677ba031a9af6b8e82a4ceabe"}
Jul 09 18:45:31.288912 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:31.288888    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz"
Jul 09 18:45:31.373681 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:31.373643    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6252620d-67af-4938-8ea7-954cf9d6811d-util\") pod \"6252620d-67af-4938-8ea7-954cf9d6811d\" (UID: \"6252620d-67af-4938-8ea7-954cf9d6811d\") "
Jul 09 18:45:31.373879 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:31.373729    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62svw\" (UniqueName: \"kubernetes.io/projected/6252620d-67af-4938-8ea7-954cf9d6811d-kube-api-access-62svw\") pod \"6252620d-67af-4938-8ea7-954cf9d6811d\" (UID: \"6252620d-67af-4938-8ea7-954cf9d6811d\") "
Jul 09 18:45:31.373879 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:31.373758    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6252620d-67af-4938-8ea7-954cf9d6811d-bundle\") pod \"6252620d-67af-4938-8ea7-954cf9d6811d\" (UID: \"6252620d-67af-4938-8ea7-954cf9d6811d\") "
Jul 09 18:45:31.374438 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:31.374407    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6252620d-67af-4938-8ea7-954cf9d6811d-bundle" (OuterVolumeSpecName: "bundle") pod "6252620d-67af-4938-8ea7-954cf9d6811d" (UID: "6252620d-67af-4938-8ea7-954cf9d6811d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:45:31.375962 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:31.375931    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6252620d-67af-4938-8ea7-954cf9d6811d-kube-api-access-62svw" (OuterVolumeSpecName: "kube-api-access-62svw") pod "6252620d-67af-4938-8ea7-954cf9d6811d" (UID: "6252620d-67af-4938-8ea7-954cf9d6811d"). InnerVolumeSpecName "kube-api-access-62svw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:45:31.378286 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:31.378265    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6252620d-67af-4938-8ea7-954cf9d6811d-util" (OuterVolumeSpecName: "util") pod "6252620d-67af-4938-8ea7-954cf9d6811d" (UID: "6252620d-67af-4938-8ea7-954cf9d6811d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:45:31.474905 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:31.474817    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6252620d-67af-4938-8ea7-954cf9d6811d-util\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:45:31.474905 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:31.474857    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62svw\" (UniqueName: \"kubernetes.io/projected/6252620d-67af-4938-8ea7-954cf9d6811d-kube-api-access-62svw\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:45:31.474905 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:31.474871    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6252620d-67af-4938-8ea7-954cf9d6811d-bundle\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:45:32.177693 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:32.177665    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz" event={"ID":"6252620d-67af-4938-8ea7-954cf9d6811d","Type":"ContainerDied","Data":"fe22ed7745dfdcbe595175406a374e80f01289d1d31960941a7ee7570cf459e5"}
Jul 09 18:45:32.177693 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:32.177694    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qpwxz"
Jul 09 18:45:32.177849 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:32.177707    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe22ed7745dfdcbe595175406a374e80f01289d1d31960941a7ee7570cf459e5"
Jul 09 18:45:38.496332 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.496304    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-28k48"]
Jul 09 18:45:38.496758 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.496543    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6252620d-67af-4938-8ea7-954cf9d6811d" containerName="util"
Jul 09 18:45:38.496758 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.496554    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6252620d-67af-4938-8ea7-954cf9d6811d" containerName="util"
Jul 09 18:45:38.496758 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.496560    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6252620d-67af-4938-8ea7-954cf9d6811d" containerName="pull"
Jul 09 18:45:38.496758 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.496566    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6252620d-67af-4938-8ea7-954cf9d6811d" containerName="pull"
Jul 09 18:45:38.496758 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.496574    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6252620d-67af-4938-8ea7-954cf9d6811d" containerName="extract"
Jul 09 18:45:38.496758 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.496579    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6252620d-67af-4938-8ea7-954cf9d6811d" containerName="extract"
Jul 09 18:45:38.496758 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.496619    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6252620d-67af-4938-8ea7-954cf9d6811d" containerName="extract"
Jul 09 18:45:38.499720 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.499704    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-28k48"
Jul 09 18:45:38.502850 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.502826    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 09 18:45:38.502850 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.502831    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-27f74\""
Jul 09 18:45:38.503169 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.503126    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 09 18:45:38.514350 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.514326    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-28k48"]
Jul 09 18:45:38.623308 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.623277    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnnf2\" (UniqueName: \"kubernetes.io/projected/e241419c-bf50-4f0b-bf89-3f754170f508-kube-api-access-pnnf2\") pod \"cert-manager-operator-controller-manager-55c444bf86-28k48\" (UID: \"e241419c-bf50-4f0b-bf89-3f754170f508\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-28k48"
Jul 09 18:45:38.623437 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.623315    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e241419c-bf50-4f0b-bf89-3f754170f508-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-28k48\" (UID: \"e241419c-bf50-4f0b-bf89-3f754170f508\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-28k48"
Jul 09 18:45:38.724493 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.724471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e241419c-bf50-4f0b-bf89-3f754170f508-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-28k48\" (UID: \"e241419c-bf50-4f0b-bf89-3f754170f508\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-28k48"
Jul 09 18:45:38.724607 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.724529    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnnf2\" (UniqueName: \"kubernetes.io/projected/e241419c-bf50-4f0b-bf89-3f754170f508-kube-api-access-pnnf2\") pod \"cert-manager-operator-controller-manager-55c444bf86-28k48\" (UID: \"e241419c-bf50-4f0b-bf89-3f754170f508\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-28k48"
Jul 09 18:45:38.724879 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.724861    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e241419c-bf50-4f0b-bf89-3f754170f508-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-28k48\" (UID: \"e241419c-bf50-4f0b-bf89-3f754170f508\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-28k48"
Jul 09 18:45:38.735225 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.735193    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnnf2\" (UniqueName: \"kubernetes.io/projected/e241419c-bf50-4f0b-bf89-3f754170f508-kube-api-access-pnnf2\") pod \"cert-manager-operator-controller-manager-55c444bf86-28k48\" (UID: \"e241419c-bf50-4f0b-bf89-3f754170f508\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-28k48"
Jul 09 18:45:38.808227 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.808160    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-28k48"
Jul 09 18:45:38.941000 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:38.940945    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-28k48"]
Jul 09 18:45:38.944007 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:45:38.943978    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode241419c_bf50_4f0b_bf89_3f754170f508.slice/crio-5042a4ac288cb6a1d6d2e120c933df979fb302301047f460ad01c608ee0e9c18 WatchSource:0}: Error finding container 5042a4ac288cb6a1d6d2e120c933df979fb302301047f460ad01c608ee0e9c18: Status 404 returned error can't find the container with id 5042a4ac288cb6a1d6d2e120c933df979fb302301047f460ad01c608ee0e9c18
Jul 09 18:45:39.201865 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:39.201786    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-28k48" event={"ID":"e241419c-bf50-4f0b-bf89-3f754170f508","Type":"ContainerStarted","Data":"5042a4ac288cb6a1d6d2e120c933df979fb302301047f460ad01c608ee0e9c18"}
Jul 09 18:45:41.211896 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:41.211814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-28k48" event={"ID":"e241419c-bf50-4f0b-bf89-3f754170f508","Type":"ContainerStarted","Data":"2ee1b54e907754665069261d78e4e135d9924e6272ae04de41c255e16a36816b"}
Jul 09 18:45:41.235781 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:41.235739    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-28k48" podStartSLOduration=1.349130124 podStartE2EDuration="3.235724412s" totalImagesPullingTime="1.886594288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:45:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:41.234224651 +0000 UTC m=+275.595371831" watchObservedRunningTime="2026-07-09 18:45:41.235724412 +0000 UTC m=+275.596871592"
Jul 09 18:45:42.407554 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.407520    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj"]
Jul 09 18:45:42.409871 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.409856    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj"
Jul 09 18:45:42.412805 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.412776    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 18:45:42.412805 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.412787    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 18:45:42.412954 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.412784    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5pb92\""
Jul 09 18:45:42.422109 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.421936    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj"]
Jul 09 18:45:42.450648 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.450628    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkvfk\" (UniqueName: \"kubernetes.io/projected/ea9c8bee-4945-4cc3-9b62-88c345f82b95-kube-api-access-qkvfk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj\" (UID: \"ea9c8bee-4945-4cc3-9b62-88c345f82b95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj"
Jul 09 18:45:42.450764 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.450658    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea9c8bee-4945-4cc3-9b62-88c345f82b95-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj\" (UID: \"ea9c8bee-4945-4cc3-9b62-88c345f82b95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj"
Jul 09 18:45:42.450764 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.450679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea9c8bee-4945-4cc3-9b62-88c345f82b95-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj\" (UID: \"ea9c8bee-4945-4cc3-9b62-88c345f82b95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj"
Jul 09 18:45:42.551808 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.551781    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkvfk\" (UniqueName: \"kubernetes.io/projected/ea9c8bee-4945-4cc3-9b62-88c345f82b95-kube-api-access-qkvfk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj\" (UID: \"ea9c8bee-4945-4cc3-9b62-88c345f82b95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj"
Jul 09 18:45:42.551925 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.551812    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea9c8bee-4945-4cc3-9b62-88c345f82b95-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj\" (UID: \"ea9c8bee-4945-4cc3-9b62-88c345f82b95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj"
Jul 09 18:45:42.551925 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.551830    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea9c8bee-4945-4cc3-9b62-88c345f82b95-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj\" (UID: \"ea9c8bee-4945-4cc3-9b62-88c345f82b95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj"
Jul 09 18:45:42.552098 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.552082    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea9c8bee-4945-4cc3-9b62-88c345f82b95-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj\" (UID: \"ea9c8bee-4945-4cc3-9b62-88c345f82b95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj"
Jul 09 18:45:42.552225 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.552205    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea9c8bee-4945-4cc3-9b62-88c345f82b95-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj\" (UID: \"ea9c8bee-4945-4cc3-9b62-88c345f82b95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj"
Jul 09 18:45:42.563808 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.563789    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkvfk\" (UniqueName: \"kubernetes.io/projected/ea9c8bee-4945-4cc3-9b62-88c345f82b95-kube-api-access-qkvfk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj\" (UID: \"ea9c8bee-4945-4cc3-9b62-88c345f82b95\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj"
Jul 09 18:45:42.719115 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.719051    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj"
Jul 09 18:45:42.844780 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:42.844756    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj"]
Jul 09 18:45:42.846342 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:45:42.846313    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea9c8bee_4945_4cc3_9b62_88c345f82b95.slice/crio-36a651cc79fa2465a725ef265e364980434111ae36ba6101e1a9b0432bc36f48 WatchSource:0}: Error finding container 36a651cc79fa2465a725ef265e364980434111ae36ba6101e1a9b0432bc36f48: Status 404 returned error can't find the container with id 36a651cc79fa2465a725ef265e364980434111ae36ba6101e1a9b0432bc36f48
Jul 09 18:45:43.222426 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:43.222391    2562 generic.go:356] "Generic (PLEG): container finished" podID="ea9c8bee-4945-4cc3-9b62-88c345f82b95" containerID="c1c411393086896e201e731b07a795b81d26b6393ddb089131309e589a38dc5d" exitCode=0
Jul 09 18:45:43.222582 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:43.222440    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj" event={"ID":"ea9c8bee-4945-4cc3-9b62-88c345f82b95","Type":"ContainerDied","Data":"c1c411393086896e201e731b07a795b81d26b6393ddb089131309e589a38dc5d"}
Jul 09 18:45:43.222582 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:43.222475    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj" event={"ID":"ea9c8bee-4945-4cc3-9b62-88c345f82b95","Type":"ContainerStarted","Data":"36a651cc79fa2465a725ef265e364980434111ae36ba6101e1a9b0432bc36f48"}
Jul 09 18:45:45.232305 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:45.232278    2562 generic.go:356] "Generic (PLEG): container finished" podID="ea9c8bee-4945-4cc3-9b62-88c345f82b95" containerID="b3477584e4e7f72c9d46e7bb055fd6fedacff144f4d1a99fbfceff2bf040f7cb" exitCode=0
Jul 09 18:45:45.232682 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:45.232331    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj" event={"ID":"ea9c8bee-4945-4cc3-9b62-88c345f82b95","Type":"ContainerDied","Data":"b3477584e4e7f72c9d46e7bb055fd6fedacff144f4d1a99fbfceff2bf040f7cb"}
Jul 09 18:45:46.238285 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:46.238248    2562 generic.go:356] "Generic (PLEG): container finished" podID="ea9c8bee-4945-4cc3-9b62-88c345f82b95" containerID="73497c2152938d95510afa5bd2e0b14fc14a3972fe4fcf2e209dce723b34960d" exitCode=0
Jul 09 18:45:46.238704 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:46.238308    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj" event={"ID":"ea9c8bee-4945-4cc3-9b62-88c345f82b95","Type":"ContainerDied","Data":"73497c2152938d95510afa5bd2e0b14fc14a3972fe4fcf2e209dce723b34960d"}
Jul 09 18:45:47.366101 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:47.366076    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj"
Jul 09 18:45:47.488900 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:47.488871    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea9c8bee-4945-4cc3-9b62-88c345f82b95-util\") pod \"ea9c8bee-4945-4cc3-9b62-88c345f82b95\" (UID: \"ea9c8bee-4945-4cc3-9b62-88c345f82b95\") "
Jul 09 18:45:47.489060 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:47.488909    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkvfk\" (UniqueName: \"kubernetes.io/projected/ea9c8bee-4945-4cc3-9b62-88c345f82b95-kube-api-access-qkvfk\") pod \"ea9c8bee-4945-4cc3-9b62-88c345f82b95\" (UID: \"ea9c8bee-4945-4cc3-9b62-88c345f82b95\") "
Jul 09 18:45:47.489060 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:47.488946    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea9c8bee-4945-4cc3-9b62-88c345f82b95-bundle\") pod \"ea9c8bee-4945-4cc3-9b62-88c345f82b95\" (UID: \"ea9c8bee-4945-4cc3-9b62-88c345f82b95\") "
Jul 09 18:45:47.489314 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:47.489284    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9c8bee-4945-4cc3-9b62-88c345f82b95-bundle" (OuterVolumeSpecName: "bundle") pod "ea9c8bee-4945-4cc3-9b62-88c345f82b95" (UID: "ea9c8bee-4945-4cc3-9b62-88c345f82b95"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:45:47.491010 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:47.490986    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea9c8bee-4945-4cc3-9b62-88c345f82b95-kube-api-access-qkvfk" (OuterVolumeSpecName: "kube-api-access-qkvfk") pod "ea9c8bee-4945-4cc3-9b62-88c345f82b95" (UID: "ea9c8bee-4945-4cc3-9b62-88c345f82b95"). InnerVolumeSpecName "kube-api-access-qkvfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:45:47.496713 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:47.496689    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea9c8bee-4945-4cc3-9b62-88c345f82b95-util" (OuterVolumeSpecName: "util") pod "ea9c8bee-4945-4cc3-9b62-88c345f82b95" (UID: "ea9c8bee-4945-4cc3-9b62-88c345f82b95"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:45:47.589941 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:47.589919    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea9c8bee-4945-4cc3-9b62-88c345f82b95-bundle\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:45:47.589941 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:47.589938    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea9c8bee-4945-4cc3-9b62-88c345f82b95-util\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:45:47.590064 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:47.589946    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkvfk\" (UniqueName: \"kubernetes.io/projected/ea9c8bee-4945-4cc3-9b62-88c345f82b95-kube-api-access-qkvfk\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:45:48.247977 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:48.247952    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj"
Jul 09 18:45:48.248101 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:48.247946    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fphfmj" event={"ID":"ea9c8bee-4945-4cc3-9b62-88c345f82b95","Type":"ContainerDied","Data":"36a651cc79fa2465a725ef265e364980434111ae36ba6101e1a9b0432bc36f48"}
Jul 09 18:45:48.248101 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:48.248072    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36a651cc79fa2465a725ef265e364980434111ae36ba6101e1a9b0432bc36f48"
Jul 09 18:45:52.125227 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.125191    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4fhhs"]
Jul 09 18:45:52.125680 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.125526    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea9c8bee-4945-4cc3-9b62-88c345f82b95" containerName="pull"
Jul 09 18:45:52.125680 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.125545    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea9c8bee-4945-4cc3-9b62-88c345f82b95" containerName="pull"
Jul 09 18:45:52.125680 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.125565    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea9c8bee-4945-4cc3-9b62-88c345f82b95" containerName="util"
Jul 09 18:45:52.125680 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.125575    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea9c8bee-4945-4cc3-9b62-88c345f82b95" containerName="util"
Jul 09 18:45:52.125680 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.125585    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea9c8bee-4945-4cc3-9b62-88c345f82b95" containerName="extract"
Jul 09 18:45:52.125680 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.125593    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea9c8bee-4945-4cc3-9b62-88c345f82b95" containerName="extract"
Jul 09 18:45:52.125680 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.125668    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea9c8bee-4945-4cc3-9b62-88c345f82b95" containerName="extract"
Jul 09 18:45:52.127517 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.127495    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4fhhs"
Jul 09 18:45:52.130425 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.130403    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mbnc7\""
Jul 09 18:45:52.130783 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.130765    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 18:45:52.131864 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.131848    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 18:45:52.139243 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.139225    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4fhhs"]
Jul 09 18:45:52.220936 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.220906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f48a316-52b6-42e8-9275-7279a48b0059-bound-sa-token\") pod \"cert-manager-55b4d954d5-4fhhs\" (UID: \"4f48a316-52b6-42e8-9275-7279a48b0059\") " pod="cert-manager/cert-manager-55b4d954d5-4fhhs"
Jul 09 18:45:52.221064 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.220947    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl9dk\" (UniqueName: \"kubernetes.io/projected/4f48a316-52b6-42e8-9275-7279a48b0059-kube-api-access-tl9dk\") pod \"cert-manager-55b4d954d5-4fhhs\" (UID: \"4f48a316-52b6-42e8-9275-7279a48b0059\") " pod="cert-manager/cert-manager-55b4d954d5-4fhhs"
Jul 09 18:45:52.321416 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.321389    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f48a316-52b6-42e8-9275-7279a48b0059-bound-sa-token\") pod \"cert-manager-55b4d954d5-4fhhs\" (UID: \"4f48a316-52b6-42e8-9275-7279a48b0059\") " pod="cert-manager/cert-manager-55b4d954d5-4fhhs"
Jul 09 18:45:52.321537 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.321426    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl9dk\" (UniqueName: \"kubernetes.io/projected/4f48a316-52b6-42e8-9275-7279a48b0059-kube-api-access-tl9dk\") pod \"cert-manager-55b4d954d5-4fhhs\" (UID: \"4f48a316-52b6-42e8-9275-7279a48b0059\") " pod="cert-manager/cert-manager-55b4d954d5-4fhhs"
Jul 09 18:45:52.332155 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.332108    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4f48a316-52b6-42e8-9275-7279a48b0059-bound-sa-token\") pod \"cert-manager-55b4d954d5-4fhhs\" (UID: \"4f48a316-52b6-42e8-9275-7279a48b0059\") " pod="cert-manager/cert-manager-55b4d954d5-4fhhs"
Jul 09 18:45:52.332300 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.332282    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl9dk\" (UniqueName: \"kubernetes.io/projected/4f48a316-52b6-42e8-9275-7279a48b0059-kube-api-access-tl9dk\") pod \"cert-manager-55b4d954d5-4fhhs\" (UID: \"4f48a316-52b6-42e8-9275-7279a48b0059\") " pod="cert-manager/cert-manager-55b4d954d5-4fhhs"
Jul 09 18:45:52.436620 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.436559    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-4fhhs"
Jul 09 18:45:52.563868 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:52.563845    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-4fhhs"]
Jul 09 18:45:52.566067 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:45:52.566040    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f48a316_52b6_42e8_9275_7279a48b0059.slice/crio-358ec0714ed96a41bd610ad7fdc475c54a2e40164afdc2f445fb50f5fb9922c3 WatchSource:0}: Error finding container 358ec0714ed96a41bd610ad7fdc475c54a2e40164afdc2f445fb50f5fb9922c3: Status 404 returned error can't find the container with id 358ec0714ed96a41bd610ad7fdc475c54a2e40164afdc2f445fb50f5fb9922c3
Jul 09 18:45:53.267941 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:53.267895    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4fhhs" event={"ID":"4f48a316-52b6-42e8-9275-7279a48b0059","Type":"ContainerStarted","Data":"358ec0714ed96a41bd610ad7fdc475c54a2e40164afdc2f445fb50f5fb9922c3"}
Jul 09 18:45:55.277979 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:55.277942    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-4fhhs" event={"ID":"4f48a316-52b6-42e8-9275-7279a48b0059","Type":"ContainerStarted","Data":"5b4ced9055a31e9001a6e35acfdce196b96f2c50da73d9a5a05da30b9bed3a18"}
Jul 09 18:45:55.295923 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:45:55.295869    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-4fhhs" podStartSLOduration=0.779102657 podStartE2EDuration="3.295852166s" totalImagesPullingTime="2.516749509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:45:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:45:55.29485395 +0000 UTC m=+289.656001133" watchObservedRunningTime="2026-07-09 18:45:55.295852166 +0000 UTC m=+289.656999346"
Jul 09 18:46:02.818032 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:02.817991    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq"]
Jul 09 18:46:02.820302 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:02.820286    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq"
Jul 09 18:46:02.823045 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:02.823018    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 18:46:02.823175 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:02.823094    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 18:46:02.823175 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:02.823098    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5pb92\""
Jul 09 18:46:02.831311 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:02.831290    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq"]
Jul 09 18:46:02.897526 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:02.897500    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acd0bb76-71d6-496f-9739-97e886fdfe74-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq\" (UID: \"acd0bb76-71d6-496f-9739-97e886fdfe74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq"
Jul 09 18:46:02.897638 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:02.897541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acd0bb76-71d6-496f-9739-97e886fdfe74-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq\" (UID: \"acd0bb76-71d6-496f-9739-97e886fdfe74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq"
Jul 09 18:46:02.897638 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:02.897576    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcqhw\" (UniqueName: \"kubernetes.io/projected/acd0bb76-71d6-496f-9739-97e886fdfe74-kube-api-access-mcqhw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq\" (UID: \"acd0bb76-71d6-496f-9739-97e886fdfe74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq"
Jul 09 18:46:02.998096 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:02.998066    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcqhw\" (UniqueName: \"kubernetes.io/projected/acd0bb76-71d6-496f-9739-97e886fdfe74-kube-api-access-mcqhw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq\" (UID: \"acd0bb76-71d6-496f-9739-97e886fdfe74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq"
Jul 09 18:46:02.998229 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:02.998108    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acd0bb76-71d6-496f-9739-97e886fdfe74-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq\" (UID: \"acd0bb76-71d6-496f-9739-97e886fdfe74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq"
Jul 09 18:46:02.998229 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:02.998172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acd0bb76-71d6-496f-9739-97e886fdfe74-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq\" (UID: \"acd0bb76-71d6-496f-9739-97e886fdfe74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq"
Jul 09 18:46:02.998565 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:02.998545    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acd0bb76-71d6-496f-9739-97e886fdfe74-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq\" (UID: \"acd0bb76-71d6-496f-9739-97e886fdfe74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq"
Jul 09 18:46:02.998565 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:02.998558    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acd0bb76-71d6-496f-9739-97e886fdfe74-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq\" (UID: \"acd0bb76-71d6-496f-9739-97e886fdfe74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq"
Jul 09 18:46:03.008550 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:03.008525    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcqhw\" (UniqueName: \"kubernetes.io/projected/acd0bb76-71d6-496f-9739-97e886fdfe74-kube-api-access-mcqhw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq\" (UID: \"acd0bb76-71d6-496f-9739-97e886fdfe74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq"
Jul 09 18:46:03.129357 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:03.129282    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq"
Jul 09 18:46:03.274073 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:03.274046    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq"]
Jul 09 18:46:03.277042 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:46:03.277015    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd0bb76_71d6_496f_9739_97e886fdfe74.slice/crio-42794a1906f08c6f0335764ad1f4baee106ac9723c416146d4702804797e464d WatchSource:0}: Error finding container 42794a1906f08c6f0335764ad1f4baee106ac9723c416146d4702804797e464d: Status 404 returned error can't find the container with id 42794a1906f08c6f0335764ad1f4baee106ac9723c416146d4702804797e464d
Jul 09 18:46:03.313575 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:03.313540    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq" event={"ID":"acd0bb76-71d6-496f-9739-97e886fdfe74","Type":"ContainerStarted","Data":"42794a1906f08c6f0335764ad1f4baee106ac9723c416146d4702804797e464d"}
Jul 09 18:46:04.318811 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:04.318726    2562 generic.go:356] "Generic (PLEG): container finished" podID="acd0bb76-71d6-496f-9739-97e886fdfe74" containerID="231e485f0fc3da19bd77a45475d5916e3a124fc2fd6cf63804de67e678117842" exitCode=0
Jul 09 18:46:04.318811 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:04.318802    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq" event={"ID":"acd0bb76-71d6-496f-9739-97e886fdfe74","Type":"ContainerDied","Data":"231e485f0fc3da19bd77a45475d5916e3a124fc2fd6cf63804de67e678117842"}
Jul 09 18:46:06.062658 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:06.062626    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 18:46:06.063128 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:06.062953    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 18:46:06.069630 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:06.069612    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 18:46:06.327900 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:06.327828    2562 generic.go:356] "Generic (PLEG): container finished" podID="acd0bb76-71d6-496f-9739-97e886fdfe74" containerID="90df98a97a5ca7c245b5185a322268ae54f8b1e20aafb225b20103e9fad3b929" exitCode=0
Jul 09 18:46:06.327900 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:06.327896    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq" event={"ID":"acd0bb76-71d6-496f-9739-97e886fdfe74","Type":"ContainerDied","Data":"90df98a97a5ca7c245b5185a322268ae54f8b1e20aafb225b20103e9fad3b929"}
Jul 09 18:46:07.334189 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:07.334131    2562 generic.go:356] "Generic (PLEG): container finished" podID="acd0bb76-71d6-496f-9739-97e886fdfe74" containerID="c5063b01949665d276325f5ff31d4a4d7b455fa35b9289e3f912eb0e8ea8c126" exitCode=0
Jul 09 18:46:07.334564 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:07.334195    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq" event={"ID":"acd0bb76-71d6-496f-9739-97e886fdfe74","Type":"ContainerDied","Data":"c5063b01949665d276325f5ff31d4a4d7b455fa35b9289e3f912eb0e8ea8c126"}
Jul 09 18:46:08.459016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:08.458993    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq"
Jul 09 18:46:08.537080 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:08.537054    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acd0bb76-71d6-496f-9739-97e886fdfe74-util\") pod \"acd0bb76-71d6-496f-9739-97e886fdfe74\" (UID: \"acd0bb76-71d6-496f-9739-97e886fdfe74\") "
Jul 09 18:46:08.537212 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:08.537092    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acd0bb76-71d6-496f-9739-97e886fdfe74-bundle\") pod \"acd0bb76-71d6-496f-9739-97e886fdfe74\" (UID: \"acd0bb76-71d6-496f-9739-97e886fdfe74\") "
Jul 09 18:46:08.537212 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:08.537122    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcqhw\" (UniqueName: \"kubernetes.io/projected/acd0bb76-71d6-496f-9739-97e886fdfe74-kube-api-access-mcqhw\") pod \"acd0bb76-71d6-496f-9739-97e886fdfe74\" (UID: \"acd0bb76-71d6-496f-9739-97e886fdfe74\") "
Jul 09 18:46:08.537745 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:08.537712    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd0bb76-71d6-496f-9739-97e886fdfe74-bundle" (OuterVolumeSpecName: "bundle") pod "acd0bb76-71d6-496f-9739-97e886fdfe74" (UID: "acd0bb76-71d6-496f-9739-97e886fdfe74"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:46:08.539324 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:08.539298    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acd0bb76-71d6-496f-9739-97e886fdfe74-kube-api-access-mcqhw" (OuterVolumeSpecName: "kube-api-access-mcqhw") pod "acd0bb76-71d6-496f-9739-97e886fdfe74" (UID: "acd0bb76-71d6-496f-9739-97e886fdfe74"). InnerVolumeSpecName "kube-api-access-mcqhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:46:08.542757 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:08.542732    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd0bb76-71d6-496f-9739-97e886fdfe74-util" (OuterVolumeSpecName: "util") pod "acd0bb76-71d6-496f-9739-97e886fdfe74" (UID: "acd0bb76-71d6-496f-9739-97e886fdfe74"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:46:08.638026 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:08.637941    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcqhw\" (UniqueName: \"kubernetes.io/projected/acd0bb76-71d6-496f-9739-97e886fdfe74-kube-api-access-mcqhw\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:46:08.638026 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:08.637989    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/acd0bb76-71d6-496f-9739-97e886fdfe74-util\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:46:08.638026 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:08.638004    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/acd0bb76-71d6-496f-9739-97e886fdfe74-bundle\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:46:09.344013 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:09.343987    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq"
Jul 09 18:46:09.344199 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:09.343987    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7czfq" event={"ID":"acd0bb76-71d6-496f-9739-97e886fdfe74","Type":"ContainerDied","Data":"42794a1906f08c6f0335764ad1f4baee106ac9723c416146d4702804797e464d"}
Jul 09 18:46:09.344199 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:09.344109    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42794a1906f08c6f0335764ad1f4baee106ac9723c416146d4702804797e464d"
Jul 09 18:46:20.902940 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:20.902909    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"]
Jul 09 18:46:20.903349 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:20.903220    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acd0bb76-71d6-496f-9739-97e886fdfe74" containerName="extract"
Jul 09 18:46:20.903349 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:20.903232    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="acd0bb76-71d6-496f-9739-97e886fdfe74" containerName="extract"
Jul 09 18:46:20.903349 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:20.903253    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acd0bb76-71d6-496f-9739-97e886fdfe74" containerName="pull"
Jul 09 18:46:20.903349 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:20.903258    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="acd0bb76-71d6-496f-9739-97e886fdfe74" containerName="pull"
Jul 09 18:46:20.903349 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:20.903268    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acd0bb76-71d6-496f-9739-97e886fdfe74" containerName="util"
Jul 09 18:46:20.903349 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:20.903273    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="acd0bb76-71d6-496f-9739-97e886fdfe74" containerName="util"
Jul 09 18:46:20.903349 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:20.903342    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="acd0bb76-71d6-496f-9739-97e886fdfe74" containerName="extract"
Jul 09 18:46:20.910880 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:20.910859    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:20.913719 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:20.913692    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 18:46:20.913952 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:20.913937    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-st4z8\""
Jul 09 18:46:20.914036 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:20.914015    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 18:46:20.914220 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:20.914202    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 18:46:20.914305 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:20.914277    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 18:46:20.923179 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:20.923128    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"]
Jul 09 18:46:21.028752 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.028711    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c5cc68d5-7e0c-462f-ad82-32482f62b2a9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-nmvjq\" (UID: \"c5cc68d5-7e0c-462f-ad82-32482f62b2a9\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:21.028752 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.028750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5cc68d5-7e0c-462f-ad82-32482f62b2a9-tmp\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-nmvjq\" (UID: \"c5cc68d5-7e0c-462f-ad82-32482f62b2a9\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:21.029002 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.028779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cm57\" (UniqueName: \"kubernetes.io/projected/c5cc68d5-7e0c-462f-ad82-32482f62b2a9-kube-api-access-2cm57\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-nmvjq\" (UID: \"c5cc68d5-7e0c-462f-ad82-32482f62b2a9\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:21.029002 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.028887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c5cc68d5-7e0c-462f-ad82-32482f62b2a9-manifests\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-nmvjq\" (UID: \"c5cc68d5-7e0c-462f-ad82-32482f62b2a9\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:21.029002 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.028923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5cc68d5-7e0c-462f-ad82-32482f62b2a9-webhook-cert\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-nmvjq\" (UID: \"c5cc68d5-7e0c-462f-ad82-32482f62b2a9\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:21.130045 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.130008    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c5cc68d5-7e0c-462f-ad82-32482f62b2a9-manifests\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-nmvjq\" (UID: \"c5cc68d5-7e0c-462f-ad82-32482f62b2a9\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:21.130045 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.130048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5cc68d5-7e0c-462f-ad82-32482f62b2a9-webhook-cert\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-nmvjq\" (UID: \"c5cc68d5-7e0c-462f-ad82-32482f62b2a9\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:21.130322 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.130073    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c5cc68d5-7e0c-462f-ad82-32482f62b2a9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-nmvjq\" (UID: \"c5cc68d5-7e0c-462f-ad82-32482f62b2a9\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:21.130322 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.130088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5cc68d5-7e0c-462f-ad82-32482f62b2a9-tmp\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-nmvjq\" (UID: \"c5cc68d5-7e0c-462f-ad82-32482f62b2a9\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:21.130322 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.130117    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cm57\" (UniqueName: \"kubernetes.io/projected/c5cc68d5-7e0c-462f-ad82-32482f62b2a9-kube-api-access-2cm57\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-nmvjq\" (UID: \"c5cc68d5-7e0c-462f-ad82-32482f62b2a9\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:21.130544 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.130520    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c5cc68d5-7e0c-462f-ad82-32482f62b2a9-manifests\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-nmvjq\" (UID: \"c5cc68d5-7e0c-462f-ad82-32482f62b2a9\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:21.132548 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.132521    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5cc68d5-7e0c-462f-ad82-32482f62b2a9-tmp\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-nmvjq\" (UID: \"c5cc68d5-7e0c-462f-ad82-32482f62b2a9\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:21.132890 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.132867    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5cc68d5-7e0c-462f-ad82-32482f62b2a9-webhook-cert\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-nmvjq\" (UID: \"c5cc68d5-7e0c-462f-ad82-32482f62b2a9\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:21.132934 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.132890    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c5cc68d5-7e0c-462f-ad82-32482f62b2a9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-nmvjq\" (UID: \"c5cc68d5-7e0c-462f-ad82-32482f62b2a9\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:21.142672 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.142650    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cm57\" (UniqueName: \"kubernetes.io/projected/c5cc68d5-7e0c-462f-ad82-32482f62b2a9-kube-api-access-2cm57\") pod \"opendatahub-operator-controller-manager-fbd77dc5f-nmvjq\" (UID: \"c5cc68d5-7e0c-462f-ad82-32482f62b2a9\") " pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:21.221836 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.221745    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:21.380427 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.380400    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"]
Jul 09 18:46:21.383136 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:46:21.383102    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5cc68d5_7e0c_462f_ad82_32482f62b2a9.slice/crio-fe2b9d4fc8f58df7f9ad01e631770e9b5110521fcd3e1c0f5106ea7e2b0ecd65 WatchSource:0}: Error finding container fe2b9d4fc8f58df7f9ad01e631770e9b5110521fcd3e1c0f5106ea7e2b0ecd65: Status 404 returned error can't find the container with id fe2b9d4fc8f58df7f9ad01e631770e9b5110521fcd3e1c0f5106ea7e2b0ecd65
Jul 09 18:46:21.384944 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.384926    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:46:21.391264 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:21.391234    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq" event={"ID":"c5cc68d5-7e0c-462f-ad82-32482f62b2a9","Type":"ContainerStarted","Data":"fe2b9d4fc8f58df7f9ad01e631770e9b5110521fcd3e1c0f5106ea7e2b0ecd65"}
Jul 09 18:46:25.411083 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:25.411052    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq" event={"ID":"c5cc68d5-7e0c-462f-ad82-32482f62b2a9","Type":"ContainerStarted","Data":"1390bd3422a45813904f6c4244095d807546b6c6d776b4898750a9b235765f91"}
Jul 09 18:46:26.416734 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:26.416699    2562 generic.go:356] "Generic (PLEG): container finished" podID="c5cc68d5-7e0c-462f-ad82-32482f62b2a9" containerID="1390bd3422a45813904f6c4244095d807546b6c6d776b4898750a9b235765f91" exitCode=0
Jul 09 18:46:26.417101 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:26.416778    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq" event={"ID":"c5cc68d5-7e0c-462f-ad82-32482f62b2a9","Type":"ContainerDied","Data":"1390bd3422a45813904f6c4244095d807546b6c6d776b4898750a9b235765f91"}
Jul 09 18:46:27.422435 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:27.422395    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq" event={"ID":"c5cc68d5-7e0c-462f-ad82-32482f62b2a9","Type":"ContainerStarted","Data":"35a28586b8bddaee8df061af27ee5d76353d545e3bc0918a34f50b47887b21b8"}
Jul 09 18:46:27.422880 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:27.422542    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:38.428243 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:38.428215    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq"
Jul 09 18:46:38.453514 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:38.453465    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-fbd77dc5f-nmvjq" podStartSLOduration=14.081331005 podStartE2EDuration="18.453450497s" totalImagesPullingTime="3.321070229s" totalInitContainerRuntime="1.051049263s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:27.469466815 +0000 UTC m=+321.830613995" watchObservedRunningTime="2026-07-09 18:46:38.453450497 +0000 UTC m=+332.814597677"
Jul 09 18:46:41.116089 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:41.116056    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jg66j"]
Jul 09 18:46:41.123263 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:41.123241    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jg66j"
Jul 09 18:46:41.126041 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:41.126021    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wnrsh\""
Jul 09 18:46:41.126168 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:41.126028    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 09 18:46:41.132288 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:41.132264    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jg66j"]
Jul 09 18:46:41.273074 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:41.273043    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlnjb\" (UniqueName: \"kubernetes.io/projected/97abeaaa-d4cc-46c9-96d3-76ae5b72a3de-kube-api-access-zlnjb\") pod \"odh-model-controller-7998c67dc4-jg66j\" (UID: \"97abeaaa-d4cc-46c9-96d3-76ae5b72a3de\") " pod="opendatahub/odh-model-controller-7998c67dc4-jg66j"
Jul 09 18:46:41.273259 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:41.273124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97abeaaa-d4cc-46c9-96d3-76ae5b72a3de-cert\") pod \"odh-model-controller-7998c67dc4-jg66j\" (UID: \"97abeaaa-d4cc-46c9-96d3-76ae5b72a3de\") " pod="opendatahub/odh-model-controller-7998c67dc4-jg66j"
Jul 09 18:46:41.374206 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:41.374122    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlnjb\" (UniqueName: \"kubernetes.io/projected/97abeaaa-d4cc-46c9-96d3-76ae5b72a3de-kube-api-access-zlnjb\") pod \"odh-model-controller-7998c67dc4-jg66j\" (UID: \"97abeaaa-d4cc-46c9-96d3-76ae5b72a3de\") " pod="opendatahub/odh-model-controller-7998c67dc4-jg66j"
Jul 09 18:46:41.374359 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:41.374225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97abeaaa-d4cc-46c9-96d3-76ae5b72a3de-cert\") pod \"odh-model-controller-7998c67dc4-jg66j\" (UID: \"97abeaaa-d4cc-46c9-96d3-76ae5b72a3de\") " pod="opendatahub/odh-model-controller-7998c67dc4-jg66j"
Jul 09 18:46:41.374359 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:46:41.374339    2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 09 18:46:41.374473 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:46:41.374405    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97abeaaa-d4cc-46c9-96d3-76ae5b72a3de-cert podName:97abeaaa-d4cc-46c9-96d3-76ae5b72a3de nodeName:}" failed. No retries permitted until 2026-07-09 18:46:41.87438378 +0000 UTC m=+336.235530955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97abeaaa-d4cc-46c9-96d3-76ae5b72a3de-cert") pod "odh-model-controller-7998c67dc4-jg66j" (UID: "97abeaaa-d4cc-46c9-96d3-76ae5b72a3de") : secret "odh-model-controller-webhook-cert" not found
Jul 09 18:46:41.384708 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:41.384680    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlnjb\" (UniqueName: \"kubernetes.io/projected/97abeaaa-d4cc-46c9-96d3-76ae5b72a3de-kube-api-access-zlnjb\") pod \"odh-model-controller-7998c67dc4-jg66j\" (UID: \"97abeaaa-d4cc-46c9-96d3-76ae5b72a3de\") " pod="opendatahub/odh-model-controller-7998c67dc4-jg66j"
Jul 09 18:46:41.879560 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:41.879526    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97abeaaa-d4cc-46c9-96d3-76ae5b72a3de-cert\") pod \"odh-model-controller-7998c67dc4-jg66j\" (UID: \"97abeaaa-d4cc-46c9-96d3-76ae5b72a3de\") " pod="opendatahub/odh-model-controller-7998c67dc4-jg66j"
Jul 09 18:46:41.881925 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:41.881899    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97abeaaa-d4cc-46c9-96d3-76ae5b72a3de-cert\") pod \"odh-model-controller-7998c67dc4-jg66j\" (UID: \"97abeaaa-d4cc-46c9-96d3-76ae5b72a3de\") " pod="opendatahub/odh-model-controller-7998c67dc4-jg66j"
Jul 09 18:46:42.033599 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:42.033564    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jg66j"
Jul 09 18:46:42.171668 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:42.171648    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jg66j"]
Jul 09 18:46:42.174028 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:46:42.174004    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97abeaaa_d4cc_46c9_96d3_76ae5b72a3de.slice/crio-9d218b05c16036bc20e64b144afa8c95e69d8a3d2f56dddf5530585a89291c7f WatchSource:0}: Error finding container 9d218b05c16036bc20e64b144afa8c95e69d8a3d2f56dddf5530585a89291c7f: Status 404 returned error can't find the container with id 9d218b05c16036bc20e64b144afa8c95e69d8a3d2f56dddf5530585a89291c7f
Jul 09 18:46:42.485852 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:42.485770    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jg66j" event={"ID":"97abeaaa-d4cc-46c9-96d3-76ae5b72a3de","Type":"ContainerStarted","Data":"9d218b05c16036bc20e64b144afa8c95e69d8a3d2f56dddf5530585a89291c7f"}
Jul 09 18:46:45.503290 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:45.503250    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jg66j" event={"ID":"97abeaaa-d4cc-46c9-96d3-76ae5b72a3de","Type":"ContainerStarted","Data":"53e1d3275aad02e2ffc616fe2f2c0ff851052c250bf218464e3ba15710eb7280"}
Jul 09 18:46:45.503704 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:45.503430    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-jg66j"
Jul 09 18:46:45.522780 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:45.522735    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-jg66j" podStartSLOduration=1.541540097 podStartE2EDuration="4.522720441s" totalImagesPullingTime="2.981180344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:45.52151112 +0000 UTC m=+339.882658299" watchObservedRunningTime="2026-07-09 18:46:45.522720441 +0000 UTC m=+339.883867620"
Jul 09 18:46:51.662631 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.662603    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-74785d646-vbb6l"]
Jul 09 18:46:51.665381 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.665364    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74785d646-vbb6l"
Jul 09 18:46:51.668969 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.668911    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 18:46:51.670122 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.670085    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 18:46:51.670122 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.670111    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 18:46:51.670319 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.670206    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-t66rk\""
Jul 09 18:46:51.670377 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.670348    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 18:46:51.681219 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.681195    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74785d646-vbb6l"]
Jul 09 18:46:51.746264 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.746238    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8c8745-aacd-445d-9863-47221b2a35fd-tls-certs\") pod \"kube-auth-proxy-74785d646-vbb6l\" (UID: \"6a8c8745-aacd-445d-9863-47221b2a35fd\") " pod="openshift-ingress/kube-auth-proxy-74785d646-vbb6l"
Jul 09 18:46:51.746264 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.746267    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a8c8745-aacd-445d-9863-47221b2a35fd-tmp\") pod \"kube-auth-proxy-74785d646-vbb6l\" (UID: \"6a8c8745-aacd-445d-9863-47221b2a35fd\") " pod="openshift-ingress/kube-auth-proxy-74785d646-vbb6l"
Jul 09 18:46:51.746460 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.746294    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb7dz\" (UniqueName: \"kubernetes.io/projected/6a8c8745-aacd-445d-9863-47221b2a35fd-kube-api-access-fb7dz\") pod \"kube-auth-proxy-74785d646-vbb6l\" (UID: \"6a8c8745-aacd-445d-9863-47221b2a35fd\") " pod="openshift-ingress/kube-auth-proxy-74785d646-vbb6l"
Jul 09 18:46:51.770435 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.770412    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7r547"]
Jul 09 18:46:51.773540 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.773526    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7r547"
Jul 09 18:46:51.776773 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.776758    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-2c24b\""
Jul 09 18:46:51.777233 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.777219    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 09 18:46:51.783038 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.783018    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gbv8b"]
Jul 09 18:46:51.785924 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.785909    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbv8b"
Jul 09 18:46:51.789477 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.789457    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7r547"]
Jul 09 18:46:51.790089 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.790071    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-zcnrg\""
Jul 09 18:46:51.791128 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.791111    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 09 18:46:51.801054 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.801035    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gbv8b"]
Jul 09 18:46:51.847719 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.847691    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8c8745-aacd-445d-9863-47221b2a35fd-tls-certs\") pod \"kube-auth-proxy-74785d646-vbb6l\" (UID: \"6a8c8745-aacd-445d-9863-47221b2a35fd\") " pod="openshift-ingress/kube-auth-proxy-74785d646-vbb6l"
Jul 09 18:46:51.847836 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.847723    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a8c8745-aacd-445d-9863-47221b2a35fd-tmp\") pod \"kube-auth-proxy-74785d646-vbb6l\" (UID: \"6a8c8745-aacd-445d-9863-47221b2a35fd\") " pod="openshift-ingress/kube-auth-proxy-74785d646-vbb6l"
Jul 09 18:46:51.847836 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.847759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb7dz\" (UniqueName: \"kubernetes.io/projected/6a8c8745-aacd-445d-9863-47221b2a35fd-kube-api-access-fb7dz\") pod \"kube-auth-proxy-74785d646-vbb6l\" (UID: \"6a8c8745-aacd-445d-9863-47221b2a35fd\") " pod="openshift-ingress/kube-auth-proxy-74785d646-vbb6l"
Jul 09 18:46:51.847836 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.847794    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwfb7\" (UniqueName: \"kubernetes.io/projected/29cc67ca-be89-4bca-92bd-b7c56da729e5-kube-api-access-vwfb7\") pod \"llmisvc-controller-manager-777c6bd7d5-gbv8b\" (UID: \"29cc67ca-be89-4bca-92bd-b7c56da729e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbv8b"
Jul 09 18:46:51.847836 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.847826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc86467c-2b93-41bd-bc91-c4aa34391ad8-cert\") pod \"kserve-controller-manager-d6f4b65b8-7r547\" (UID: \"cc86467c-2b93-41bd-bc91-c4aa34391ad8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7r547"
Jul 09 18:46:51.848008 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.847867    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29cc67ca-be89-4bca-92bd-b7c56da729e5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gbv8b\" (UID: \"29cc67ca-be89-4bca-92bd-b7c56da729e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbv8b"
Jul 09 18:46:51.848008 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.847914    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnhkl\" (UniqueName: \"kubernetes.io/projected/cc86467c-2b93-41bd-bc91-c4aa34391ad8-kube-api-access-lnhkl\") pod \"kserve-controller-manager-d6f4b65b8-7r547\" (UID: \"cc86467c-2b93-41bd-bc91-c4aa34391ad8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7r547"
Jul 09 18:46:51.849965 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.849942    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a8c8745-aacd-445d-9863-47221b2a35fd-tmp\") pod \"kube-auth-proxy-74785d646-vbb6l\" (UID: \"6a8c8745-aacd-445d-9863-47221b2a35fd\") " pod="openshift-ingress/kube-auth-proxy-74785d646-vbb6l"
Jul 09 18:46:51.850192 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.850173    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a8c8745-aacd-445d-9863-47221b2a35fd-tls-certs\") pod \"kube-auth-proxy-74785d646-vbb6l\" (UID: \"6a8c8745-aacd-445d-9863-47221b2a35fd\") " pod="openshift-ingress/kube-auth-proxy-74785d646-vbb6l"
Jul 09 18:46:51.858862 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.858841    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb7dz\" (UniqueName: \"kubernetes.io/projected/6a8c8745-aacd-445d-9863-47221b2a35fd-kube-api-access-fb7dz\") pod \"kube-auth-proxy-74785d646-vbb6l\" (UID: \"6a8c8745-aacd-445d-9863-47221b2a35fd\") " pod="openshift-ingress/kube-auth-proxy-74785d646-vbb6l"
Jul 09 18:46:51.949238 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.949124    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwfb7\" (UniqueName: \"kubernetes.io/projected/29cc67ca-be89-4bca-92bd-b7c56da729e5-kube-api-access-vwfb7\") pod \"llmisvc-controller-manager-777c6bd7d5-gbv8b\" (UID: \"29cc67ca-be89-4bca-92bd-b7c56da729e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbv8b"
Jul 09 18:46:51.949238 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.949187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc86467c-2b93-41bd-bc91-c4aa34391ad8-cert\") pod \"kserve-controller-manager-d6f4b65b8-7r547\" (UID: \"cc86467c-2b93-41bd-bc91-c4aa34391ad8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7r547"
Jul 09 18:46:51.949438 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.949241    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29cc67ca-be89-4bca-92bd-b7c56da729e5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gbv8b\" (UID: \"29cc67ca-be89-4bca-92bd-b7c56da729e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbv8b"
Jul 09 18:46:51.949438 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.949271    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnhkl\" (UniqueName: \"kubernetes.io/projected/cc86467c-2b93-41bd-bc91-c4aa34391ad8-kube-api-access-lnhkl\") pod \"kserve-controller-manager-d6f4b65b8-7r547\" (UID: \"cc86467c-2b93-41bd-bc91-c4aa34391ad8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7r547"
Jul 09 18:46:51.949438 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:46:51.949341    2562 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 09 18:46:51.949438 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:46:51.949416    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc86467c-2b93-41bd-bc91-c4aa34391ad8-cert podName:cc86467c-2b93-41bd-bc91-c4aa34391ad8 nodeName:}" failed. No retries permitted until 2026-07-09 18:46:52.449395396 +0000 UTC m=+346.810542568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cc86467c-2b93-41bd-bc91-c4aa34391ad8-cert") pod "kserve-controller-manager-d6f4b65b8-7r547" (UID: "cc86467c-2b93-41bd-bc91-c4aa34391ad8") : secret "kserve-webhook-server-cert" not found
Jul 09 18:46:51.951754 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.951725    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29cc67ca-be89-4bca-92bd-b7c56da729e5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-gbv8b\" (UID: \"29cc67ca-be89-4bca-92bd-b7c56da729e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbv8b"
Jul 09 18:46:51.961734 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.961713    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwfb7\" (UniqueName: \"kubernetes.io/projected/29cc67ca-be89-4bca-92bd-b7c56da729e5-kube-api-access-vwfb7\") pod \"llmisvc-controller-manager-777c6bd7d5-gbv8b\" (UID: \"29cc67ca-be89-4bca-92bd-b7c56da729e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbv8b"
Jul 09 18:46:51.962274 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.962259    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnhkl\" (UniqueName: \"kubernetes.io/projected/cc86467c-2b93-41bd-bc91-c4aa34391ad8-kube-api-access-lnhkl\") pod \"kserve-controller-manager-d6f4b65b8-7r547\" (UID: \"cc86467c-2b93-41bd-bc91-c4aa34391ad8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7r547"
Jul 09 18:46:51.976193 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:51.976172    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-74785d646-vbb6l"
Jul 09 18:46:52.095590 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:52.095562    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbv8b"
Jul 09 18:46:52.111401 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:52.111377    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-74785d646-vbb6l"]
Jul 09 18:46:52.114009 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:46:52.113987    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a8c8745_aacd_445d_9863_47221b2a35fd.slice/crio-4fedfaac0d091b57bc122ca5e0d5ce09cfdb03026350daa7b3a463e9f024e19b WatchSource:0}: Error finding container 4fedfaac0d091b57bc122ca5e0d5ce09cfdb03026350daa7b3a463e9f024e19b: Status 404 returned error can't find the container with id 4fedfaac0d091b57bc122ca5e0d5ce09cfdb03026350daa7b3a463e9f024e19b
Jul 09 18:46:52.244566 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:52.244494    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-gbv8b"]
Jul 09 18:46:52.246538 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:46:52.246510    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod29cc67ca_be89_4bca_92bd_b7c56da729e5.slice/crio-b6dab13a9ec76df442ddc11f04a0048dca936d83603f353278a7bdb17ce69e28 WatchSource:0}: Error finding container b6dab13a9ec76df442ddc11f04a0048dca936d83603f353278a7bdb17ce69e28: Status 404 returned error can't find the container with id b6dab13a9ec76df442ddc11f04a0048dca936d83603f353278a7bdb17ce69e28
Jul 09 18:46:52.452712 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:52.452689    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc86467c-2b93-41bd-bc91-c4aa34391ad8-cert\") pod \"kserve-controller-manager-d6f4b65b8-7r547\" (UID: \"cc86467c-2b93-41bd-bc91-c4aa34391ad8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7r547"
Jul 09 18:46:52.455081 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:52.455061    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc86467c-2b93-41bd-bc91-c4aa34391ad8-cert\") pod \"kserve-controller-manager-d6f4b65b8-7r547\" (UID: \"cc86467c-2b93-41bd-bc91-c4aa34391ad8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7r547"
Jul 09 18:46:52.532691 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:52.532610    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbv8b" event={"ID":"29cc67ca-be89-4bca-92bd-b7c56da729e5","Type":"ContainerStarted","Data":"b6dab13a9ec76df442ddc11f04a0048dca936d83603f353278a7bdb17ce69e28"}
Jul 09 18:46:52.533739 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:52.533717    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74785d646-vbb6l" event={"ID":"6a8c8745-aacd-445d-9863-47221b2a35fd","Type":"ContainerStarted","Data":"4fedfaac0d091b57bc122ca5e0d5ce09cfdb03026350daa7b3a463e9f024e19b"}
Jul 09 18:46:52.683571 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:52.683540    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7r547"
Jul 09 18:46:52.830303 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:52.830129    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7r547"]
Jul 09 18:46:52.832638 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:46:52.832611    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc86467c_2b93_41bd_bc91_c4aa34391ad8.slice/crio-e16bb3fe5f3e84677002bc69e96d05ae853e1955194b27479c69a740198e0de8 WatchSource:0}: Error finding container e16bb3fe5f3e84677002bc69e96d05ae853e1955194b27479c69a740198e0de8: Status 404 returned error can't find the container with id e16bb3fe5f3e84677002bc69e96d05ae853e1955194b27479c69a740198e0de8
Jul 09 18:46:53.539733 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.539687    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7r547" event={"ID":"cc86467c-2b93-41bd-bc91-c4aa34391ad8","Type":"ContainerStarted","Data":"e16bb3fe5f3e84677002bc69e96d05ae853e1955194b27479c69a740198e0de8"}
Jul 09 18:46:53.688591 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.688559    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"]
Jul 09 18:46:53.692370 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.692344    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.695582 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.695426    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 18:46:53.695713 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.695690    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 18:46:53.695768 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.695712    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 18:46:53.695768 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.695706    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 18:46:53.696323 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.696159    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pjptf\""
Jul 09 18:46:53.713922 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.713865    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"]
Jul 09 18:46:53.762407 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.762369    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d0d6a4b2-ee86-4779-841d-aea2539d7bff-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.762643 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.762417    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d0d6a4b2-ee86-4779-841d-aea2539d7bff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.762643 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.762458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0d6a4b2-ee86-4779-841d-aea2539d7bff-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.762643 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.762563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0d6a4b2-ee86-4779-841d-aea2539d7bff-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.762643 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.762595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d0d6a4b2-ee86-4779-841d-aea2539d7bff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.763002 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.762668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scb42\" (UniqueName: \"kubernetes.io/projected/d0d6a4b2-ee86-4779-841d-aea2539d7bff-kube-api-access-scb42\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.763002 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.762709    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0d6a4b2-ee86-4779-841d-aea2539d7bff-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.863978 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.863730    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0d6a4b2-ee86-4779-841d-aea2539d7bff-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.863978 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.863775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d0d6a4b2-ee86-4779-841d-aea2539d7bff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.863978 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.863810    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scb42\" (UniqueName: \"kubernetes.io/projected/d0d6a4b2-ee86-4779-841d-aea2539d7bff-kube-api-access-scb42\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.863978 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.863884    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0d6a4b2-ee86-4779-841d-aea2539d7bff-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.863978 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.863978    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d0d6a4b2-ee86-4779-841d-aea2539d7bff-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.864376 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.864006    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d0d6a4b2-ee86-4779-841d-aea2539d7bff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.864376 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.864040    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0d6a4b2-ee86-4779-841d-aea2539d7bff-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.865124 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.865094    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d0d6a4b2-ee86-4779-841d-aea2539d7bff-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.868167 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.867942    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d0d6a4b2-ee86-4779-841d-aea2539d7bff-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.868408 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.868385    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d0d6a4b2-ee86-4779-841d-aea2539d7bff-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.868764 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.868719    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0d6a4b2-ee86-4779-841d-aea2539d7bff-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.870604 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.870565    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d0d6a4b2-ee86-4779-841d-aea2539d7bff-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.878462 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.878419    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0d6a4b2-ee86-4779-841d-aea2539d7bff-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:53.878876 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:53.878818    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scb42\" (UniqueName: \"kubernetes.io/projected/d0d6a4b2-ee86-4779-841d-aea2539d7bff-kube-api-access-scb42\") pod \"istiod-openshift-gateway-94bb8fbfd-gt69d\" (UID: \"d0d6a4b2-ee86-4779-841d-aea2539d7bff\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:54.005015 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:54.004976    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:54.174312 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:54.174236    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"]
Jul 09 18:46:54.179041 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:46:54.178969    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d6a4b2_ee86_4779_841d_aea2539d7bff.slice/crio-505294d8f79df9a722b370ab081185f7ea03bdc7dc7f7dd702aaadd8bfc34ae2 WatchSource:0}: Error finding container 505294d8f79df9a722b370ab081185f7ea03bdc7dc7f7dd702aaadd8bfc34ae2: Status 404 returned error can't find the container with id 505294d8f79df9a722b370ab081185f7ea03bdc7dc7f7dd702aaadd8bfc34ae2
Jul 09 18:46:54.546340 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:54.546309    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d" event={"ID":"d0d6a4b2-ee86-4779-841d-aea2539d7bff","Type":"ContainerStarted","Data":"505294d8f79df9a722b370ab081185f7ea03bdc7dc7f7dd702aaadd8bfc34ae2"}
Jul 09 18:46:56.509942 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:56.509914    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-jg66j"
Jul 09 18:46:57.564304 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:57.564207    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-74785d646-vbb6l" event={"ID":"6a8c8745-aacd-445d-9863-47221b2a35fd","Type":"ContainerStarted","Data":"18a7cda07ba62d7d1f70827851e8301719feede403f4c36167897b4f98505b0d"}
Jul 09 18:46:57.565974 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:57.565946    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7r547" event={"ID":"cc86467c-2b93-41bd-bc91-c4aa34391ad8","Type":"ContainerStarted","Data":"0a763335278671446c4762ba72c4c8be408c40361e74eea5cf6eb2ae56441cb0"}
Jul 09 18:46:57.566115 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:57.566007    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7r547"
Jul 09 18:46:57.567530 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:57.567510    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbv8b" event={"ID":"29cc67ca-be89-4bca-92bd-b7c56da729e5","Type":"ContainerStarted","Data":"ba95d79b227e02e7f4174e36f8e4a0d6da129d03d0b1787642a25e0d681cddec"}
Jul 09 18:46:57.567682 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:57.567663    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbv8b"
Jul 09 18:46:57.587280 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:57.587212    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-74785d646-vbb6l" podStartSLOduration=2.130655732 podStartE2EDuration="6.587194633s" totalImagesPullingTime="4.456538901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:57.585558901 +0000 UTC m=+351.946706084" watchObservedRunningTime="2026-07-09 18:46:57.587194633 +0000 UTC m=+351.948341813"
Jul 09 18:46:57.608172 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:57.607994    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7r547" podStartSLOduration=2.86561608 podStartE2EDuration="6.607975499s" totalImagesPullingTime="3.742359419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:57.606722751 +0000 UTC m=+351.967869931" watchObservedRunningTime="2026-07-09 18:46:57.607975499 +0000 UTC m=+351.969122680"
Jul 09 18:46:57.630768 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:57.630722    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbv8b" podStartSLOduration=2.312414897 podStartE2EDuration="6.630709085s" totalImagesPullingTime="4.318294188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:57.628707579 +0000 UTC m=+351.989854764" watchObservedRunningTime="2026-07-09 18:46:57.630709085 +0000 UTC m=+351.991856264"
Jul 09 18:46:57.881246 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:57.881209    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 18:46:57.881329 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:57.881278    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 18:46:58.573864 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:58.573820    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d" event={"ID":"d0d6a4b2-ee86-4779-841d-aea2539d7bff","Type":"ContainerStarted","Data":"7016f9bf54ab385d3c09cb53fdbc249755405d1bae9d820ca37aa01a6c9786fa"}
Jul 09 18:46:58.574347 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:58.574328    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:46:58.575636 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:58.575599    2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-gt69d container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 18:46:58.575722 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:58.575659    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d" podUID="d0d6a4b2-ee86-4779-841d-aea2539d7bff" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 18:46:58.599911 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:58.599860    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d" podStartSLOduration=1.900110358 podStartE2EDuration="5.599840724s" totalImagesPullingTime="3.699730366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:46:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:46:58.597463712 +0000 UTC m=+352.958610893" watchObservedRunningTime="2026-07-09 18:46:58.599840724 +0000 UTC m=+352.960987905"
Jul 09 18:46:59.579913 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:46:59.579885    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gt69d"
Jul 09 18:47:28.575818 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:28.575786    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-gbv8b"
Jul 09 18:47:28.578811 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:28.578788    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7r547"
Jul 09 18:47:57.332353 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.332320    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62"]
Jul 09 18:47:57.337349 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.337332    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62"
Jul 09 18:47:57.341904 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.341872    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9wdsc\""
Jul 09 18:47:57.341904 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.341900    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 18:47:57.342869 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.342849    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 18:47:57.354525 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.354488    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62"]
Jul 09 18:47:57.370074 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.370047    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26d8c542-1981-4013-89eb-c287c6aeba73-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62\" (UID: \"26d8c542-1981-4013-89eb-c287c6aeba73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62"
Jul 09 18:47:57.370201 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.370111    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctwjh\" (UniqueName: \"kubernetes.io/projected/26d8c542-1981-4013-89eb-c287c6aeba73-kube-api-access-ctwjh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62\" (UID: \"26d8c542-1981-4013-89eb-c287c6aeba73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62"
Jul 09 18:47:57.370201 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.370180    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26d8c542-1981-4013-89eb-c287c6aeba73-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62\" (UID: \"26d8c542-1981-4013-89eb-c287c6aeba73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62"
Jul 09 18:47:57.471322 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.471295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26d8c542-1981-4013-89eb-c287c6aeba73-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62\" (UID: \"26d8c542-1981-4013-89eb-c287c6aeba73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62"
Jul 09 18:47:57.471447 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.471354    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26d8c542-1981-4013-89eb-c287c6aeba73-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62\" (UID: \"26d8c542-1981-4013-89eb-c287c6aeba73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62"
Jul 09 18:47:57.471447 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.471392    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctwjh\" (UniqueName: \"kubernetes.io/projected/26d8c542-1981-4013-89eb-c287c6aeba73-kube-api-access-ctwjh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62\" (UID: \"26d8c542-1981-4013-89eb-c287c6aeba73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62"
Jul 09 18:47:57.471657 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.471638    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26d8c542-1981-4013-89eb-c287c6aeba73-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62\" (UID: \"26d8c542-1981-4013-89eb-c287c6aeba73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62"
Jul 09 18:47:57.471738 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.471696    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26d8c542-1981-4013-89eb-c287c6aeba73-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62\" (UID: \"26d8c542-1981-4013-89eb-c287c6aeba73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62"
Jul 09 18:47:57.481985 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.481964    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctwjh\" (UniqueName: \"kubernetes.io/projected/26d8c542-1981-4013-89eb-c287c6aeba73-kube-api-access-ctwjh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62\" (UID: \"26d8c542-1981-4013-89eb-c287c6aeba73\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62"
Jul 09 18:47:57.646709 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.646646    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62"
Jul 09 18:47:57.780974 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.780947    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62"]
Jul 09 18:47:57.782885 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:47:57.782858    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d8c542_1981_4013_89eb_c287c6aeba73.slice/crio-192b949adf9f77d202da5cfd7fcdd031f466c782b7a544a97da385c9d4203c8d WatchSource:0}: Error finding container 192b949adf9f77d202da5cfd7fcdd031f466c782b7a544a97da385c9d4203c8d: Status 404 returned error can't find the container with id 192b949adf9f77d202da5cfd7fcdd031f466c782b7a544a97da385c9d4203c8d
Jul 09 18:47:57.827301 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.827270    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62" event={"ID":"26d8c542-1981-4013-89eb-c287c6aeba73","Type":"ContainerStarted","Data":"192b949adf9f77d202da5cfd7fcdd031f466c782b7a544a97da385c9d4203c8d"}
Jul 09 18:47:57.926631 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.926567    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh"]
Jul 09 18:47:57.928864 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.928844    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh"
Jul 09 18:47:57.939359 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.939336    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh"]
Jul 09 18:47:57.975246 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.975226    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh\" (UID: \"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh"
Jul 09 18:47:57.975373 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.975263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmfmv\" (UniqueName: \"kubernetes.io/projected/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-kube-api-access-rmfmv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh\" (UID: \"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh"
Jul 09 18:47:57.975373 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:57.975301    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh\" (UID: \"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh"
Jul 09 18:47:58.076634 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.076611    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh\" (UID: \"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh"
Jul 09 18:47:58.076748 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.076645    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmfmv\" (UniqueName: \"kubernetes.io/projected/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-kube-api-access-rmfmv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh\" (UID: \"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh"
Jul 09 18:47:58.076748 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.076679    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh\" (UID: \"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh"
Jul 09 18:47:58.076976 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.076958    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh\" (UID: \"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh"
Jul 09 18:47:58.077031 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.076979    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh\" (UID: \"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh"
Jul 09 18:47:58.087016 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.086997    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmfmv\" (UniqueName: \"kubernetes.io/projected/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-kube-api-access-rmfmv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh\" (UID: \"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh"
Jul 09 18:47:58.244814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.244785    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh"
Jul 09 18:47:58.318599 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.318572    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t"]
Jul 09 18:47:58.321311 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.321291    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t"
Jul 09 18:47:58.331517 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.331473    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t"]
Jul 09 18:47:58.375519 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.375499    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh"]
Jul 09 18:47:58.377578 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:47:58.377558    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14f86b3_8b1c_4f49_a038_ea3d4ea695d6.slice/crio-dd07fe68e6e40752d4bc56b7df4f834b9d0bfece4eff9f8bd2323796e2438bc0 WatchSource:0}: Error finding container dd07fe68e6e40752d4bc56b7df4f834b9d0bfece4eff9f8bd2323796e2438bc0: Status 404 returned error can't find the container with id dd07fe68e6e40752d4bc56b7df4f834b9d0bfece4eff9f8bd2323796e2438bc0
Jul 09 18:47:58.379326 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.379298    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a9bb699-058d-4816-ae3e-bf20d9112c0d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t\" (UID: \"2a9bb699-058d-4816-ae3e-bf20d9112c0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t"
Jul 09 18:47:58.379424 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.379340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a9bb699-058d-4816-ae3e-bf20d9112c0d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t\" (UID: \"2a9bb699-058d-4816-ae3e-bf20d9112c0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t"
Jul 09 18:47:58.379424 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.379367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzxn5\" (UniqueName: \"kubernetes.io/projected/2a9bb699-058d-4816-ae3e-bf20d9112c0d-kube-api-access-pzxn5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t\" (UID: \"2a9bb699-058d-4816-ae3e-bf20d9112c0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t"
Jul 09 18:47:58.480439 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.480416    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a9bb699-058d-4816-ae3e-bf20d9112c0d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t\" (UID: \"2a9bb699-058d-4816-ae3e-bf20d9112c0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t"
Jul 09 18:47:58.480565 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.480448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a9bb699-058d-4816-ae3e-bf20d9112c0d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t\" (UID: \"2a9bb699-058d-4816-ae3e-bf20d9112c0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t"
Jul 09 18:47:58.480565 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.480471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzxn5\" (UniqueName: \"kubernetes.io/projected/2a9bb699-058d-4816-ae3e-bf20d9112c0d-kube-api-access-pzxn5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t\" (UID: \"2a9bb699-058d-4816-ae3e-bf20d9112c0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t"
Jul 09 18:47:58.480769 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.480751    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a9bb699-058d-4816-ae3e-bf20d9112c0d-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t\" (UID: \"2a9bb699-058d-4816-ae3e-bf20d9112c0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t"
Jul 09 18:47:58.480837 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.480815    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a9bb699-058d-4816-ae3e-bf20d9112c0d-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t\" (UID: \"2a9bb699-058d-4816-ae3e-bf20d9112c0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t"
Jul 09 18:47:58.490495 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.490474    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzxn5\" (UniqueName: \"kubernetes.io/projected/2a9bb699-058d-4816-ae3e-bf20d9112c0d-kube-api-access-pzxn5\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t\" (UID: \"2a9bb699-058d-4816-ae3e-bf20d9112c0d\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t"
Jul 09 18:47:58.632486 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.632450    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t"
Jul 09 18:47:58.716410 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.716381    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n"]
Jul 09 18:47:58.718826 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.718807    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n"
Jul 09 18:47:58.728697 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.728638    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n"]
Jul 09 18:47:58.767640 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.767349    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t"]
Jul 09 18:47:58.769902 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:47:58.769873    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a9bb699_058d_4816_ae3e_bf20d9112c0d.slice/crio-f3d8d4755dd1b64c37f9f12b2b32ec7aef365d26818a6f50fc5474069734a9f5 WatchSource:0}: Error finding container f3d8d4755dd1b64c37f9f12b2b32ec7aef365d26818a6f50fc5474069734a9f5: Status 404 returned error can't find the container with id f3d8d4755dd1b64c37f9f12b2b32ec7aef365d26818a6f50fc5474069734a9f5
Jul 09 18:47:58.783818 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.783797    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n\" (UID: \"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n"
Jul 09 18:47:58.783883 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.783867    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n\" (UID: \"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n"
Jul 09 18:47:58.783935 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.783919    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ksvw\" (UniqueName: \"kubernetes.io/projected/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-kube-api-access-4ksvw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n\" (UID: \"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n"
Jul 09 18:47:58.832490 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.832464    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t" event={"ID":"2a9bb699-058d-4816-ae3e-bf20d9112c0d","Type":"ContainerStarted","Data":"b211d10f8ca1ebcdd0c18690105b23ee6a05aca62183ba5ae846a525e11a13ec"}
Jul 09 18:47:58.832598 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.832514    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t" event={"ID":"2a9bb699-058d-4816-ae3e-bf20d9112c0d","Type":"ContainerStarted","Data":"f3d8d4755dd1b64c37f9f12b2b32ec7aef365d26818a6f50fc5474069734a9f5"}
Jul 09 18:47:58.834105 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.834078    2562 generic.go:356] "Generic (PLEG): container finished" podID="a14f86b3-8b1c-4f49-a038-ea3d4ea695d6" containerID="2045fae5db8f2762897eb4fbe2cf1d1f9f880406b4657dfb8c0bcb89e310e76f" exitCode=0
Jul 09 18:47:58.834213 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.834109    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh" event={"ID":"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6","Type":"ContainerDied","Data":"2045fae5db8f2762897eb4fbe2cf1d1f9f880406b4657dfb8c0bcb89e310e76f"}
Jul 09 18:47:58.834213 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.834166    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh" event={"ID":"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6","Type":"ContainerStarted","Data":"dd07fe68e6e40752d4bc56b7df4f834b9d0bfece4eff9f8bd2323796e2438bc0"}
Jul 09 18:47:58.835794 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.835769    2562 generic.go:356] "Generic (PLEG): container finished" podID="26d8c542-1981-4013-89eb-c287c6aeba73" containerID="b35d19077a6af0d2e5ef532421b07e0c1a89193d31280282e8d07688bc02eec8" exitCode=0
Jul 09 18:47:58.835879 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.835839    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62" event={"ID":"26d8c542-1981-4013-89eb-c287c6aeba73","Type":"ContainerDied","Data":"b35d19077a6af0d2e5ef532421b07e0c1a89193d31280282e8d07688bc02eec8"}
Jul 09 18:47:58.884543 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.884517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n\" (UID: \"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n"
Jul 09 18:47:58.884642 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.884555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ksvw\" (UniqueName: \"kubernetes.io/projected/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-kube-api-access-4ksvw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n\" (UID: \"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n"
Jul 09 18:47:58.884642 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.884613    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n\" (UID: \"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n"
Jul 09 18:47:58.884919 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.884888    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n\" (UID: \"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n"
Jul 09 18:47:58.884994 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.884934    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n\" (UID: \"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n"
Jul 09 18:47:58.896850 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:58.896822    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ksvw\" (UniqueName: \"kubernetes.io/projected/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-kube-api-access-4ksvw\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n\" (UID: \"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n"
Jul 09 18:47:59.031690 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:59.031620    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n"
Jul 09 18:47:59.161712 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:59.161677    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n"]
Jul 09 18:47:59.165099 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:47:59.165074    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0331ff0_f0dc_4c9d_a9c9_f653885fa4c3.slice/crio-60407f851c3f59decc95a9c98806902ef8e8ac6fcf2c52eb723d02695ae0b82a WatchSource:0}: Error finding container 60407f851c3f59decc95a9c98806902ef8e8ac6fcf2c52eb723d02695ae0b82a: Status 404 returned error can't find the container with id 60407f851c3f59decc95a9c98806902ef8e8ac6fcf2c52eb723d02695ae0b82a
Jul 09 18:47:59.841426 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:59.841397    2562 generic.go:356] "Generic (PLEG): container finished" podID="2a9bb699-058d-4816-ae3e-bf20d9112c0d" containerID="b211d10f8ca1ebcdd0c18690105b23ee6a05aca62183ba5ae846a525e11a13ec" exitCode=0
Jul 09 18:47:59.841797 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:59.841479    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t" event={"ID":"2a9bb699-058d-4816-ae3e-bf20d9112c0d","Type":"ContainerDied","Data":"b211d10f8ca1ebcdd0c18690105b23ee6a05aca62183ba5ae846a525e11a13ec"}
Jul 09 18:47:59.843193 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:59.843168    2562 generic.go:356] "Generic (PLEG): container finished" podID="a14f86b3-8b1c-4f49-a038-ea3d4ea695d6" containerID="5b63c8293dc637a35398cc5b14f63dbe72485af6059ed521c2cd3831d6217c2b" exitCode=0
Jul 09 18:47:59.843289 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:59.843239    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh" event={"ID":"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6","Type":"ContainerDied","Data":"5b63c8293dc637a35398cc5b14f63dbe72485af6059ed521c2cd3831d6217c2b"}
Jul 09 18:47:59.845131 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:59.845108    2562 generic.go:356] "Generic (PLEG): container finished" podID="26d8c542-1981-4013-89eb-c287c6aeba73" containerID="e67c37e7e9a3bf518435ef2c038b3750c6c6cd321f1cc61ae51b338f292fd6e3" exitCode=0
Jul 09 18:47:59.845246 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:59.845164    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62" event={"ID":"26d8c542-1981-4013-89eb-c287c6aeba73","Type":"ContainerDied","Data":"e67c37e7e9a3bf518435ef2c038b3750c6c6cd321f1cc61ae51b338f292fd6e3"}
Jul 09 18:47:59.846761 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:59.846742    2562 generic.go:356] "Generic (PLEG): container finished" podID="f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3" containerID="3f26a35ce4bc03d272f2c461181abb3848475f2e43bd58493f545bd3fdd6e30f" exitCode=0
Jul 09 18:47:59.846866 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:59.846776    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n" event={"ID":"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3","Type":"ContainerDied","Data":"3f26a35ce4bc03d272f2c461181abb3848475f2e43bd58493f545bd3fdd6e30f"}
Jul 09 18:47:59.846866 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:47:59.846800    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n" event={"ID":"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3","Type":"ContainerStarted","Data":"60407f851c3f59decc95a9c98806902ef8e8ac6fcf2c52eb723d02695ae0b82a"}
Jul 09 18:48:00.854906 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:00.854873    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t" event={"ID":"2a9bb699-058d-4816-ae3e-bf20d9112c0d","Type":"ContainerStarted","Data":"debb9a5f29ad52b834ec34de23ce1c4b775fc21110581f3a102b60344f4e84d3"}
Jul 09 18:48:00.856975 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:00.856947    2562 generic.go:356] "Generic (PLEG): container finished" podID="a14f86b3-8b1c-4f49-a038-ea3d4ea695d6" containerID="de5c7fae6f4528d9cb3879f99757ee804a46113cd6dd00db746a25ecd2b892e8" exitCode=0
Jul 09 18:48:00.857085 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:00.857028    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh" event={"ID":"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6","Type":"ContainerDied","Data":"de5c7fae6f4528d9cb3879f99757ee804a46113cd6dd00db746a25ecd2b892e8"}
Jul 09 18:48:00.859358 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:00.859337    2562 generic.go:356] "Generic (PLEG): container finished" podID="26d8c542-1981-4013-89eb-c287c6aeba73" containerID="8c8b90b618c637e7dbdf761cd6594f56b3787766daaf6a28cdbac9077ef7273b" exitCode=0
Jul 09 18:48:00.859444 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:00.859398    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62" event={"ID":"26d8c542-1981-4013-89eb-c287c6aeba73","Type":"ContainerDied","Data":"8c8b90b618c637e7dbdf761cd6594f56b3787766daaf6a28cdbac9077ef7273b"}
Jul 09 18:48:00.861100 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:00.861082    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n" event={"ID":"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3","Type":"ContainerStarted","Data":"a35f2b612da178a5d71851dbe75171908e504f8cdd9643d0f878f34f50d9dec1"}
Jul 09 18:48:01.868555 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:01.868522    2562 generic.go:356] "Generic (PLEG): container finished" podID="f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3" containerID="a35f2b612da178a5d71851dbe75171908e504f8cdd9643d0f878f34f50d9dec1" exitCode=0
Jul 09 18:48:01.868555 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:01.868551    2562 generic.go:356] "Generic (PLEG): container finished" podID="f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3" containerID="025debeb1ed714d35236794c228f50b3be3b6d4db8adebc146d69769b0cb00d1" exitCode=0
Jul 09 18:48:01.869053 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:01.868628    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n" event={"ID":"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3","Type":"ContainerDied","Data":"a35f2b612da178a5d71851dbe75171908e504f8cdd9643d0f878f34f50d9dec1"}
Jul 09 18:48:01.869053 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:01.868853    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n" event={"ID":"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3","Type":"ContainerDied","Data":"025debeb1ed714d35236794c228f50b3be3b6d4db8adebc146d69769b0cb00d1"}
Jul 09 18:48:01.870445 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:01.870423    2562 generic.go:356] "Generic (PLEG): container finished" podID="2a9bb699-058d-4816-ae3e-bf20d9112c0d" containerID="debb9a5f29ad52b834ec34de23ce1c4b775fc21110581f3a102b60344f4e84d3" exitCode=0
Jul 09 18:48:01.870554 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:01.870487    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t" event={"ID":"2a9bb699-058d-4816-ae3e-bf20d9112c0d","Type":"ContainerDied","Data":"debb9a5f29ad52b834ec34de23ce1c4b775fc21110581f3a102b60344f4e84d3"}
Jul 09 18:48:02.094510 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.094486    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh"
Jul 09 18:48:02.101327 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.101308    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62"
Jul 09 18:48:02.112712 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.112694    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctwjh\" (UniqueName: \"kubernetes.io/projected/26d8c542-1981-4013-89eb-c287c6aeba73-kube-api-access-ctwjh\") pod \"26d8c542-1981-4013-89eb-c287c6aeba73\" (UID: \"26d8c542-1981-4013-89eb-c287c6aeba73\") "
Jul 09 18:48:02.112769 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.112724    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-util\") pod \"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6\" (UID: \"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6\") "
Jul 09 18:48:02.112769 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.112743    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmfmv\" (UniqueName: \"kubernetes.io/projected/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-kube-api-access-rmfmv\") pod \"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6\" (UID: \"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6\") "
Jul 09 18:48:02.112858 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.112772    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26d8c542-1981-4013-89eb-c287c6aeba73-bundle\") pod \"26d8c542-1981-4013-89eb-c287c6aeba73\" (UID: \"26d8c542-1981-4013-89eb-c287c6aeba73\") "
Jul 09 18:48:02.112911 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.112888    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-bundle\") pod \"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6\" (UID: \"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6\") "
Jul 09 18:48:02.112964 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.112916    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26d8c542-1981-4013-89eb-c287c6aeba73-util\") pod \"26d8c542-1981-4013-89eb-c287c6aeba73\" (UID: \"26d8c542-1981-4013-89eb-c287c6aeba73\") "
Jul 09 18:48:02.113588 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.113555    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26d8c542-1981-4013-89eb-c287c6aeba73-bundle" (OuterVolumeSpecName: "bundle") pod "26d8c542-1981-4013-89eb-c287c6aeba73" (UID: "26d8c542-1981-4013-89eb-c287c6aeba73"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:48:02.113686 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.113593    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-bundle" (OuterVolumeSpecName: "bundle") pod "a14f86b3-8b1c-4f49-a038-ea3d4ea695d6" (UID: "a14f86b3-8b1c-4f49-a038-ea3d4ea695d6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:48:02.115014 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.114986    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-kube-api-access-rmfmv" (OuterVolumeSpecName: "kube-api-access-rmfmv") pod "a14f86b3-8b1c-4f49-a038-ea3d4ea695d6" (UID: "a14f86b3-8b1c-4f49-a038-ea3d4ea695d6"). InnerVolumeSpecName "kube-api-access-rmfmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:48:02.115098 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.115039    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26d8c542-1981-4013-89eb-c287c6aeba73-kube-api-access-ctwjh" (OuterVolumeSpecName: "kube-api-access-ctwjh") pod "26d8c542-1981-4013-89eb-c287c6aeba73" (UID: "26d8c542-1981-4013-89eb-c287c6aeba73"). InnerVolumeSpecName "kube-api-access-ctwjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:48:02.120164 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.120078    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-util" (OuterVolumeSpecName: "util") pod "a14f86b3-8b1c-4f49-a038-ea3d4ea695d6" (UID: "a14f86b3-8b1c-4f49-a038-ea3d4ea695d6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:48:02.120254 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.120164    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26d8c542-1981-4013-89eb-c287c6aeba73-util" (OuterVolumeSpecName: "util") pod "26d8c542-1981-4013-89eb-c287c6aeba73" (UID: "26d8c542-1981-4013-89eb-c287c6aeba73"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:48:02.213773 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.213752    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-bundle\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:02.213773 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.213774    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26d8c542-1981-4013-89eb-c287c6aeba73-util\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:02.213773 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.213782    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctwjh\" (UniqueName: \"kubernetes.io/projected/26d8c542-1981-4013-89eb-c287c6aeba73-kube-api-access-ctwjh\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:02.213943 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.213791    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-util\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:02.213943 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.213799    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmfmv\" (UniqueName: \"kubernetes.io/projected/a14f86b3-8b1c-4f49-a038-ea3d4ea695d6-kube-api-access-rmfmv\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:02.213943 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.213807    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26d8c542-1981-4013-89eb-c287c6aeba73-bundle\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:02.876997 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.876921    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh"
Jul 09 18:48:02.877429 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.876921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh" event={"ID":"a14f86b3-8b1c-4f49-a038-ea3d4ea695d6","Type":"ContainerDied","Data":"dd07fe68e6e40752d4bc56b7df4f834b9d0bfece4eff9f8bd2323796e2438bc0"}
Jul 09 18:48:02.877429 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.877045    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd07fe68e6e40752d4bc56b7df4f834b9d0bfece4eff9f8bd2323796e2438bc0"
Jul 09 18:48:02.879012 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.878996    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62"
Jul 09 18:48:02.879190 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.879010    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62" event={"ID":"26d8c542-1981-4013-89eb-c287c6aeba73","Type":"ContainerDied","Data":"192b949adf9f77d202da5cfd7fcdd031f466c782b7a544a97da385c9d4203c8d"}
Jul 09 18:48:02.879190 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.879049    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="192b949adf9f77d202da5cfd7fcdd031f466c782b7a544a97da385c9d4203c8d"
Jul 09 18:48:02.881230 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.881207    2562 generic.go:356] "Generic (PLEG): container finished" podID="2a9bb699-058d-4816-ae3e-bf20d9112c0d" containerID="1f79e129086a38c9fbfb727be4b9415cf4ed6eb9f3f76014a4a927f015cdb90c" exitCode=0
Jul 09 18:48:02.881307 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:02.881272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t" event={"ID":"2a9bb699-058d-4816-ae3e-bf20d9112c0d","Type":"ContainerDied","Data":"1f79e129086a38c9fbfb727be4b9415cf4ed6eb9f3f76014a4a927f015cdb90c"}
Jul 09 18:48:03.010210 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:03.010190    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n"
Jul 09 18:48:03.018901 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:03.018881    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ksvw\" (UniqueName: \"kubernetes.io/projected/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-kube-api-access-4ksvw\") pod \"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3\" (UID: \"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3\") "
Jul 09 18:48:03.018985 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:03.018914    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-util\") pod \"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3\" (UID: \"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3\") "
Jul 09 18:48:03.018985 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:03.018933    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-bundle\") pod \"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3\" (UID: \"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3\") "
Jul 09 18:48:03.019374 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:03.019340    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-bundle" (OuterVolumeSpecName: "bundle") pod "f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3" (UID: "f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:48:03.021018 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:03.020995    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-kube-api-access-4ksvw" (OuterVolumeSpecName: "kube-api-access-4ksvw") pod "f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3" (UID: "f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3"). InnerVolumeSpecName "kube-api-access-4ksvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:48:03.024010 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:03.023987    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-util" (OuterVolumeSpecName: "util") pod "f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3" (UID: "f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:48:03.120159 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:03.120118    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ksvw\" (UniqueName: \"kubernetes.io/projected/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-kube-api-access-4ksvw\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:03.120159 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:03.120158    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-util\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:03.120315 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:03.120169    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3-bundle\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:03.888766 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:03.888732    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n"
Jul 09 18:48:03.888766 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:03.888760    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n" event={"ID":"f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3","Type":"ContainerDied","Data":"60407f851c3f59decc95a9c98806902ef8e8ac6fcf2c52eb723d02695ae0b82a"}
Jul 09 18:48:03.889327 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:03.888810    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60407f851c3f59decc95a9c98806902ef8e8ac6fcf2c52eb723d02695ae0b82a"
Jul 09 18:48:04.018342 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:04.018321    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t"
Jul 09 18:48:04.026304 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:04.026283    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a9bb699-058d-4816-ae3e-bf20d9112c0d-bundle\") pod \"2a9bb699-058d-4816-ae3e-bf20d9112c0d\" (UID: \"2a9bb699-058d-4816-ae3e-bf20d9112c0d\") "
Jul 09 18:48:04.026395 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:04.026327    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a9bb699-058d-4816-ae3e-bf20d9112c0d-util\") pod \"2a9bb699-058d-4816-ae3e-bf20d9112c0d\" (UID: \"2a9bb699-058d-4816-ae3e-bf20d9112c0d\") "
Jul 09 18:48:04.026395 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:04.026385    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzxn5\" (UniqueName: \"kubernetes.io/projected/2a9bb699-058d-4816-ae3e-bf20d9112c0d-kube-api-access-pzxn5\") pod \"2a9bb699-058d-4816-ae3e-bf20d9112c0d\" (UID: \"2a9bb699-058d-4816-ae3e-bf20d9112c0d\") "
Jul 09 18:48:04.026750 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:04.026728    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a9bb699-058d-4816-ae3e-bf20d9112c0d-bundle" (OuterVolumeSpecName: "bundle") pod "2a9bb699-058d-4816-ae3e-bf20d9112c0d" (UID: "2a9bb699-058d-4816-ae3e-bf20d9112c0d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:48:04.028567 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:04.028543    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a9bb699-058d-4816-ae3e-bf20d9112c0d-kube-api-access-pzxn5" (OuterVolumeSpecName: "kube-api-access-pzxn5") pod "2a9bb699-058d-4816-ae3e-bf20d9112c0d" (UID: "2a9bb699-058d-4816-ae3e-bf20d9112c0d"). InnerVolumeSpecName "kube-api-access-pzxn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:48:04.032421 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:04.032390    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a9bb699-058d-4816-ae3e-bf20d9112c0d-util" (OuterVolumeSpecName: "util") pod "2a9bb699-058d-4816-ae3e-bf20d9112c0d" (UID: "2a9bb699-058d-4816-ae3e-bf20d9112c0d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:48:04.127640 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:04.127609    2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a9bb699-058d-4816-ae3e-bf20d9112c0d-bundle\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:04.127640 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:04.127632    2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a9bb699-058d-4816-ae3e-bf20d9112c0d-util\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:04.127640 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:04.127641    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzxn5\" (UniqueName: \"kubernetes.io/projected/2a9bb699-058d-4816-ae3e-bf20d9112c0d-kube-api-access-pzxn5\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:04.895106 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:04.895068    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t" event={"ID":"2a9bb699-058d-4816-ae3e-bf20d9112c0d","Type":"ContainerDied","Data":"f3d8d4755dd1b64c37f9f12b2b32ec7aef365d26818a6f50fc5474069734a9f5"}
Jul 09 18:48:04.895106 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:04.895101    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t"
Jul 09 18:48:04.895548 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:04.895117    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3d8d4755dd1b64c37f9f12b2b32ec7aef365d26818a6f50fc5474069734a9f5"
Jul 09 18:48:06.776216 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776184    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-867d8958b9-dmghn"]
Jul 09 18:48:06.776574 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776518    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d8c542-1981-4013-89eb-c287c6aeba73" containerName="pull"
Jul 09 18:48:06.776574 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776530    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d8c542-1981-4013-89eb-c287c6aeba73" containerName="pull"
Jul 09 18:48:06.776574 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776539    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a9bb699-058d-4816-ae3e-bf20d9112c0d" containerName="extract"
Jul 09 18:48:06.776574 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776544    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a9bb699-058d-4816-ae3e-bf20d9112c0d" containerName="extract"
Jul 09 18:48:06.776574 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776552    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a9bb699-058d-4816-ae3e-bf20d9112c0d" containerName="util"
Jul 09 18:48:06.776574 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776557    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a9bb699-058d-4816-ae3e-bf20d9112c0d" containerName="util"
Jul 09 18:48:06.776574 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776566    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3" containerName="pull"
Jul 09 18:48:06.776574 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776573    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3" containerName="pull"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776583    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d8c542-1981-4013-89eb-c287c6aeba73" containerName="util"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776591    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d8c542-1981-4013-89eb-c287c6aeba73" containerName="util"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776598    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a14f86b3-8b1c-4f49-a038-ea3d4ea695d6" containerName="util"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776603    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a14f86b3-8b1c-4f49-a038-ea3d4ea695d6" containerName="util"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776614    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d8c542-1981-4013-89eb-c287c6aeba73" containerName="extract"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776620    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d8c542-1981-4013-89eb-c287c6aeba73" containerName="extract"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776626    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3" containerName="util"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776631    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3" containerName="util"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776640    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a14f86b3-8b1c-4f49-a038-ea3d4ea695d6" containerName="extract"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776644    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a14f86b3-8b1c-4f49-a038-ea3d4ea695d6" containerName="extract"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776652    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3" containerName="extract"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776660    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3" containerName="extract"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776670    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a9bb699-058d-4816-ae3e-bf20d9112c0d" containerName="pull"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776676    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a9bb699-058d-4816-ae3e-bf20d9112c0d" containerName="pull"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776684    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a14f86b3-8b1c-4f49-a038-ea3d4ea695d6" containerName="pull"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776689    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a14f86b3-8b1c-4f49-a038-ea3d4ea695d6" containerName="pull"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776733    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3" containerName="extract"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776744    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a9bb699-058d-4816-ae3e-bf20d9112c0d" containerName="extract"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776754    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="26d8c542-1981-4013-89eb-c287c6aeba73" containerName="extract"
Jul 09 18:48:06.776814 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.776760    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a14f86b3-8b1c-4f49-a038-ea3d4ea695d6" containerName="extract"
Jul 09 18:48:06.780195 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.780179    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.792125 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.792104    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-867d8958b9-dmghn"]
Jul 09 18:48:06.847763 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.847738    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-service-ca\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.847873 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.847772    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-console-oauth-config\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.847873 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.847821    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-console-config\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.847873 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.847837    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5c8f\" (UniqueName: \"kubernetes.io/projected/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-kube-api-access-w5c8f\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.847873 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.847852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-console-serving-cert\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.848060 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.847874    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-oauth-serving-cert\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.848060 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.847976    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-trusted-ca-bundle\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.948312 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.948290    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-service-ca\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.948450 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.948323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-console-oauth-config\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.948450 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.948361    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-console-config\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.948450 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.948376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5c8f\" (UniqueName: \"kubernetes.io/projected/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-kube-api-access-w5c8f\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.948450 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.948392    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-console-serving-cert\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.948450 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.948409    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-oauth-serving-cert\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.948450 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.948431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-trusted-ca-bundle\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.949177 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.949133    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-console-config\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.949273 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.949221    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-service-ca\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.949505 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.949481    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-oauth-serving-cert\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.949576 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.949526    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-trusted-ca-bundle\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.951005 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.950983    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-console-serving-cert\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.951126 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.951107    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-console-oauth-config\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:06.961846 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:06.961822    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5c8f\" (UniqueName: \"kubernetes.io/projected/58791f9c-d4d6-4ffd-8fa2-316478c5bf9a-kube-api-access-w5c8f\") pod \"console-867d8958b9-dmghn\" (UID: \"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a\") " pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:07.089467 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:07.089394    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:07.229035 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:07.229007    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-867d8958b9-dmghn"]
Jul 09 18:48:07.230420 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:48:07.230397    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58791f9c_d4d6_4ffd_8fa2_316478c5bf9a.slice/crio-5d4f55b47674ff0a3d242685ba97c65eb5d92a4424dad352e186c8fc5a298b5a WatchSource:0}: Error finding container 5d4f55b47674ff0a3d242685ba97c65eb5d92a4424dad352e186c8fc5a298b5a: Status 404 returned error can't find the container with id 5d4f55b47674ff0a3d242685ba97c65eb5d92a4424dad352e186c8fc5a298b5a
Jul 09 18:48:07.911125 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:07.911085    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d8958b9-dmghn" event={"ID":"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a","Type":"ContainerStarted","Data":"9c012b3593634951a784ce060954bfbba25991cde4538ab745300569e5129766"}
Jul 09 18:48:07.911591 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:07.911162    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-867d8958b9-dmghn" event={"ID":"58791f9c-d4d6-4ffd-8fa2-316478c5bf9a","Type":"ContainerStarted","Data":"5d4f55b47674ff0a3d242685ba97c65eb5d92a4424dad352e186c8fc5a298b5a"}
Jul 09 18:48:07.938398 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:07.938353    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-867d8958b9-dmghn" podStartSLOduration=1.93833804 podStartE2EDuration="1.93833804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:48:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:48:07.937027992 +0000 UTC m=+422.298175173" watchObservedRunningTime="2026-07-09 18:48:07.93833804 +0000 UTC m=+422.299485219"
Jul 09 18:48:17.090525 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:17.090489    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:17.090872 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:17.090543    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:17.095423 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:17.095403    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:17.965242 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:17.965215    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-867d8958b9-dmghn"
Jul 09 18:48:18.029704 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:18.029674    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84fb8b5cc6-9hmtm"]
Jul 09 18:48:22.807119 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:22.807090    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"]
Jul 09 18:48:22.810723 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:22.810703    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:22.813444 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:22.813425    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 18:48:22.813544 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:22.813495    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 18:48:22.813628 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:22.813606    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5ncwd\""
Jul 09 18:48:22.835230 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:22.835206    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"]
Jul 09 18:48:22.880053 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:22.880024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9bdh\" (UniqueName: \"kubernetes.io/projected/b448d79e-f6b9-4496-905b-04256e6f7440-kube-api-access-z9bdh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jbwrx\" (UID: \"b448d79e-f6b9-4496-905b-04256e6f7440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:22.880207 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:22.880088    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b448d79e-f6b9-4496-905b-04256e6f7440-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jbwrx\" (UID: \"b448d79e-f6b9-4496-905b-04256e6f7440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:22.980572 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:22.980532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b448d79e-f6b9-4496-905b-04256e6f7440-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jbwrx\" (UID: \"b448d79e-f6b9-4496-905b-04256e6f7440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:22.980782 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:22.980597    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9bdh\" (UniqueName: \"kubernetes.io/projected/b448d79e-f6b9-4496-905b-04256e6f7440-kube-api-access-z9bdh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jbwrx\" (UID: \"b448d79e-f6b9-4496-905b-04256e6f7440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:22.980935 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:22.980915    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b448d79e-f6b9-4496-905b-04256e6f7440-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jbwrx\" (UID: \"b448d79e-f6b9-4496-905b-04256e6f7440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:23.000488 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:23.000457    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9bdh\" (UniqueName: \"kubernetes.io/projected/b448d79e-f6b9-4496-905b-04256e6f7440-kube-api-access-z9bdh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jbwrx\" (UID: \"b448d79e-f6b9-4496-905b-04256e6f7440\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:23.121787 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:23.121690    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:23.273046 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:23.273018    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"]
Jul 09 18:48:23.275415 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:48:23.275388    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb448d79e_f6b9_4496_905b_04256e6f7440.slice/crio-3111c1ca1ed9dc8c11795ef7142665bc90158411bfee8f589159ebca2e7f0b26 WatchSource:0}: Error finding container 3111c1ca1ed9dc8c11795ef7142665bc90158411bfee8f589159ebca2e7f0b26: Status 404 returned error can't find the container with id 3111c1ca1ed9dc8c11795ef7142665bc90158411bfee8f589159ebca2e7f0b26
Jul 09 18:48:23.990987 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:23.990949    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx" event={"ID":"b448d79e-f6b9-4496-905b-04256e6f7440","Type":"ContainerStarted","Data":"3111c1ca1ed9dc8c11795ef7142665bc90158411bfee8f589159ebca2e7f0b26"}
Jul 09 18:48:31.033049 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:31.033012    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx" event={"ID":"b448d79e-f6b9-4496-905b-04256e6f7440","Type":"ContainerStarted","Data":"5c7b9cb5bde0a823e3557ad16155b3cb8e595ffc7a489da27a0ed9446d759284"}
Jul 09 18:48:31.033463 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:31.033171    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:31.057619 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:31.057574    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx" podStartSLOduration=1.482930478 podStartE2EDuration="9.057561165s" totalImagesPullingTime="7.574630687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:48:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:48:31.054818383 +0000 UTC m=+445.415965564" watchObservedRunningTime="2026-07-09 18:48:31.057561165 +0000 UTC m=+445.418708345"
Jul 09 18:48:42.039386 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:42.039357    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:43.055892 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.055853    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84fb8b5cc6-9hmtm" podUID="528b9df1-a9d2-42cb-b5cf-7af456ad4e7d" containerName="console" containerID="cri-o://3a48353ca6de0fabe37baa412ffef572f772d416ec7cf019ac91e7440329c616" gracePeriod=15
Jul 09 18:48:43.071671 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.071553    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"]
Jul 09 18:48:43.074959 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.074943    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"
Jul 09 18:48:43.089419 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.089396    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"]
Jul 09 18:48:43.153401 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.153377    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57cfw\" (UniqueName: \"kubernetes.io/projected/bb04c7fe-370e-48de-b1b9-f870f8c0bfb3-kube-api-access-57cfw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tfxxh\" (UID: \"bb04c7fe-370e-48de-b1b9-f870f8c0bfb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"
Jul 09 18:48:43.153503 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.153432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb04c7fe-370e-48de-b1b9-f870f8c0bfb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tfxxh\" (UID: \"bb04c7fe-370e-48de-b1b9-f870f8c0bfb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"
Jul 09 18:48:43.254744 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.254651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb04c7fe-370e-48de-b1b9-f870f8c0bfb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tfxxh\" (UID: \"bb04c7fe-370e-48de-b1b9-f870f8c0bfb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"
Jul 09 18:48:43.254744 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.254712    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57cfw\" (UniqueName: \"kubernetes.io/projected/bb04c7fe-370e-48de-b1b9-f870f8c0bfb3-kube-api-access-57cfw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tfxxh\" (UID: \"bb04c7fe-370e-48de-b1b9-f870f8c0bfb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"
Jul 09 18:48:43.255077 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.255055    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb04c7fe-370e-48de-b1b9-f870f8c0bfb3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tfxxh\" (UID: \"bb04c7fe-370e-48de-b1b9-f870f8c0bfb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"
Jul 09 18:48:43.266503 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.266474    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57cfw\" (UniqueName: \"kubernetes.io/projected/bb04c7fe-370e-48de-b1b9-f870f8c0bfb3-kube-api-access-57cfw\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-tfxxh\" (UID: \"bb04c7fe-370e-48de-b1b9-f870f8c0bfb3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"
Jul 09 18:48:43.309956 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.309902    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:48:43.433649 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.433618    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"
Jul 09 18:48:43.455675 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.455649    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-trusted-ca-bundle\") pod \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") "
Jul 09 18:48:43.455803 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.455691    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-oauth-serving-cert\") pod \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") "
Jul 09 18:48:43.455803 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.455744    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rkzs\" (UniqueName: \"kubernetes.io/projected/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-kube-api-access-2rkzs\") pod \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") "
Jul 09 18:48:43.455803 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.455776    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-serving-cert\") pod \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") "
Jul 09 18:48:43.455964 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.455808    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-oauth-config\") pod \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") "
Jul 09 18:48:43.455964 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.455850    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-service-ca\") pod \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") "
Jul 09 18:48:43.455964 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.455925    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-config\") pod \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\" (UID: \"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d\") "
Jul 09 18:48:43.456095 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.456049    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "528b9df1-a9d2-42cb-b5cf-7af456ad4e7d" (UID: "528b9df1-a9d2-42cb-b5cf-7af456ad4e7d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:43.456206 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.456180    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "528b9df1-a9d2-42cb-b5cf-7af456ad4e7d" (UID: "528b9df1-a9d2-42cb-b5cf-7af456ad4e7d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:43.456273 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.456204    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-trusted-ca-bundle\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:43.456458 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.456435    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-config" (OuterVolumeSpecName: "console-config") pod "528b9df1-a9d2-42cb-b5cf-7af456ad4e7d" (UID: "528b9df1-a9d2-42cb-b5cf-7af456ad4e7d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:43.456539 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.456514    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-service-ca" (OuterVolumeSpecName: "service-ca") pod "528b9df1-a9d2-42cb-b5cf-7af456ad4e7d" (UID: "528b9df1-a9d2-42cb-b5cf-7af456ad4e7d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 18:48:43.458080 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.458052    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "528b9df1-a9d2-42cb-b5cf-7af456ad4e7d" (UID: "528b9df1-a9d2-42cb-b5cf-7af456ad4e7d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:43.458285 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.458262    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-kube-api-access-2rkzs" (OuterVolumeSpecName: "kube-api-access-2rkzs") pod "528b9df1-a9d2-42cb-b5cf-7af456ad4e7d" (UID: "528b9df1-a9d2-42cb-b5cf-7af456ad4e7d"). InnerVolumeSpecName "kube-api-access-2rkzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:48:43.458443 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.458429    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "528b9df1-a9d2-42cb-b5cf-7af456ad4e7d" (UID: "528b9df1-a9d2-42cb-b5cf-7af456ad4e7d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 18:48:43.556690 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.556659    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-config\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:43.556690 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.556686    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-oauth-serving-cert\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:43.556690 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.556695    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rkzs\" (UniqueName: \"kubernetes.io/projected/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-kube-api-access-2rkzs\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:43.556979 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.556705    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-serving-cert\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:43.556979 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.556714    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-console-oauth-config\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:43.556979 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.556722    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d-service-ca\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:43.587471 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.587450    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"]
Jul 09 18:48:43.589079 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:48:43.589057    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb04c7fe_370e_48de_b1b9_f870f8c0bfb3.slice/crio-f34166c1e4f1d3a4bcea66d9ec38a70bee424ab25fc25b56afa0b49834f03ef9 WatchSource:0}: Error finding container f34166c1e4f1d3a4bcea66d9ec38a70bee424ab25fc25b56afa0b49834f03ef9: Status 404 returned error can't find the container with id f34166c1e4f1d3a4bcea66d9ec38a70bee424ab25fc25b56afa0b49834f03ef9
Jul 09 18:48:43.756096 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.756061    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"]
Jul 09 18:48:43.762661 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.762638    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"]
Jul 09 18:48:43.775525 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.775504    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"]
Jul 09 18:48:43.775703 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.775678    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx" podUID="b448d79e-f6b9-4496-905b-04256e6f7440" containerName="manager" containerID="cri-o://5c7b9cb5bde0a823e3557ad16155b3cb8e595ffc7a489da27a0ed9446d759284" gracePeriod=2
Jul 09 18:48:43.789007 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.788981    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"]
Jul 09 18:48:43.805406 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.803889    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"]
Jul 09 18:48:43.805406 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.804294    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b448d79e-f6b9-4496-905b-04256e6f7440" containerName="manager"
Jul 09 18:48:43.805406 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.804310    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b448d79e-f6b9-4496-905b-04256e6f7440" containerName="manager"
Jul 09 18:48:43.805406 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.804336    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528b9df1-a9d2-42cb-b5cf-7af456ad4e7d" containerName="console"
Jul 09 18:48:43.805406 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.804344    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="528b9df1-a9d2-42cb-b5cf-7af456ad4e7d" containerName="console"
Jul 09 18:48:43.805406 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.804364    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb04c7fe-370e-48de-b1b9-f870f8c0bfb3" containerName="manager"
Jul 09 18:48:43.805406 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.804373    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb04c7fe-370e-48de-b1b9-f870f8c0bfb3" containerName="manager"
Jul 09 18:48:43.805406 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.804451    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb04c7fe-370e-48de-b1b9-f870f8c0bfb3" containerName="manager"
Jul 09 18:48:43.805406 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.804464    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="528b9df1-a9d2-42cb-b5cf-7af456ad4e7d" containerName="console"
Jul 09 18:48:43.805406 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.804474    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b448d79e-f6b9-4496-905b-04256e6f7440" containerName="manager"
Jul 09 18:48:43.808486 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.808051    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"
Jul 09 18:48:43.841328 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.841251    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"]
Jul 09 18:48:43.844658 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.844633    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gp5lw"]
Jul 09 18:48:43.848216 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.848197    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gp5lw"
Jul 09 18:48:43.857188 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.857134    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gpclt\""
Jul 09 18:48:43.878842 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.878821    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gp5lw"]
Jul 09 18:48:43.892239 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:48:43.892209    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jbwrx\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="b448d79e-f6b9-4496-905b-04256e6f7440" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:43.894978 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:48:43.894953    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jbwrx\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="b448d79e-f6b9-4496-905b-04256e6f7440" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:43.959613 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.959581    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hcsl\" (UniqueName: \"kubernetes.io/projected/21c7af88-6c11-4b42-8a98-e3d23f705c15-kube-api-access-8hcsl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-457jb\" (UID: \"21c7af88-6c11-4b42-8a98-e3d23f705c15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"
Jul 09 18:48:43.959728 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.959640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21c7af88-6c11-4b42-8a98-e3d23f705c15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-457jb\" (UID: \"21c7af88-6c11-4b42-8a98-e3d23f705c15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"
Jul 09 18:48:43.959776 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:43.959742    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87l75\" (UniqueName: \"kubernetes.io/projected/7d57e33b-dd0c-45b0-a38a-2a263eb205fb-kube-api-access-87l75\") pod \"limitador-operator-controller-manager-859d7b78bd-gp5lw\" (UID: \"7d57e33b-dd0c-45b0-a38a-2a263eb205fb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gp5lw"
Jul 09 18:48:44.010290 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.010267    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:44.016385 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:48:44.016357    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jbwrx\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="b448d79e-f6b9-4496-905b-04256e6f7440" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:44.060729 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.060703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87l75\" (UniqueName: \"kubernetes.io/projected/7d57e33b-dd0c-45b0-a38a-2a263eb205fb-kube-api-access-87l75\") pod \"limitador-operator-controller-manager-859d7b78bd-gp5lw\" (UID: \"7d57e33b-dd0c-45b0-a38a-2a263eb205fb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gp5lw"
Jul 09 18:48:44.061089 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.060739    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hcsl\" (UniqueName: \"kubernetes.io/projected/21c7af88-6c11-4b42-8a98-e3d23f705c15-kube-api-access-8hcsl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-457jb\" (UID: \"21c7af88-6c11-4b42-8a98-e3d23f705c15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"
Jul 09 18:48:44.061089 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.060833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21c7af88-6c11-4b42-8a98-e3d23f705c15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-457jb\" (UID: \"21c7af88-6c11-4b42-8a98-e3d23f705c15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"
Jul 09 18:48:44.061279 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.061260    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21c7af88-6c11-4b42-8a98-e3d23f705c15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-457jb\" (UID: \"21c7af88-6c11-4b42-8a98-e3d23f705c15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"
Jul 09 18:48:44.079423 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.079403    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hcsl\" (UniqueName: \"kubernetes.io/projected/21c7af88-6c11-4b42-8a98-e3d23f705c15-kube-api-access-8hcsl\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-457jb\" (UID: \"21c7af88-6c11-4b42-8a98-e3d23f705c15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"
Jul 09 18:48:44.079507 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.079456    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87l75\" (UniqueName: \"kubernetes.io/projected/7d57e33b-dd0c-45b0-a38a-2a263eb205fb-kube-api-access-87l75\") pod \"limitador-operator-controller-manager-859d7b78bd-gp5lw\" (UID: \"7d57e33b-dd0c-45b0-a38a-2a263eb205fb\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gp5lw"
Jul 09 18:48:44.096738 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:48:44.096674    2562 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh" container="manager"
Jul 09 18:48:44.097782 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.097760    2562 generic.go:356] "Generic (PLEG): container finished" podID="b448d79e-f6b9-4496-905b-04256e6f7440" containerID="5c7b9cb5bde0a823e3557ad16155b3cb8e595ffc7a489da27a0ed9446d759284" exitCode=0
Jul 09 18:48:44.097864 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.097798    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:44.097938 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.097872    2562 scope.go:117] "RemoveContainer" containerID="5c7b9cb5bde0a823e3557ad16155b3cb8e595ffc7a489da27a0ed9446d759284"
Jul 09 18:48:44.099361 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.099340    2562 generic.go:356] "Generic (PLEG): container finished" podID="528b9df1-a9d2-42cb-b5cf-7af456ad4e7d" containerID="3a48353ca6de0fabe37baa412ffef572f772d416ec7cf019ac91e7440329c616" exitCode=0
Jul 09 18:48:44.099457 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.099377    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84fb8b5cc6-9hmtm" event={"ID":"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d","Type":"ContainerDied","Data":"3a48353ca6de0fabe37baa412ffef572f772d416ec7cf019ac91e7440329c616"}
Jul 09 18:48:44.099457 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.099406    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84fb8b5cc6-9hmtm"
Jul 09 18:48:44.099457 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.099414    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84fb8b5cc6-9hmtm" event={"ID":"528b9df1-a9d2-42cb-b5cf-7af456ad4e7d","Type":"ContainerDied","Data":"20ffa10b200430bf199658db151bd187d73ebe1a8b5746bc3e8985eb3a299cc8"}
Jul 09 18:48:44.099754 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:48:44.099732    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jbwrx\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="b448d79e-f6b9-4496-905b-04256e6f7440" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:44.102280 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:48:44.102255    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-tfxxh\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="bb04c7fe-370e-48de-b1b9-f870f8c0bfb3" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"
Jul 09 18:48:44.106367 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:48:44.106341    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-tfxxh\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="bb04c7fe-370e-48de-b1b9-f870f8c0bfb3" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"
Jul 09 18:48:44.106774 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.106742    2562 scope.go:117] "RemoveContainer" containerID="5c7b9cb5bde0a823e3557ad16155b3cb8e595ffc7a489da27a0ed9446d759284"
Jul 09 18:48:44.107089 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:48:44.107070    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c7b9cb5bde0a823e3557ad16155b3cb8e595ffc7a489da27a0ed9446d759284\": container with ID starting with 5c7b9cb5bde0a823e3557ad16155b3cb8e595ffc7a489da27a0ed9446d759284 not found: ID does not exist" containerID="5c7b9cb5bde0a823e3557ad16155b3cb8e595ffc7a489da27a0ed9446d759284"
Jul 09 18:48:44.107177 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.107095    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c7b9cb5bde0a823e3557ad16155b3cb8e595ffc7a489da27a0ed9446d759284"} err="failed to get container status \"5c7b9cb5bde0a823e3557ad16155b3cb8e595ffc7a489da27a0ed9446d759284\": rpc error: code = NotFound desc = could not find container \"5c7b9cb5bde0a823e3557ad16155b3cb8e595ffc7a489da27a0ed9446d759284\": container with ID starting with 5c7b9cb5bde0a823e3557ad16155b3cb8e595ffc7a489da27a0ed9446d759284 not found: ID does not exist"
Jul 09 18:48:44.107177 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.107116    2562 scope.go:117] "RemoveContainer" containerID="3a48353ca6de0fabe37baa412ffef572f772d416ec7cf019ac91e7440329c616"
Jul 09 18:48:44.114827 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.114813    2562 scope.go:117] "RemoveContainer" containerID="3a48353ca6de0fabe37baa412ffef572f772d416ec7cf019ac91e7440329c616"
Jul 09 18:48:44.115081 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:48:44.115067    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a48353ca6de0fabe37baa412ffef572f772d416ec7cf019ac91e7440329c616\": container with ID starting with 3a48353ca6de0fabe37baa412ffef572f772d416ec7cf019ac91e7440329c616 not found: ID does not exist" containerID="3a48353ca6de0fabe37baa412ffef572f772d416ec7cf019ac91e7440329c616"
Jul 09 18:48:44.115125 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.115087    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a48353ca6de0fabe37baa412ffef572f772d416ec7cf019ac91e7440329c616"} err="failed to get container status \"3a48353ca6de0fabe37baa412ffef572f772d416ec7cf019ac91e7440329c616\": rpc error: code = NotFound desc = could not find container \"3a48353ca6de0fabe37baa412ffef572f772d416ec7cf019ac91e7440329c616\": container with ID starting with 3a48353ca6de0fabe37baa412ffef572f772d416ec7cf019ac91e7440329c616 not found: ID does not exist"
Jul 09 18:48:44.117160 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:48:44.117123    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jbwrx\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="b448d79e-f6b9-4496-905b-04256e6f7440" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:44.154500 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.154483    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84fb8b5cc6-9hmtm"]
Jul 09 18:48:44.161828 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.161810    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b448d79e-f6b9-4496-905b-04256e6f7440-extensions-socket-volume\") pod \"b448d79e-f6b9-4496-905b-04256e6f7440\" (UID: \"b448d79e-f6b9-4496-905b-04256e6f7440\") "
Jul 09 18:48:44.161937 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.161859    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9bdh\" (UniqueName: \"kubernetes.io/projected/b448d79e-f6b9-4496-905b-04256e6f7440-kube-api-access-z9bdh\") pod \"b448d79e-f6b9-4496-905b-04256e6f7440\" (UID: \"b448d79e-f6b9-4496-905b-04256e6f7440\") "
Jul 09 18:48:44.162302 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.162280    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b448d79e-f6b9-4496-905b-04256e6f7440-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b448d79e-f6b9-4496-905b-04256e6f7440" (UID: "b448d79e-f6b9-4496-905b-04256e6f7440"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:48:44.162403 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.162389    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"
Jul 09 18:48:44.162799 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:48:44.162776    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jbwrx\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="b448d79e-f6b9-4496-905b-04256e6f7440" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jbwrx"
Jul 09 18:48:44.162866 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.162814    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84fb8b5cc6-9hmtm"]
Jul 09 18:48:44.163839 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.163820    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b448d79e-f6b9-4496-905b-04256e6f7440-kube-api-access-z9bdh" (OuterVolumeSpecName: "kube-api-access-z9bdh") pod "b448d79e-f6b9-4496-905b-04256e6f7440" (UID: "b448d79e-f6b9-4496-905b-04256e6f7440"). InnerVolumeSpecName "kube-api-access-z9bdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:48:44.165763 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:48:44.165743    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-tfxxh\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="bb04c7fe-370e-48de-b1b9-f870f8c0bfb3" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"
Jul 09 18:48:44.170893 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.170872    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gp5lw"
Jul 09 18:48:44.262752 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.262717    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9bdh\" (UniqueName: \"kubernetes.io/projected/b448d79e-f6b9-4496-905b-04256e6f7440-kube-api-access-z9bdh\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:44.262888 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.262754    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b448d79e-f6b9-4496-905b-04256e6f7440-extensions-socket-volume\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:44.320805 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.320752    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"]
Jul 09 18:48:44.322942 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:48:44.322916    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c7af88_6c11_4b42_8a98_e3d23f705c15.slice/crio-7552700f2f00b71c6af490aa1bcc42a6b15ebf477a60acc38264196c5ec7dbac WatchSource:0}: Error finding container 7552700f2f00b71c6af490aa1bcc42a6b15ebf477a60acc38264196c5ec7dbac: Status 404 returned error can't find the container with id 7552700f2f00b71c6af490aa1bcc42a6b15ebf477a60acc38264196c5ec7dbac
Jul 09 18:48:44.330313 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:48:44.330291    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d57e33b_dd0c_45b0_a38a_2a263eb205fb.slice/crio-6ee79d2c9bbdb7f3cab4f04a9d3a0c224f25018ead1e5d526cb9bbf267226cd2 WatchSource:0}: Error finding container 6ee79d2c9bbdb7f3cab4f04a9d3a0c224f25018ead1e5d526cb9bbf267226cd2: Status 404 returned error can't find the container with id 6ee79d2c9bbdb7f3cab4f04a9d3a0c224f25018ead1e5d526cb9bbf267226cd2
Jul 09 18:48:44.332872 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:44.332853    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gp5lw"]
Jul 09 18:48:45.113030 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:45.112988    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb" event={"ID":"21c7af88-6c11-4b42-8a98-e3d23f705c15","Type":"ContainerStarted","Data":"12a9568ba2311d52e3db1db7c3cedd0537d70967a54468ad816d75ce9c010ba6"}
Jul 09 18:48:45.113475 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:45.113074    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb" event={"ID":"21c7af88-6c11-4b42-8a98-e3d23f705c15","Type":"ContainerStarted","Data":"7552700f2f00b71c6af490aa1bcc42a6b15ebf477a60acc38264196c5ec7dbac"}
Jul 09 18:48:45.113475 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:45.113097    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"
Jul 09 18:48:45.114188 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:45.114168    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gp5lw" event={"ID":"7d57e33b-dd0c-45b0-a38a-2a263eb205fb","Type":"ContainerStarted","Data":"6ee79d2c9bbdb7f3cab4f04a9d3a0c224f25018ead1e5d526cb9bbf267226cd2"}
Jul 09 18:48:45.116472 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:45.116446    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh" podUID="bb04c7fe-370e-48de-b1b9-f870f8c0bfb3" containerName="manager" containerID="cri-o://1abe4dc3b56862019c6f5900b0b35511ecdbd51d9cbd78c627ffab726908b28d" gracePeriod=2
Jul 09 18:48:45.138229 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:45.138190    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb" podStartSLOduration=2.138175366 podStartE2EDuration="2.138175366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:48:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:48:45.135264968 +0000 UTC m=+459.496412148" watchObservedRunningTime="2026-07-09 18:48:45.138175366 +0000 UTC m=+459.499322546"
Jul 09 18:48:45.373442 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:45.373391    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"
Jul 09 18:48:45.376023 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:48:45.375995    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-tfxxh\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="bb04c7fe-370e-48de-b1b9-f870f8c0bfb3" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"
Jul 09 18:48:45.474415 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:45.474385    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57cfw\" (UniqueName: \"kubernetes.io/projected/bb04c7fe-370e-48de-b1b9-f870f8c0bfb3-kube-api-access-57cfw\") pod \"bb04c7fe-370e-48de-b1b9-f870f8c0bfb3\" (UID: \"bb04c7fe-370e-48de-b1b9-f870f8c0bfb3\") "
Jul 09 18:48:45.474572 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:45.474446    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb04c7fe-370e-48de-b1b9-f870f8c0bfb3-extensions-socket-volume\") pod \"bb04c7fe-370e-48de-b1b9-f870f8c0bfb3\" (UID: \"bb04c7fe-370e-48de-b1b9-f870f8c0bfb3\") "
Jul 09 18:48:45.474780 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:45.474753    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb04c7fe-370e-48de-b1b9-f870f8c0bfb3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bb04c7fe-370e-48de-b1b9-f870f8c0bfb3" (UID: "bb04c7fe-370e-48de-b1b9-f870f8c0bfb3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:48:45.476861 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:45.476838    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb04c7fe-370e-48de-b1b9-f870f8c0bfb3-kube-api-access-57cfw" (OuterVolumeSpecName: "kube-api-access-57cfw") pod "bb04c7fe-370e-48de-b1b9-f870f8c0bfb3" (UID: "bb04c7fe-370e-48de-b1b9-f870f8c0bfb3"). InnerVolumeSpecName "kube-api-access-57cfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:48:45.575088 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:45.575056    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57cfw\" (UniqueName: \"kubernetes.io/projected/bb04c7fe-370e-48de-b1b9-f870f8c0bfb3-kube-api-access-57cfw\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:45.575088 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:45.575094    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb04c7fe-370e-48de-b1b9-f870f8c0bfb3-extensions-socket-volume\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:48:46.123235 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:46.123201    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gp5lw" event={"ID":"7d57e33b-dd0c-45b0-a38a-2a263eb205fb","Type":"ContainerStarted","Data":"ab4e364a20e9b7d9cd3a05272084de469e113192d567afbec18b54d73b0ef46c"}
Jul 09 18:48:46.123608 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:46.123362    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gp5lw"
Jul 09 18:48:46.124701 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:46.124681    2562 generic.go:356] "Generic (PLEG): container finished" podID="bb04c7fe-370e-48de-b1b9-f870f8c0bfb3" containerID="1abe4dc3b56862019c6f5900b0b35511ecdbd51d9cbd78c627ffab726908b28d" exitCode=2
Jul 09 18:48:46.124771 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:46.124724    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"
Jul 09 18:48:46.124771 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:46.124757    2562 scope.go:117] "RemoveContainer" containerID="1abe4dc3b56862019c6f5900b0b35511ecdbd51d9cbd78c627ffab726908b28d"
Jul 09 18:48:46.125567 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:48:46.125544    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-tfxxh\" is forbidden: User \"system:node:ip-10-0-141-47.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-47.ec2.internal' and this object" podUID="bb04c7fe-370e-48de-b1b9-f870f8c0bfb3" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-tfxxh"
Jul 09 18:48:46.133933 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:46.133919    2562 scope.go:117] "RemoveContainer" containerID="1abe4dc3b56862019c6f5900b0b35511ecdbd51d9cbd78c627ffab726908b28d"
Jul 09 18:48:46.134193 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:48:46.134178    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1abe4dc3b56862019c6f5900b0b35511ecdbd51d9cbd78c627ffab726908b28d\": container with ID starting with 1abe4dc3b56862019c6f5900b0b35511ecdbd51d9cbd78c627ffab726908b28d not found: ID does not exist" containerID="1abe4dc3b56862019c6f5900b0b35511ecdbd51d9cbd78c627ffab726908b28d"
Jul 09 18:48:46.134243 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:46.134200    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1abe4dc3b56862019c6f5900b0b35511ecdbd51d9cbd78c627ffab726908b28d"} err="failed to get container status \"1abe4dc3b56862019c6f5900b0b35511ecdbd51d9cbd78c627ffab726908b28d\": rpc error: code = NotFound desc = could not find container \"1abe4dc3b56862019c6f5900b0b35511ecdbd51d9cbd78c627ffab726908b28d\": container with ID starting with 1abe4dc3b56862019c6f5900b0b35511ecdbd51d9cbd78c627ffab726908b28d not found: ID does not exist"
Jul 09 18:48:46.153101 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:46.153081    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="528b9df1-a9d2-42cb-b5cf-7af456ad4e7d" path="/var/lib/kubelet/pods/528b9df1-a9d2-42cb-b5cf-7af456ad4e7d/volumes"
Jul 09 18:48:46.153480 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:46.153462    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b448d79e-f6b9-4496-905b-04256e6f7440" path="/var/lib/kubelet/pods/b448d79e-f6b9-4496-905b-04256e6f7440/volumes"
Jul 09 18:48:46.153802 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:46.153785    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb04c7fe-370e-48de-b1b9-f870f8c0bfb3" path="/var/lib/kubelet/pods/bb04c7fe-370e-48de-b1b9-f870f8c0bfb3/volumes"
Jul 09 18:48:46.159620 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:46.159569    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gp5lw" podStartSLOduration=1.546706644 podStartE2EDuration="3.159557292s" totalImagesPullingTime="1.612850648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:48:46.157165359 +0000 UTC m=+460.518312540" watchObservedRunningTime="2026-07-09 18:48:46.159557292 +0000 UTC m=+460.520704537"
Jul 09 18:48:56.127875 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:56.127840    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"
Jul 09 18:48:56.488554 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:56.488527    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"]
Jul 09 18:48:56.493258 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:56.493237    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"
Jul 09 18:48:56.514247 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:56.514225    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"]
Jul 09 18:48:56.565976 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:56.565942    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfpkv\" (UniqueName: \"kubernetes.io/projected/4455b2bd-e1b5-467d-8679-a1c7b638fe21-kube-api-access-sfpkv\") pod \"kuadrant-operator-controller-manager-86878c769f-kg6zr\" (UID: \"4455b2bd-e1b5-467d-8679-a1c7b638fe21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"
Jul 09 18:48:56.566090 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:56.565997    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4455b2bd-e1b5-467d-8679-a1c7b638fe21-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kg6zr\" (UID: \"4455b2bd-e1b5-467d-8679-a1c7b638fe21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"
Jul 09 18:48:56.667250 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:56.667221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4455b2bd-e1b5-467d-8679-a1c7b638fe21-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kg6zr\" (UID: \"4455b2bd-e1b5-467d-8679-a1c7b638fe21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"
Jul 09 18:48:56.667360 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:56.667298    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfpkv\" (UniqueName: \"kubernetes.io/projected/4455b2bd-e1b5-467d-8679-a1c7b638fe21-kube-api-access-sfpkv\") pod \"kuadrant-operator-controller-manager-86878c769f-kg6zr\" (UID: \"4455b2bd-e1b5-467d-8679-a1c7b638fe21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"
Jul 09 18:48:56.667553 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:56.667534    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4455b2bd-e1b5-467d-8679-a1c7b638fe21-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kg6zr\" (UID: \"4455b2bd-e1b5-467d-8679-a1c7b638fe21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"
Jul 09 18:48:56.694437 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:56.694377    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfpkv\" (UniqueName: \"kubernetes.io/projected/4455b2bd-e1b5-467d-8679-a1c7b638fe21-kube-api-access-sfpkv\") pod \"kuadrant-operator-controller-manager-86878c769f-kg6zr\" (UID: \"4455b2bd-e1b5-467d-8679-a1c7b638fe21\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"
Jul 09 18:48:56.803388 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:56.803360    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"
Jul 09 18:48:56.941181 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:56.941156    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"]
Jul 09 18:48:56.943736 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:48:56.943702    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4455b2bd_e1b5_467d_8679_a1c7b638fe21.slice/crio-a1945ed2bfc7bb0e3108418c08bab7b80e639c079b6a3f3c64fea76f395992c2 WatchSource:0}: Error finding container a1945ed2bfc7bb0e3108418c08bab7b80e639c079b6a3f3c64fea76f395992c2: Status 404 returned error can't find the container with id a1945ed2bfc7bb0e3108418c08bab7b80e639c079b6a3f3c64fea76f395992c2
Jul 09 18:48:57.132624 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:57.132599    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gp5lw"
Jul 09 18:48:57.183326 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:57.183290    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr" event={"ID":"4455b2bd-e1b5-467d-8679-a1c7b638fe21","Type":"ContainerStarted","Data":"ce92a13e3f2143ab5583fa86cb5de59f64d44beaa68fb9c6e23e9e5213dd0486"}
Jul 09 18:48:57.183478 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:57.183349    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr" event={"ID":"4455b2bd-e1b5-467d-8679-a1c7b638fe21","Type":"ContainerStarted","Data":"a1945ed2bfc7bb0e3108418c08bab7b80e639c079b6a3f3c64fea76f395992c2"}
Jul 09 18:48:57.183478 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:57.183377    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"
Jul 09 18:48:57.214125 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:48:57.214034    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr" podStartSLOduration=1.21401768 podStartE2EDuration="1.21401768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:48:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:48:57.212787548 +0000 UTC m=+471.573934728" watchObservedRunningTime="2026-07-09 18:48:57.21401768 +0000 UTC m=+471.575164861"
Jul 09 18:49:08.190303 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:08.190270    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"
Jul 09 18:49:08.285236 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:08.285204    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"]
Jul 09 18:49:08.285404 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:08.285381    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb" podUID="21c7af88-6c11-4b42-8a98-e3d23f705c15" containerName="manager" containerID="cri-o://12a9568ba2311d52e3db1db7c3cedd0537d70967a54468ad816d75ce9c010ba6" gracePeriod=10
Jul 09 18:49:08.529222 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:08.529202    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"
Jul 09 18:49:08.550670 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:08.550648    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hcsl\" (UniqueName: \"kubernetes.io/projected/21c7af88-6c11-4b42-8a98-e3d23f705c15-kube-api-access-8hcsl\") pod \"21c7af88-6c11-4b42-8a98-e3d23f705c15\" (UID: \"21c7af88-6c11-4b42-8a98-e3d23f705c15\") "
Jul 09 18:49:08.550775 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:08.550699    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21c7af88-6c11-4b42-8a98-e3d23f705c15-extensions-socket-volume\") pod \"21c7af88-6c11-4b42-8a98-e3d23f705c15\" (UID: \"21c7af88-6c11-4b42-8a98-e3d23f705c15\") "
Jul 09 18:49:08.551059 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:08.551038    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c7af88-6c11-4b42-8a98-e3d23f705c15-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "21c7af88-6c11-4b42-8a98-e3d23f705c15" (UID: "21c7af88-6c11-4b42-8a98-e3d23f705c15"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:49:08.552727 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:08.552703    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21c7af88-6c11-4b42-8a98-e3d23f705c15-kube-api-access-8hcsl" (OuterVolumeSpecName: "kube-api-access-8hcsl") pod "21c7af88-6c11-4b42-8a98-e3d23f705c15" (UID: "21c7af88-6c11-4b42-8a98-e3d23f705c15"). InnerVolumeSpecName "kube-api-access-8hcsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:49:08.651793 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:08.651764    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hcsl\" (UniqueName: \"kubernetes.io/projected/21c7af88-6c11-4b42-8a98-e3d23f705c15-kube-api-access-8hcsl\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:49:08.651793 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:08.651788    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/21c7af88-6c11-4b42-8a98-e3d23f705c15-extensions-socket-volume\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:49:09.240342 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:09.240301    2562 generic.go:356] "Generic (PLEG): container finished" podID="21c7af88-6c11-4b42-8a98-e3d23f705c15" containerID="12a9568ba2311d52e3db1db7c3cedd0537d70967a54468ad816d75ce9c010ba6" exitCode=0
Jul 09 18:49:09.240716 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:09.240348    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"
Jul 09 18:49:09.240716 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:09.240342    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb" event={"ID":"21c7af88-6c11-4b42-8a98-e3d23f705c15","Type":"ContainerDied","Data":"12a9568ba2311d52e3db1db7c3cedd0537d70967a54468ad816d75ce9c010ba6"}
Jul 09 18:49:09.240716 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:09.240465    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb" event={"ID":"21c7af88-6c11-4b42-8a98-e3d23f705c15","Type":"ContainerDied","Data":"7552700f2f00b71c6af490aa1bcc42a6b15ebf477a60acc38264196c5ec7dbac"}
Jul 09 18:49:09.240716 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:09.240486    2562 scope.go:117] "RemoveContainer" containerID="12a9568ba2311d52e3db1db7c3cedd0537d70967a54468ad816d75ce9c010ba6"
Jul 09 18:49:09.249981 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:09.249966    2562 scope.go:117] "RemoveContainer" containerID="12a9568ba2311d52e3db1db7c3cedd0537d70967a54468ad816d75ce9c010ba6"
Jul 09 18:49:09.250267 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:49:09.250251    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12a9568ba2311d52e3db1db7c3cedd0537d70967a54468ad816d75ce9c010ba6\": container with ID starting with 12a9568ba2311d52e3db1db7c3cedd0537d70967a54468ad816d75ce9c010ba6 not found: ID does not exist" containerID="12a9568ba2311d52e3db1db7c3cedd0537d70967a54468ad816d75ce9c010ba6"
Jul 09 18:49:09.250315 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:09.250274    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12a9568ba2311d52e3db1db7c3cedd0537d70967a54468ad816d75ce9c010ba6"} err="failed to get container status \"12a9568ba2311d52e3db1db7c3cedd0537d70967a54468ad816d75ce9c010ba6\": rpc error: code = NotFound desc = could not find container \"12a9568ba2311d52e3db1db7c3cedd0537d70967a54468ad816d75ce9c010ba6\": container with ID starting with 12a9568ba2311d52e3db1db7c3cedd0537d70967a54468ad816d75ce9c010ba6 not found: ID does not exist"
Jul 09 18:49:09.282783 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:09.282759    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"]
Jul 09 18:49:09.289730 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:09.289705    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-457jb"]
Jul 09 18:49:10.152839 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:49:10.152809    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21c7af88-6c11-4b42-8a98-e3d23f705c15" path="/var/lib/kubelet/pods/21c7af88-6c11-4b42-8a98-e3d23f705c15/volumes"
Jul 09 18:51:04.768214 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:04.768179    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"]
Jul 09 18:51:04.768604 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:04.768493    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c7af88-6c11-4b42-8a98-e3d23f705c15" containerName="manager"
Jul 09 18:51:04.768604 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:04.768508    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c7af88-6c11-4b42-8a98-e3d23f705c15" containerName="manager"
Jul 09 18:51:04.768604 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:04.768590    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="21c7af88-6c11-4b42-8a98-e3d23f705c15" containerName="manager"
Jul 09 18:51:04.771544 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:04.771529    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:04.774533 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:04.774514    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 18:51:04.775681 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:04.775659    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 09 18:51:04.775870 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:04.775852    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gqjpx\""
Jul 09 18:51:04.775949 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:04.775859    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 18:51:04.783166 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:04.783121    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"]
Jul 09 18:51:04.923598 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:04.923564    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2291855-afd9-4c14-8bea-49dd71ef6927-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:04.923598 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:04.923601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2291855-afd9-4c14-8bea-49dd71ef6927-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:04.923834 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:04.923622    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2291855-afd9-4c14-8bea-49dd71ef6927-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:04.923834 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:04.923646    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2291855-afd9-4c14-8bea-49dd71ef6927-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:04.923834 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:04.923711    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2291855-afd9-4c14-8bea-49dd71ef6927-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:04.923834 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:04.923785    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cclxq\" (UniqueName: \"kubernetes.io/projected/f2291855-afd9-4c14-8bea-49dd71ef6927-kube-api-access-cclxq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:05.024482 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:05.024410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2291855-afd9-4c14-8bea-49dd71ef6927-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:05.024482 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:05.024448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2291855-afd9-4c14-8bea-49dd71ef6927-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:05.024482 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:05.024476    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2291855-afd9-4c14-8bea-49dd71ef6927-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:05.024699 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:05.024513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2291855-afd9-4c14-8bea-49dd71ef6927-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:05.024699 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:05.024546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2291855-afd9-4c14-8bea-49dd71ef6927-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:05.024699 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:05.024576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cclxq\" (UniqueName: \"kubernetes.io/projected/f2291855-afd9-4c14-8bea-49dd71ef6927-kube-api-access-cclxq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:05.024880 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:05.024855    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2291855-afd9-4c14-8bea-49dd71ef6927-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:05.024932 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:05.024890    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f2291855-afd9-4c14-8bea-49dd71ef6927-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:05.024968 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:05.024955    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f2291855-afd9-4c14-8bea-49dd71ef6927-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:05.026961 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:05.026934    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f2291855-afd9-4c14-8bea-49dd71ef6927-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:05.027173 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:05.027121    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2291855-afd9-4c14-8bea-49dd71ef6927-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:05.038591 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:05.038570    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cclxq\" (UniqueName: \"kubernetes.io/projected/f2291855-afd9-4c14-8bea-49dd71ef6927-kube-api-access-cclxq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv\" (UID: \"f2291855-afd9-4c14-8bea-49dd71ef6927\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:05.082628 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:05.082602    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:05.219860 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:05.219824    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"]
Jul 09 18:51:05.221339 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:51:05.221313    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2291855_afd9_4c14_8bea_49dd71ef6927.slice/crio-1cdf7fbaf2445958117a94b7ec591c4a3ad3ae33fcb252f472bd5d21db4ad180 WatchSource:0}: Error finding container 1cdf7fbaf2445958117a94b7ec591c4a3ad3ae33fcb252f472bd5d21db4ad180: Status 404 returned error can't find the container with id 1cdf7fbaf2445958117a94b7ec591c4a3ad3ae33fcb252f472bd5d21db4ad180
Jul 09 18:51:05.814344 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:05.814295    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv" event={"ID":"f2291855-afd9-4c14-8bea-49dd71ef6927","Type":"ContainerStarted","Data":"1cdf7fbaf2445958117a94b7ec591c4a3ad3ae33fcb252f472bd5d21db4ad180"}
Jul 09 18:51:06.383498 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:06.383402    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 18:51:06.393074 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:06.384062    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 18:51:06.821187 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:06.821151    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv" event={"ID":"f2291855-afd9-4c14-8bea-49dd71ef6927","Type":"ContainerStarted","Data":"6dea8ff1a181d5c4f73ac427e9bbf1f49fce8adfb27856b334d93fcdfc86c36e"}
Jul 09 18:51:06.841957 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:06.841910    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv" podStartSLOduration=1.651256524 podStartE2EDuration="2.841894528s" totalImagesPullingTime="1.190638004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:51:06.839850625 +0000 UTC m=+601.200997807" watchObservedRunningTime="2026-07-09 18:51:06.841894528 +0000 UTC m=+601.203041707"
Jul 09 18:51:15.083645 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:15.083614    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:15.084099 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:15.083708    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:15.096464 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:15.096438    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:15.877431 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:15.877398    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv"
Jul 09 18:51:32.561955 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.561880    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"]
Jul 09 18:51:32.564929 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.564912    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.567788 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.567765    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 09 18:51:32.577185 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.577163    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"]
Jul 09 18:51:32.646869 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.646838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn2pt\" (UniqueName: \"kubernetes.io/projected/abae2b00-f04a-454c-956b-abf14f1e7a79-kube-api-access-mn2pt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.647011 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.646880    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abae2b00-f04a-454c-956b-abf14f1e7a79-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.647011 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.646920    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abae2b00-f04a-454c-956b-abf14f1e7a79-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.647011 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.646950    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abae2b00-f04a-454c-956b-abf14f1e7a79-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.647011 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.646964    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abae2b00-f04a-454c-956b-abf14f1e7a79-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.647011 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.646981    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abae2b00-f04a-454c-956b-abf14f1e7a79-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.747775 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.747748    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn2pt\" (UniqueName: \"kubernetes.io/projected/abae2b00-f04a-454c-956b-abf14f1e7a79-kube-api-access-mn2pt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.747920 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.747789    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abae2b00-f04a-454c-956b-abf14f1e7a79-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.747920 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.747820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abae2b00-f04a-454c-956b-abf14f1e7a79-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.747920 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.747859    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abae2b00-f04a-454c-956b-abf14f1e7a79-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.747920 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.747882    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abae2b00-f04a-454c-956b-abf14f1e7a79-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.747920 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.747912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abae2b00-f04a-454c-956b-abf14f1e7a79-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.748260 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.748240    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/abae2b00-f04a-454c-956b-abf14f1e7a79-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.748328 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.748259    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abae2b00-f04a-454c-956b-abf14f1e7a79-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.748328 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.748291    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/abae2b00-f04a-454c-956b-abf14f1e7a79-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.750315 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.750289    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/abae2b00-f04a-454c-956b-abf14f1e7a79-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.750682 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.750662    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abae2b00-f04a-454c-956b-abf14f1e7a79-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.757746 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.757724    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn2pt\" (UniqueName: \"kubernetes.io/projected/abae2b00-f04a-454c-956b-abf14f1e7a79-kube-api-access-mn2pt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sghmf\" (UID: \"abae2b00-f04a-454c-956b-abf14f1e7a79\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:32.875986 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:32.875915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:33.015996 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:33.015970    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"]
Jul 09 18:51:33.017986 ip-10-0-141-47 kubenswrapper[2562]: W0709 18:51:33.017959    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabae2b00_f04a_454c_956b_abf14f1e7a79.slice/crio-8b7400a6657c1db7452268ab8eecc54136f9d259d84307a476e10c750a50dfdc WatchSource:0}: Error finding container 8b7400a6657c1db7452268ab8eecc54136f9d259d84307a476e10c750a50dfdc: Status 404 returned error can't find the container with id 8b7400a6657c1db7452268ab8eecc54136f9d259d84307a476e10c750a50dfdc
Jul 09 18:51:33.019261 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:33.019242    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 18:51:33.957839 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:33.957803    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf" event={"ID":"abae2b00-f04a-454c-956b-abf14f1e7a79","Type":"ContainerStarted","Data":"a52bb880e2a46b0bf7e10abe0f57e435fd58e444cca877ba6b09102091a2a9f8"}
Jul 09 18:51:33.958268 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:33.957854    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf" event={"ID":"abae2b00-f04a-454c-956b-abf14f1e7a79","Type":"ContainerStarted","Data":"8b7400a6657c1db7452268ab8eecc54136f9d259d84307a476e10c750a50dfdc"}
Jul 09 18:51:33.992683 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:33.992629    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf" podStartSLOduration=1.795907171 podStartE2EDuration="1.992610835s" totalImagesPullingTime="196.703664ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:51:33.991729229 +0000 UTC m=+628.352876409" watchObservedRunningTime="2026-07-09 18:51:33.992610835 +0000 UTC m=+628.353758019"
Jul 09 18:51:42.876319 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:42.876284    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:42.876734 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:42.876355    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:42.888230 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:42.888202    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:51:43.013513 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:51:43.013486    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sghmf"
Jul 09 18:56:06.418381 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:56:06.418286    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 18:56:06.418381 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:56:06.418290    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 18:59:19.664638 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:19.664563    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"]
Jul 09 18:59:19.665133 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:19.664771    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr" podUID="4455b2bd-e1b5-467d-8679-a1c7b638fe21" containerName="manager" containerID="cri-o://ce92a13e3f2143ab5583fa86cb5de59f64d44beaa68fb9c6e23e9e5213dd0486" gracePeriod=10
Jul 09 18:59:22.912192 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:22.912168    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"
Jul 09 18:59:22.990310 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:22.990241    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfpkv\" (UniqueName: \"kubernetes.io/projected/4455b2bd-e1b5-467d-8679-a1c7b638fe21-kube-api-access-sfpkv\") pod \"4455b2bd-e1b5-467d-8679-a1c7b638fe21\" (UID: \"4455b2bd-e1b5-467d-8679-a1c7b638fe21\") "
Jul 09 18:59:22.990310 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:22.990296    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4455b2bd-e1b5-467d-8679-a1c7b638fe21-extensions-socket-volume\") pod \"4455b2bd-e1b5-467d-8679-a1c7b638fe21\" (UID: \"4455b2bd-e1b5-467d-8679-a1c7b638fe21\") "
Jul 09 18:59:22.990670 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:22.990645    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4455b2bd-e1b5-467d-8679-a1c7b638fe21-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4455b2bd-e1b5-467d-8679-a1c7b638fe21" (UID: "4455b2bd-e1b5-467d-8679-a1c7b638fe21"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 18:59:22.992434 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:22.992410    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4455b2bd-e1b5-467d-8679-a1c7b638fe21-kube-api-access-sfpkv" (OuterVolumeSpecName: "kube-api-access-sfpkv") pod "4455b2bd-e1b5-467d-8679-a1c7b638fe21" (UID: "4455b2bd-e1b5-467d-8679-a1c7b638fe21"). InnerVolumeSpecName "kube-api-access-sfpkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 18:59:23.091101 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:23.091075    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfpkv\" (UniqueName: \"kubernetes.io/projected/4455b2bd-e1b5-467d-8679-a1c7b638fe21-kube-api-access-sfpkv\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:59:23.091101 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:23.091097    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4455b2bd-e1b5-467d-8679-a1c7b638fe21-extensions-socket-volume\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 18:59:23.263999 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:23.263965    2562 generic.go:356] "Generic (PLEG): container finished" podID="4455b2bd-e1b5-467d-8679-a1c7b638fe21" containerID="ce92a13e3f2143ab5583fa86cb5de59f64d44beaa68fb9c6e23e9e5213dd0486" exitCode=0
Jul 09 18:59:23.264191 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:23.264017    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"
Jul 09 18:59:23.264191 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:23.264051    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr" event={"ID":"4455b2bd-e1b5-467d-8679-a1c7b638fe21","Type":"ContainerDied","Data":"ce92a13e3f2143ab5583fa86cb5de59f64d44beaa68fb9c6e23e9e5213dd0486"}
Jul 09 18:59:23.264191 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:23.264103    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr" event={"ID":"4455b2bd-e1b5-467d-8679-a1c7b638fe21","Type":"ContainerDied","Data":"a1945ed2bfc7bb0e3108418c08bab7b80e639c079b6a3f3c64fea76f395992c2"}
Jul 09 18:59:23.264191 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:23.264126    2562 scope.go:117] "RemoveContainer" containerID="ce92a13e3f2143ab5583fa86cb5de59f64d44beaa68fb9c6e23e9e5213dd0486"
Jul 09 18:59:23.273405 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:23.273391    2562 scope.go:117] "RemoveContainer" containerID="ce92a13e3f2143ab5583fa86cb5de59f64d44beaa68fb9c6e23e9e5213dd0486"
Jul 09 18:59:23.273665 ip-10-0-141-47 kubenswrapper[2562]: E0709 18:59:23.273648    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce92a13e3f2143ab5583fa86cb5de59f64d44beaa68fb9c6e23e9e5213dd0486\": container with ID starting with ce92a13e3f2143ab5583fa86cb5de59f64d44beaa68fb9c6e23e9e5213dd0486 not found: ID does not exist" containerID="ce92a13e3f2143ab5583fa86cb5de59f64d44beaa68fb9c6e23e9e5213dd0486"
Jul 09 18:59:23.273729 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:23.273673    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce92a13e3f2143ab5583fa86cb5de59f64d44beaa68fb9c6e23e9e5213dd0486"} err="failed to get container status \"ce92a13e3f2143ab5583fa86cb5de59f64d44beaa68fb9c6e23e9e5213dd0486\": rpc error: code = NotFound desc = could not find container \"ce92a13e3f2143ab5583fa86cb5de59f64d44beaa68fb9c6e23e9e5213dd0486\": container with ID starting with ce92a13e3f2143ab5583fa86cb5de59f64d44beaa68fb9c6e23e9e5213dd0486 not found: ID does not exist"
Jul 09 18:59:23.287864 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:23.287840    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"]
Jul 09 18:59:23.292247 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:23.292228    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kg6zr"]
Jul 09 18:59:24.153093 ip-10-0-141-47 kubenswrapper[2562]: I0709 18:59:24.153059    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4455b2bd-e1b5-467d-8679-a1c7b638fe21" path="/var/lib/kubelet/pods/4455b2bd-e1b5-467d-8679-a1c7b638fe21/volumes"
Jul 09 19:00:00.159320 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:00.159289    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm"]
Jul 09 19:00:00.159791 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:00.159593    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4455b2bd-e1b5-467d-8679-a1c7b638fe21" containerName="manager"
Jul 09 19:00:00.159791 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:00.159603    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4455b2bd-e1b5-467d-8679-a1c7b638fe21" containerName="manager"
Jul 09 19:00:00.159791 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:00.159652    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4455b2bd-e1b5-467d-8679-a1c7b638fe21" containerName="manager"
Jul 09 19:00:00.162477 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:00.162459    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm"
Jul 09 19:00:00.165466 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:00.165439    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:00:00.165591 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:00.165468    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jq94v\""
Jul 09 19:00:00.165591 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:00.165565    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:00:00.173614 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:00.173587    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm"]
Jul 09 19:00:00.277556 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:00.277512    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zzrr\" (UniqueName: \"kubernetes.io/projected/0609de63-0eb8-480e-be71-9d094e49ddb2-kube-api-access-5zzrr\") pod \"maas-api-key-cleanup-29727060-ps5cm\" (UID: \"0609de63-0eb8-480e-be71-9d094e49ddb2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm"
Jul 09 19:00:00.378352 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:00.378310    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zzrr\" (UniqueName: \"kubernetes.io/projected/0609de63-0eb8-480e-be71-9d094e49ddb2-kube-api-access-5zzrr\") pod \"maas-api-key-cleanup-29727060-ps5cm\" (UID: \"0609de63-0eb8-480e-be71-9d094e49ddb2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm"
Jul 09 19:00:00.389472 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:00.389444    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zzrr\" (UniqueName: \"kubernetes.io/projected/0609de63-0eb8-480e-be71-9d094e49ddb2-kube-api-access-5zzrr\") pod \"maas-api-key-cleanup-29727060-ps5cm\" (UID: \"0609de63-0eb8-480e-be71-9d094e49ddb2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm"
Jul 09 19:00:00.472777 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:00.472695    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm"
Jul 09 19:00:00.607054 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:00.607030    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm"]
Jul 09 19:00:00.608954 ip-10-0-141-47 kubenswrapper[2562]: W0709 19:00:00.608925    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0609de63_0eb8_480e_be71_9d094e49ddb2.slice/crio-9b526a06fa166143d242b21ed135ae3e2aaaec8258370ba7f527a06e4226ae6a WatchSource:0}: Error finding container 9b526a06fa166143d242b21ed135ae3e2aaaec8258370ba7f527a06e4226ae6a: Status 404 returned error can't find the container with id 9b526a06fa166143d242b21ed135ae3e2aaaec8258370ba7f527a06e4226ae6a
Jul 09 19:00:00.610926 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:00.610906    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:00:01.456920 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:01.456884    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm" event={"ID":"0609de63-0eb8-480e-be71-9d094e49ddb2","Type":"ContainerStarted","Data":"9b526a06fa166143d242b21ed135ae3e2aaaec8258370ba7f527a06e4226ae6a"}
Jul 09 19:00:07.487518 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:07.487487    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm" event={"ID":"0609de63-0eb8-480e-be71-9d094e49ddb2","Type":"ContainerStarted","Data":"451d6594453068d74ce5b6887db28d60477d4b226550f223bdbc7bb5aedecc76"}
Jul 09 19:00:07.508009 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:07.507962    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm" podStartSLOduration=1.8269658149999999 podStartE2EDuration="7.507948941s" totalImagesPullingTime="5.680983126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:07.505846356 +0000 UTC m=+1141.866993540" watchObservedRunningTime="2026-07-09 19:00:07.507948941 +0000 UTC m=+1141.869096179"
Jul 09 19:00:20.841595 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:20.841567    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85r5m"]
Jul 09 19:00:20.843947 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:20.843932    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85r5m"
Jul 09 19:00:20.846940 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:20.846920    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5ncwd\""
Jul 09 19:00:20.862716 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:20.862695    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85r5m"]
Jul 09 19:00:20.946660 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:20.946635    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5js9\" (UniqueName: \"kubernetes.io/projected/036b8ff4-e821-41f4-8e5a-d78073a534c8-kube-api-access-p5js9\") pod \"kuadrant-operator-controller-manager-86878c769f-85r5m\" (UID: \"036b8ff4-e821-41f4-8e5a-d78073a534c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85r5m"
Jul 09 19:00:20.946771 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:20.946723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/036b8ff4-e821-41f4-8e5a-d78073a534c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-85r5m\" (UID: \"036b8ff4-e821-41f4-8e5a-d78073a534c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85r5m"
Jul 09 19:00:21.047416 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:21.047386    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5js9\" (UniqueName: \"kubernetes.io/projected/036b8ff4-e821-41f4-8e5a-d78073a534c8-kube-api-access-p5js9\") pod \"kuadrant-operator-controller-manager-86878c769f-85r5m\" (UID: \"036b8ff4-e821-41f4-8e5a-d78073a534c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85r5m"
Jul 09 19:00:21.047548 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:21.047482    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/036b8ff4-e821-41f4-8e5a-d78073a534c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-85r5m\" (UID: \"036b8ff4-e821-41f4-8e5a-d78073a534c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85r5m"
Jul 09 19:00:21.047867 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:21.047851    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/036b8ff4-e821-41f4-8e5a-d78073a534c8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-85r5m\" (UID: \"036b8ff4-e821-41f4-8e5a-d78073a534c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85r5m"
Jul 09 19:00:21.060978 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:21.060957    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5js9\" (UniqueName: \"kubernetes.io/projected/036b8ff4-e821-41f4-8e5a-d78073a534c8-kube-api-access-p5js9\") pod \"kuadrant-operator-controller-manager-86878c769f-85r5m\" (UID: \"036b8ff4-e821-41f4-8e5a-d78073a534c8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85r5m"
Jul 09 19:00:21.154275 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:21.154210    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85r5m"
Jul 09 19:00:21.294821 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:21.294797    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85r5m"]
Jul 09 19:00:21.298911 ip-10-0-141-47 kubenswrapper[2562]: W0709 19:00:21.298883    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod036b8ff4_e821_41f4_8e5a_d78073a534c8.slice/crio-a130af72394d8008cdbc128281da6720f0a107146205478f310263890d2088c2 WatchSource:0}: Error finding container a130af72394d8008cdbc128281da6720f0a107146205478f310263890d2088c2: Status 404 returned error can't find the container with id a130af72394d8008cdbc128281da6720f0a107146205478f310263890d2088c2
Jul 09 19:00:21.554432 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:21.554396    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85r5m" event={"ID":"036b8ff4-e821-41f4-8e5a-d78073a534c8","Type":"ContainerStarted","Data":"e664520d882b1cc21ebd8b4f94a1f5a685918dde5e591eca1fe9ca6d0f392aab"}
Jul 09 19:00:21.554637 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:21.554457    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85r5m" event={"ID":"036b8ff4-e821-41f4-8e5a-d78073a534c8","Type":"ContainerStarted","Data":"a130af72394d8008cdbc128281da6720f0a107146205478f310263890d2088c2"}
Jul 09 19:00:21.554637 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:21.554521    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85r5m"
Jul 09 19:00:21.624953 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:21.624876    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85r5m" podStartSLOduration=1.624860717 podStartE2EDuration="1.624860717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:00:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:00:21.622096708 +0000 UTC m=+1155.983243891" watchObservedRunningTime="2026-07-09 19:00:21.624860717 +0000 UTC m=+1155.986007961"
Jul 09 19:00:32.561399 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:00:32.561309    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-85r5m"
Jul 09 19:01:00.012299 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:00.012264    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm"]
Jul 09 19:01:00.012749 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:00.012459    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm" podUID="0609de63-0eb8-480e-be71-9d094e49ddb2" containerName="cleanup" containerID="cri-o://451d6594453068d74ce5b6887db28d60477d4b226550f223bdbc7bb5aedecc76" gracePeriod=30
Jul 09 19:01:06.450056 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:06.449951    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 19:01:06.454874 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:06.450750    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 19:01:30.199556 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:30.199530    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm"
Jul 09 19:01:30.282390 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:30.282329    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zzrr\" (UniqueName: \"kubernetes.io/projected/0609de63-0eb8-480e-be71-9d094e49ddb2-kube-api-access-5zzrr\") pod \"0609de63-0eb8-480e-be71-9d094e49ddb2\" (UID: \"0609de63-0eb8-480e-be71-9d094e49ddb2\") "
Jul 09 19:01:30.284679 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:30.284648    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0609de63-0eb8-480e-be71-9d094e49ddb2-kube-api-access-5zzrr" (OuterVolumeSpecName: "kube-api-access-5zzrr") pod "0609de63-0eb8-480e-be71-9d094e49ddb2" (UID: "0609de63-0eb8-480e-be71-9d094e49ddb2"). InnerVolumeSpecName "kube-api-access-5zzrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:01:30.383638 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:30.383612    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zzrr\" (UniqueName: \"kubernetes.io/projected/0609de63-0eb8-480e-be71-9d094e49ddb2-kube-api-access-5zzrr\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:01:30.891729 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:30.891693    2562 generic.go:356] "Generic (PLEG): container finished" podID="0609de63-0eb8-480e-be71-9d094e49ddb2" containerID="451d6594453068d74ce5b6887db28d60477d4b226550f223bdbc7bb5aedecc76" exitCode=137
Jul 09 19:01:30.891960 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:30.891758    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm"
Jul 09 19:01:30.891960 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:30.891787    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm" event={"ID":"0609de63-0eb8-480e-be71-9d094e49ddb2","Type":"ContainerDied","Data":"451d6594453068d74ce5b6887db28d60477d4b226550f223bdbc7bb5aedecc76"}
Jul 09 19:01:30.891960 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:30.891853    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm" event={"ID":"0609de63-0eb8-480e-be71-9d094e49ddb2","Type":"ContainerDied","Data":"9b526a06fa166143d242b21ed135ae3e2aaaec8258370ba7f527a06e4226ae6a"}
Jul 09 19:01:30.891960 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:30.891873    2562 scope.go:117] "RemoveContainer" containerID="451d6594453068d74ce5b6887db28d60477d4b226550f223bdbc7bb5aedecc76"
Jul 09 19:01:30.900254 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:30.900239    2562 scope.go:117] "RemoveContainer" containerID="451d6594453068d74ce5b6887db28d60477d4b226550f223bdbc7bb5aedecc76"
Jul 09 19:01:30.900717 ip-10-0-141-47 kubenswrapper[2562]: E0709 19:01:30.900507    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"451d6594453068d74ce5b6887db28d60477d4b226550f223bdbc7bb5aedecc76\": container with ID starting with 451d6594453068d74ce5b6887db28d60477d4b226550f223bdbc7bb5aedecc76 not found: ID does not exist" containerID="451d6594453068d74ce5b6887db28d60477d4b226550f223bdbc7bb5aedecc76"
Jul 09 19:01:30.900717 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:30.900533    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"451d6594453068d74ce5b6887db28d60477d4b226550f223bdbc7bb5aedecc76"} err="failed to get container status \"451d6594453068d74ce5b6887db28d60477d4b226550f223bdbc7bb5aedecc76\": rpc error: code = NotFound desc = could not find container \"451d6594453068d74ce5b6887db28d60477d4b226550f223bdbc7bb5aedecc76\": container with ID starting with 451d6594453068d74ce5b6887db28d60477d4b226550f223bdbc7bb5aedecc76 not found: ID does not exist"
Jul 09 19:01:30.918908 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:30.918883    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm"]
Jul 09 19:01:30.920874 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:30.920855    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727060-ps5cm"]
Jul 09 19:01:32.152987 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:01:32.152956    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0609de63-0eb8-480e-be71-9d094e49ddb2" path="/var/lib/kubelet/pods/0609de63-0eb8-480e-be71-9d094e49ddb2/volumes"
Jul 09 19:06:06.483700 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:06:06.483588    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 19:06:06.487940 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:06:06.485642    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 19:11:06.516414 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:11:06.516390    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 19:11:06.519573 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:11:06.519551    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 19:15:00.152611 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.152572    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx"]
Jul 09 19:15:00.153234 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.153044    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0609de63-0eb8-480e-be71-9d094e49ddb2" containerName="cleanup"
Jul 09 19:15:00.153234 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.153064    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0609de63-0eb8-480e-be71-9d094e49ddb2" containerName="cleanup"
Jul 09 19:15:00.153234 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.153173    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0609de63-0eb8-480e-be71-9d094e49ddb2" containerName="cleanup"
Jul 09 19:15:00.156057 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.156037    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx"
Jul 09 19:15:00.159080 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.159058    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 19:15:00.160164 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.160125    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-jq94v\""
Jul 09 19:15:00.160261 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.160125    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 19:15:00.169819 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.169785    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx"]
Jul 09 19:15:00.316510 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.316463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xn9c\" (UniqueName: \"kubernetes.io/projected/90282418-1808-4d9c-908c-79dc9daaa337-kube-api-access-5xn9c\") pod \"maas-api-key-cleanup-29727075-nzjjx\" (UID: \"90282418-1808-4d9c-908c-79dc9daaa337\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx"
Jul 09 19:15:00.418032 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.417943    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xn9c\" (UniqueName: \"kubernetes.io/projected/90282418-1808-4d9c-908c-79dc9daaa337-kube-api-access-5xn9c\") pod \"maas-api-key-cleanup-29727075-nzjjx\" (UID: \"90282418-1808-4d9c-908c-79dc9daaa337\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx"
Jul 09 19:15:00.427700 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.427668    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xn9c\" (UniqueName: \"kubernetes.io/projected/90282418-1808-4d9c-908c-79dc9daaa337-kube-api-access-5xn9c\") pod \"maas-api-key-cleanup-29727075-nzjjx\" (UID: \"90282418-1808-4d9c-908c-79dc9daaa337\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx"
Jul 09 19:15:00.466571 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.466537    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx"
Jul 09 19:15:00.606214 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.605854    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx"]
Jul 09 19:15:00.608987 ip-10-0-141-47 kubenswrapper[2562]: W0709 19:15:00.608959    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90282418_1808_4d9c_908c_79dc9daaa337.slice/crio-d841f81dc92679315550b2a42e4c3bd366dde2934abdcafe0c282d1e44385294 WatchSource:0}: Error finding container d841f81dc92679315550b2a42e4c3bd366dde2934abdcafe0c282d1e44385294: Status 404 returned error can't find the container with id d841f81dc92679315550b2a42e4c3bd366dde2934abdcafe0c282d1e44385294
Jul 09 19:15:00.806636 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.806605    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx" event={"ID":"90282418-1808-4d9c-908c-79dc9daaa337","Type":"ContainerStarted","Data":"cb0d42dd4be94adf5f8ec1a105d972079edfecc9d4c59613aa1b0059679e4dba"}
Jul 09 19:15:00.806732 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.806668    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx" event={"ID":"90282418-1808-4d9c-908c-79dc9daaa337","Type":"ContainerStarted","Data":"d841f81dc92679315550b2a42e4c3bd366dde2934abdcafe0c282d1e44385294"}
Jul 09 19:15:00.823538 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:15:00.823489    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx" podStartSLOduration=0.823472374 podStartE2EDuration="823.472374ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:15:00.822655829 +0000 UTC m=+2035.183803008" watchObservedRunningTime="2026-07-09 19:15:00.823472374 +0000 UTC m=+2035.184619554"
Jul 09 19:16:00.013761 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:00.013727    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx"]
Jul 09 19:16:00.014303 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:00.013931    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx" podUID="90282418-1808-4d9c-908c-79dc9daaa337" containerName="cleanup" containerID="cri-o://cb0d42dd4be94adf5f8ec1a105d972079edfecc9d4c59613aa1b0059679e4dba" gracePeriod=30
Jul 09 19:16:06.546986 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:06.546884    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 19:16:06.551660 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:06.551638    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 19:16:18.460897 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.460865    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"]
Jul 09 19:16:18.464164 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.464125    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.466935 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.466916    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8d3645\"/\"test-model-8d3645-kserve-self-signed-certs\""
Jul 09 19:16:18.467041 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.466950    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8d3645\"/\"openshift-service-ca.crt\""
Jul 09 19:16:18.467967 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.467937    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-8d3645\"/\"kube-root-ca.crt\""
Jul 09 19:16:18.468044 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.467977    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-8d3645\"/\"default-dockercfg-lz9fk\""
Jul 09 19:16:18.476911 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.476890    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"]
Jul 09 19:16:18.544300 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.544272    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-model-cache\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.544454 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.544363    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-dshm\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.544454 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.544385    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blsch\" (UniqueName: \"kubernetes.io/projected/499f4daf-1d84-4da6-9862-a483b6d1e5a5-kube-api-access-blsch\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.544454 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.544405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-tmp-dir\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.544454 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.544427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/499f4daf-1d84-4da6-9862-a483b6d1e5a5-tls-certs\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.544454 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.544453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-home\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.645557 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.645532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-dshm\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.645702 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.645566    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blsch\" (UniqueName: \"kubernetes.io/projected/499f4daf-1d84-4da6-9862-a483b6d1e5a5-kube-api-access-blsch\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.645702 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.645586    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-tmp-dir\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.645702 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.645602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/499f4daf-1d84-4da6-9862-a483b6d1e5a5-tls-certs\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.645702 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.645631    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-home\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.645702 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.645675    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-model-cache\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.646059 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.646026    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-tmp-dir\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.646059 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.646053    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-model-cache\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.646200 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.646075    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-home\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.648009 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.647978    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-dshm\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.648105 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.648055    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/499f4daf-1d84-4da6-9862-a483b6d1e5a5-tls-certs\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.656445 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.656415    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blsch\" (UniqueName: \"kubernetes.io/projected/499f4daf-1d84-4da6-9862-a483b6d1e5a5-kube-api-access-blsch\") pod \"test-model-8d3645-kserve-5844946865-gm785\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") " pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.773987 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.773961    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:18.917440 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:18.917416    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"]
Jul 09 19:16:18.919282 ip-10-0-141-47 kubenswrapper[2562]: W0709 19:16:18.919253    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod499f4daf_1d84_4da6_9862_a483b6d1e5a5.slice/crio-f02bd222cf96b653ae0c69962e704d9f9500812198cf39bc7947dbc02a47352d WatchSource:0}: Error finding container f02bd222cf96b653ae0c69962e704d9f9500812198cf39bc7947dbc02a47352d: Status 404 returned error can't find the container with id f02bd222cf96b653ae0c69962e704d9f9500812198cf39bc7947dbc02a47352d
Jul 09 19:16:19.210427 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:19.210342    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785" event={"ID":"499f4daf-1d84-4da6-9862-a483b6d1e5a5","Type":"ContainerStarted","Data":"dea81d0ebc4cfe5f5de79ff7f3e6218894d2e21ae227ee6d16cdf211a631eefd"}
Jul 09 19:16:19.210427 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:19.210386    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785" event={"ID":"499f4daf-1d84-4da6-9862-a483b6d1e5a5","Type":"ContainerStarted","Data":"f02bd222cf96b653ae0c69962e704d9f9500812198cf39bc7947dbc02a47352d"}
Jul 09 19:16:19.237332 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:19.232953    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785" podStartSLOduration=1.232932483 podStartE2EDuration="1.232932483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:16:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:16:19.229528087 +0000 UTC m=+2113.590675268" watchObservedRunningTime="2026-07-09 19:16:19.232932483 +0000 UTC m=+2113.594079664"
Jul 09 19:16:28.774618 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:28.774584    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:28.775063 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:28.774635    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:28.787264 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:28.787240    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:29.269828 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:29.269800    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:16:30.203665 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:30.203645    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx"
Jul 09 19:16:30.239893 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:30.239867    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xn9c\" (UniqueName: \"kubernetes.io/projected/90282418-1808-4d9c-908c-79dc9daaa337-kube-api-access-5xn9c\") pod \"90282418-1808-4d9c-908c-79dc9daaa337\" (UID: \"90282418-1808-4d9c-908c-79dc9daaa337\") "
Jul 09 19:16:30.241950 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:30.241923    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90282418-1808-4d9c-908c-79dc9daaa337-kube-api-access-5xn9c" (OuterVolumeSpecName: "kube-api-access-5xn9c") pod "90282418-1808-4d9c-908c-79dc9daaa337" (UID: "90282418-1808-4d9c-908c-79dc9daaa337"). InnerVolumeSpecName "kube-api-access-5xn9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:16:30.267487 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:30.267456    2562 generic.go:356] "Generic (PLEG): container finished" podID="90282418-1808-4d9c-908c-79dc9daaa337" containerID="cb0d42dd4be94adf5f8ec1a105d972079edfecc9d4c59613aa1b0059679e4dba" exitCode=137
Jul 09 19:16:30.267612 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:30.267509    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx"
Jul 09 19:16:30.267612 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:30.267546    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx" event={"ID":"90282418-1808-4d9c-908c-79dc9daaa337","Type":"ContainerDied","Data":"cb0d42dd4be94adf5f8ec1a105d972079edfecc9d4c59613aa1b0059679e4dba"}
Jul 09 19:16:30.267612 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:30.267598    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx" event={"ID":"90282418-1808-4d9c-908c-79dc9daaa337","Type":"ContainerDied","Data":"d841f81dc92679315550b2a42e4c3bd366dde2934abdcafe0c282d1e44385294"}
Jul 09 19:16:30.267791 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:30.267624    2562 scope.go:117] "RemoveContainer" containerID="cb0d42dd4be94adf5f8ec1a105d972079edfecc9d4c59613aa1b0059679e4dba"
Jul 09 19:16:30.276353 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:30.276339    2562 scope.go:117] "RemoveContainer" containerID="cb0d42dd4be94adf5f8ec1a105d972079edfecc9d4c59613aa1b0059679e4dba"
Jul 09 19:16:30.276597 ip-10-0-141-47 kubenswrapper[2562]: E0709 19:16:30.276581    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb0d42dd4be94adf5f8ec1a105d972079edfecc9d4c59613aa1b0059679e4dba\": container with ID starting with cb0d42dd4be94adf5f8ec1a105d972079edfecc9d4c59613aa1b0059679e4dba not found: ID does not exist" containerID="cb0d42dd4be94adf5f8ec1a105d972079edfecc9d4c59613aa1b0059679e4dba"
Jul 09 19:16:30.276633 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:30.276609    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb0d42dd4be94adf5f8ec1a105d972079edfecc9d4c59613aa1b0059679e4dba"} err="failed to get container status \"cb0d42dd4be94adf5f8ec1a105d972079edfecc9d4c59613aa1b0059679e4dba\": rpc error: code = NotFound desc = could not find container \"cb0d42dd4be94adf5f8ec1a105d972079edfecc9d4c59613aa1b0059679e4dba\": container with ID starting with cb0d42dd4be94adf5f8ec1a105d972079edfecc9d4c59613aa1b0059679e4dba not found: ID does not exist"
Jul 09 19:16:30.292391 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:30.292364    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx"]
Jul 09 19:16:30.296779 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:30.296759    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29727075-nzjjx"]
Jul 09 19:16:30.341124 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:30.341104    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xn9c\" (UniqueName: \"kubernetes.io/projected/90282418-1808-4d9c-908c-79dc9daaa337-kube-api-access-5xn9c\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:16:32.153482 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:32.153450    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90282418-1808-4d9c-908c-79dc9daaa337" path="/var/lib/kubelet/pods/90282418-1808-4d9c-908c-79dc9daaa337/volumes"
Jul 09 19:16:38.815790 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:38.815760    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"]
Jul 09 19:16:38.816160 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:38.816087    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90282418-1808-4d9c-908c-79dc9daaa337" containerName="cleanup"
Jul 09 19:16:38.816160 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:38.816097    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="90282418-1808-4d9c-908c-79dc9daaa337" containerName="cleanup"
Jul 09 19:16:38.816239 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:38.816195    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="90282418-1808-4d9c-908c-79dc9daaa337" containerName="cleanup"
Jul 09 19:16:38.820549 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:38.820533    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:38.826254 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:38.826231    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-reuse-8e4d4c-openshift-default-dockercfg-n47xb\""
Jul 09 19:16:38.839916 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:38.839896    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"]
Jul 09 19:16:38.914240 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:38.914202    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-credential-socket\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:38.914446 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:38.914258    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-podinfo\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:38.914446 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:38.914356    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-workload-socket\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:38.914446 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:38.914396    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-workload-certs\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:38.914446 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:38.914418    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-data\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:38.914446 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:38.914440    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg64c\" (UniqueName: \"kubernetes.io/projected/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-kube-api-access-tg64c\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:38.914671 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:38.914497    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istiod-ca-cert\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:38.914671 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:38.914537    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-envoy\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:38.914671 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:38.914567    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-token\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.015880 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.015844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-credential-socket\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.015880 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.015883    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-podinfo\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.016168 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.015908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-workload-socket\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.016168 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.015925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-workload-certs\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.016168 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.015949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-data\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.016168 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.015975    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg64c\" (UniqueName: \"kubernetes.io/projected/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-kube-api-access-tg64c\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.016168 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.016000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istiod-ca-cert\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.016168 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.016029    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-envoy\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.016168 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.016063    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-token\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.016496 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.016390    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-credential-socket\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.016496 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.016414    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-workload-socket\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.016791 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.016691    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-data\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.016791 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.016816    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-workload-certs\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.016791 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.016855    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istiod-ca-cert\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.018630 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.018607    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-envoy\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.018788 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.018760    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-podinfo\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.027871 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.027851    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-token\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.028425 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.028405    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg64c\" (UniqueName: \"kubernetes.io/projected/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-kube-api-access-tg64c\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.130203 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.130111    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:39.280330 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.280305    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"]
Jul 09 19:16:39.281891 ip-10-0-141-47 kubenswrapper[2562]: W0709 19:16:39.281867    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d804b66_e7ed_4f72_8bc0_2c9d98dab1c9.slice/crio-8fd287fed99819de78e9ddc65bddda9e038bd230c55834f3e3149c5877f00cd4 WatchSource:0}: Error finding container 8fd287fed99819de78e9ddc65bddda9e038bd230c55834f3e3149c5877f00cd4: Status 404 returned error can't find the container with id 8fd287fed99819de78e9ddc65bddda9e038bd230c55834f3e3149c5877f00cd4
Jul 09 19:16:39.283905 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.283884    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 19:16:39.312711 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:39.312685    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg" event={"ID":"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9","Type":"ContainerStarted","Data":"8fd287fed99819de78e9ddc65bddda9e038bd230c55834f3e3149c5877f00cd4"}
Jul 09 19:16:44.447966 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:44.447931    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:16:44.448258 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:44.448002    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:16:44.448258 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:44.448053    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:16:45.349248 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:45.349213    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg" event={"ID":"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9","Type":"ContainerStarted","Data":"f4d7a9e4ea5a934f3ea99834edff9bf42b269ce18e77b62cc6107236300a1991"}
Jul 09 19:16:45.374160 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:45.374092    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg" podStartSLOduration=2.210484266 podStartE2EDuration="7.374075664s" totalImagesPullingTime="5.163591398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:16:45.37287547 +0000 UTC m=+2139.734022651" watchObservedRunningTime="2026-07-09 19:16:45.374075664 +0000 UTC m=+2139.735222843"
Jul 09 19:16:46.130981 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:46.130946    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:46.135725 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:46.135693    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:46.353937 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:46.353905    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:16:46.354929 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:16:46.354908    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:17:02.395295 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:02.395255    2562 patch_prober.go:28] interesting pod/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 19:17:02.395828 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:02.395323    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg" podUID="1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 19:17:03.447976 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:03.447942    2562 generic.go:356] "Generic (PLEG): container finished" podID="1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" containerID="f4d7a9e4ea5a934f3ea99834edff9bf42b269ce18e77b62cc6107236300a1991" exitCode=0
Jul 09 19:17:03.448522 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:03.448024    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg" event={"ID":"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9","Type":"ContainerDied","Data":"f4d7a9e4ea5a934f3ea99834edff9bf42b269ce18e77b62cc6107236300a1991"}
Jul 09 19:17:03.448522 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:03.448508    2562 scope.go:117] "RemoveContainer" containerID="f4d7a9e4ea5a934f3ea99834edff9bf42b269ce18e77b62cc6107236300a1991"
Jul 09 19:17:03.450550 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:03.450519    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:17:03.450662 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:03.450589    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:17:03.450662 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:03.450626    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:17:04.455810 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:04.455777    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg" event={"ID":"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9","Type":"ContainerStarted","Data":"afbae0e960c0400d5152133d6b89c43f2b97a4fb2e1c99d4c7a07cebe5077ac4"}
Jul 09 19:17:05.130830 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:05.130791    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:17:05.131043 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:05.130967    2562 patch_prober.go:28] interesting pod/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 09 19:17:05.131043 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:05.131015    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg" podUID="1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 09 19:17:06.130686 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:06.130653    2562 patch_prober.go:28] interesting pod/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 09 19:17:06.131059 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:06.130709    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg" podUID="1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 09 19:17:07.130578 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:07.130531    2562 patch_prober.go:28] interesting pod/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 09 19:17:07.130782 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:07.130607    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg" podUID="1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 09 19:17:08.131254 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:08.131214    2562 patch_prober.go:28] interesting pod/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 09 19:17:08.131664 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:08.131273    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg" podUID="1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 09 19:17:09.134722 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:09.134690    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:17:09.135083 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:09.134991    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:17:09.135738 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:17:09.135718    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:18:18.070466 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:18.070432    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"]
Jul 09 19:18:18.071002 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:18.070682    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg" podUID="1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" containerName="istio-proxy" containerID="cri-o://afbae0e960c0400d5152133d6b89c43f2b97a4fb2e1c99d4c7a07cebe5077ac4" gracePeriod=30
Jul 09 19:18:19.039117 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.039088    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"]
Jul 09 19:18:19.042392 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.042377    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.043018 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.042997    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mccgz\" (UniqueName: \"kubernetes.io/projected/f61ed9ca-f806-462b-bdb2-71c0c08be537-kube-api-access-mccgz\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.043118 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.043033    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-token\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.043118 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.043052    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f61ed9ca-f806-462b-bdb2-71c0c08be537-istiod-ca-cert\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.043118 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.043069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-envoy\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.043118 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.043090    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-podinfo\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.043315 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.043175    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-workload-certs\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.043315 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.043204    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-data\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.043315 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.043221    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-workload-socket\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.043315 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.043277    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-credential-socket\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.045133 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.045116    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-reuse-8e4d4c-openshift-default-dockercfg-8rbcp\""
Jul 09 19:18:19.056490 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.056465    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"]
Jul 09 19:18:19.144831 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.144769    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-workload-certs\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.145347 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.144834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-data\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.145347 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.144883    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-workload-socket\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.145347 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.144942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-credential-socket\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.145347 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.144972    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mccgz\" (UniqueName: \"kubernetes.io/projected/f61ed9ca-f806-462b-bdb2-71c0c08be537-kube-api-access-mccgz\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.145347 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.145015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-token\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.145347 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.145039    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f61ed9ca-f806-462b-bdb2-71c0c08be537-istiod-ca-cert\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.145347 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.145067    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-envoy\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.145347 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.145097    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-podinfo\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.145823 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.145567    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-data\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.146043 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.145988    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-workload-socket\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.146419 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.146316    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-credential-socket\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.146533 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.146509    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f61ed9ca-f806-462b-bdb2-71c0c08be537-istiod-ca-cert\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.146601 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.146512    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-workload-certs\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.148399 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.148377    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-envoy\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.148705 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.148683    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-podinfo\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.158413 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.158385    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-token\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.158582 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.158564    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mccgz\" (UniqueName: \"kubernetes.io/projected/f61ed9ca-f806-462b-bdb2-71c0c08be537-kube-api-access-mccgz\") pod \"e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") " pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.352284 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.352204    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:19.494798 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.494771    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"]
Jul 09 19:18:19.495561 ip-10-0-141-47 kubenswrapper[2562]: W0709 19:18:19.495525    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf61ed9ca_f806_462b_bdb2_71c0c08be537.slice/crio-e2278833af869a9c00a724cd1beca4af9ef43319259916ca724013aabf266909 WatchSource:0}: Error finding container e2278833af869a9c00a724cd1beca4af9ef43319259916ca724013aabf266909: Status 404 returned error can't find the container with id e2278833af869a9c00a724cd1beca4af9ef43319259916ca724013aabf266909
Jul 09 19:18:19.497890 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.497852    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:18:19.497965 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.497933    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:18:19.498010 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.497979    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:18:19.836338 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.836301    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz" event={"ID":"f61ed9ca-f806-462b-bdb2-71c0c08be537","Type":"ContainerStarted","Data":"b4337a06a5f98bdc758a8b2ef12b0621cc5298812df9593a83fdc68b1e9388ce"}
Jul 09 19:18:19.836505 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.836358    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz" event={"ID":"f61ed9ca-f806-462b-bdb2-71c0c08be537","Type":"ContainerStarted","Data":"e2278833af869a9c00a724cd1beca4af9ef43319259916ca724013aabf266909"}
Jul 09 19:18:19.862535 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:19.862480    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz" podStartSLOduration=0.862466965 podStartE2EDuration="862.466965ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:18:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:18:19.861347015 +0000 UTC m=+2234.222494195" watchObservedRunningTime="2026-07-09 19:18:19.862466965 +0000 UTC m=+2234.223614145"
Jul 09 19:18:20.352919 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:20.352889    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:20.357715 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:20.357689    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:20.841200 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:20.841164    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:20.842079 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:20.842053    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:23.334511 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.334458    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:18:23.380230 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.380202    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-token\") pod \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") "
Jul 09 19:18:23.380365 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.380257    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-credential-socket\") pod \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") "
Jul 09 19:18:23.380365 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.380292    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istiod-ca-cert\") pod \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") "
Jul 09 19:18:23.380365 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.380329    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-workload-certs\") pod \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") "
Jul 09 19:18:23.380365 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.380357    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-envoy\") pod \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") "
Jul 09 19:18:23.380576 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.380410    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-data\") pod \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") "
Jul 09 19:18:23.381052 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.380490    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-workload-socket\") pod \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") "
Jul 09 19:18:23.381135 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.381116    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg64c\" (UniqueName: \"kubernetes.io/projected/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-kube-api-access-tg64c\") pod \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") "
Jul 09 19:18:23.381218 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.380556    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" (UID: "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:23.381218 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.380590    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" (UID: "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:23.381218 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.380715    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" (UID: "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:23.381218 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.380724    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" (UID: "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:18:23.381441 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.381181    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-podinfo\") pod \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\" (UID: \"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9\") "
Jul 09 19:18:23.381441 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.381422    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-data" (OuterVolumeSpecName: "istio-data") pod "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" (UID: "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:23.381556 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.381518    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-workload-socket\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:18:23.381556 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.381539    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-credential-socket\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:18:23.381556 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.381554    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istiod-ca-cert\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:18:23.381715 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.381568    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-workload-certs\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:18:23.381715 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.381580    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-data\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:18:23.382762 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.382727    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" (UID: "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:18:23.383056 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.383032    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-token" (OuterVolumeSpecName: "istio-token") pod "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" (UID: "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:18:23.383314 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.383290    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-kube-api-access-tg64c" (OuterVolumeSpecName: "kube-api-access-tg64c") pod "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" (UID: "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9"). InnerVolumeSpecName "kube-api-access-tg64c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:18:23.383377 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.383345    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" (UID: "1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:18:23.482215 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.482179    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg64c\" (UniqueName: \"kubernetes.io/projected/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-kube-api-access-tg64c\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:18:23.482215 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.482212    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-podinfo\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:18:23.482413 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.482225    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-token\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:18:23.482413 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.482236    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9-istio-envoy\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:18:23.857252 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.857222    2562 generic.go:356] "Generic (PLEG): container finished" podID="1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" containerID="afbae0e960c0400d5152133d6b89c43f2b97a4fb2e1c99d4c7a07cebe5077ac4" exitCode=0
Jul 09 19:18:23.857428 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.857267    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"
Jul 09 19:18:23.857428 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.857306    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg" event={"ID":"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9","Type":"ContainerDied","Data":"afbae0e960c0400d5152133d6b89c43f2b97a4fb2e1c99d4c7a07cebe5077ac4"}
Jul 09 19:18:23.857428 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.857364    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg" event={"ID":"1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9","Type":"ContainerDied","Data":"8fd287fed99819de78e9ddc65bddda9e038bd230c55834f3e3149c5877f00cd4"}
Jul 09 19:18:23.857428 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.857395    2562 scope.go:117] "RemoveContainer" containerID="afbae0e960c0400d5152133d6b89c43f2b97a4fb2e1c99d4c7a07cebe5077ac4"
Jul 09 19:18:23.866783 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.866766    2562 scope.go:117] "RemoveContainer" containerID="f4d7a9e4ea5a934f3ea99834edff9bf42b269ce18e77b62cc6107236300a1991"
Jul 09 19:18:23.874631 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.874612    2562 scope.go:117] "RemoveContainer" containerID="afbae0e960c0400d5152133d6b89c43f2b97a4fb2e1c99d4c7a07cebe5077ac4"
Jul 09 19:18:23.874885 ip-10-0-141-47 kubenswrapper[2562]: E0709 19:18:23.874865    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afbae0e960c0400d5152133d6b89c43f2b97a4fb2e1c99d4c7a07cebe5077ac4\": container with ID starting with afbae0e960c0400d5152133d6b89c43f2b97a4fb2e1c99d4c7a07cebe5077ac4 not found: ID does not exist" containerID="afbae0e960c0400d5152133d6b89c43f2b97a4fb2e1c99d4c7a07cebe5077ac4"
Jul 09 19:18:23.874929 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.874898    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afbae0e960c0400d5152133d6b89c43f2b97a4fb2e1c99d4c7a07cebe5077ac4"} err="failed to get container status \"afbae0e960c0400d5152133d6b89c43f2b97a4fb2e1c99d4c7a07cebe5077ac4\": rpc error: code = NotFound desc = could not find container \"afbae0e960c0400d5152133d6b89c43f2b97a4fb2e1c99d4c7a07cebe5077ac4\": container with ID starting with afbae0e960c0400d5152133d6b89c43f2b97a4fb2e1c99d4c7a07cebe5077ac4 not found: ID does not exist"
Jul 09 19:18:23.874929 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.874918    2562 scope.go:117] "RemoveContainer" containerID="f4d7a9e4ea5a934f3ea99834edff9bf42b269ce18e77b62cc6107236300a1991"
Jul 09 19:18:23.875188 ip-10-0-141-47 kubenswrapper[2562]: E0709 19:18:23.875172    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4d7a9e4ea5a934f3ea99834edff9bf42b269ce18e77b62cc6107236300a1991\": container with ID starting with f4d7a9e4ea5a934f3ea99834edff9bf42b269ce18e77b62cc6107236300a1991 not found: ID does not exist" containerID="f4d7a9e4ea5a934f3ea99834edff9bf42b269ce18e77b62cc6107236300a1991"
Jul 09 19:18:23.875235 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.875195    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4d7a9e4ea5a934f3ea99834edff9bf42b269ce18e77b62cc6107236300a1991"} err="failed to get container status \"f4d7a9e4ea5a934f3ea99834edff9bf42b269ce18e77b62cc6107236300a1991\": rpc error: code = NotFound desc = could not find container \"f4d7a9e4ea5a934f3ea99834edff9bf42b269ce18e77b62cc6107236300a1991\": container with ID starting with f4d7a9e4ea5a934f3ea99834edff9bf42b269ce18e77b62cc6107236300a1991 not found: ID does not exist"
Jul 09 19:18:23.882312 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.882293    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"]
Jul 09 19:18:23.891038 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:23.891015    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-mxtqg"]
Jul 09 19:18:24.154489 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:24.154397    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" path="/var/lib/kubelet/pods/1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9/volumes"
Jul 09 19:18:33.916254 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:33.916159    2562 generic.go:356] "Generic (PLEG): container finished" podID="f61ed9ca-f806-462b-bdb2-71c0c08be537" containerID="b4337a06a5f98bdc758a8b2ef12b0621cc5298812df9593a83fdc68b1e9388ce" exitCode=0
Jul 09 19:18:33.916254 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:33.916233    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz" event={"ID":"f61ed9ca-f806-462b-bdb2-71c0c08be537","Type":"ContainerDied","Data":"b4337a06a5f98bdc758a8b2ef12b0621cc5298812df9593a83fdc68b1e9388ce"}
Jul 09 19:18:33.916670 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:33.916580    2562 scope.go:117] "RemoveContainer" containerID="b4337a06a5f98bdc758a8b2ef12b0621cc5298812df9593a83fdc68b1e9388ce"
Jul 09 19:18:33.917635 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:33.917610    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:18:33.917709 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:33.917674    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:18:33.917751 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:33.917708    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:18:34.922720 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:34.922684    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz" event={"ID":"f61ed9ca-f806-462b-bdb2-71c0c08be537","Type":"ContainerStarted","Data":"b677a8677607474a9a4aa0cb4bf9e409d90169cce73ef2d8c42804217f97d1e3"}
Jul 09 19:18:35.352741 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:35.352703    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:35.353912 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:35.353888    2562 patch_prober.go:28] interesting pod/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 09 19:18:35.353990 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:35.353940    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz" podUID="f61ed9ca-f806-462b-bdb2-71c0c08be537" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 09 19:18:35.842020 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:35.841984    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:36.352847 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:36.352814    2562 patch_prober.go:28] interesting pod/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 09 19:18:36.353241 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:36.352867    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz" podUID="f61ed9ca-f806-462b-bdb2-71c0c08be537" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 09 19:18:37.353525 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:37.353487    2562 patch_prober.go:28] interesting pod/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 09 19:18:37.353916 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:37.353549    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz" podUID="f61ed9ca-f806-462b-bdb2-71c0c08be537" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 09 19:18:38.353009 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:38.352971    2562 patch_prober.go:28] interesting pod/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 09 19:18:38.353243 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:38.353049    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz" podUID="f61ed9ca-f806-462b-bdb2-71c0c08be537" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 09 19:18:39.356960 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:39.356923    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:18:39.357794 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:18:39.357775    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:20:07.648502 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:07.648413    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"]
Jul 09 19:20:07.649055 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:07.648690    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz" podUID="f61ed9ca-f806-462b-bdb2-71c0c08be537" containerName="istio-proxy" containerID="cri-o://b677a8677607474a9a4aa0cb4bf9e409d90169cce73ef2d8c42804217f97d1e3" gracePeriod=30
Jul 09 19:20:09.359641 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:09.359606    2562 patch_prober.go:28] interesting pod/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 19:20:09.360023 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:09.359670    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz" podUID="f61ed9ca-f806-462b-bdb2-71c0c08be537" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 19:20:09.855445 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:09.855409    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"]
Jul 09 19:20:12.904394 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:12.904367    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:20:13.010851 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.010814    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-token\") pod \"f61ed9ca-f806-462b-bdb2-71c0c08be537\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") "
Jul 09 19:20:13.010851 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.010850    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-data\") pod \"f61ed9ca-f806-462b-bdb2-71c0c08be537\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") "
Jul 09 19:20:13.011114 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.010893    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-credential-socket\") pod \"f61ed9ca-f806-462b-bdb2-71c0c08be537\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") "
Jul 09 19:20:13.011114 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.010921    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-podinfo\") pod \"f61ed9ca-f806-462b-bdb2-71c0c08be537\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") "
Jul 09 19:20:13.011114 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.010943    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-envoy\") pod \"f61ed9ca-f806-462b-bdb2-71c0c08be537\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") "
Jul 09 19:20:13.011114 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.010983    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-workload-socket\") pod \"f61ed9ca-f806-462b-bdb2-71c0c08be537\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") "
Jul 09 19:20:13.011114 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.011033    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mccgz\" (UniqueName: \"kubernetes.io/projected/f61ed9ca-f806-462b-bdb2-71c0c08be537-kube-api-access-mccgz\") pod \"f61ed9ca-f806-462b-bdb2-71c0c08be537\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") "
Jul 09 19:20:13.011114 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.011056    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f61ed9ca-f806-462b-bdb2-71c0c08be537-istiod-ca-cert\") pod \"f61ed9ca-f806-462b-bdb2-71c0c08be537\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") "
Jul 09 19:20:13.011114 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.011071    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-workload-certs\") pod \"f61ed9ca-f806-462b-bdb2-71c0c08be537\" (UID: \"f61ed9ca-f806-462b-bdb2-71c0c08be537\") "
Jul 09 19:20:13.011504 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.011430    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f61ed9ca-f806-462b-bdb2-71c0c08be537" (UID: "f61ed9ca-f806-462b-bdb2-71c0c08be537"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:20:13.011576 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.011545    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f61ed9ca-f806-462b-bdb2-71c0c08be537" (UID: "f61ed9ca-f806-462b-bdb2-71c0c08be537"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:20:13.011576 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.011556    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f61ed9ca-f806-462b-bdb2-71c0c08be537" (UID: "f61ed9ca-f806-462b-bdb2-71c0c08be537"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:20:13.011855 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.011741    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f61ed9ca-f806-462b-bdb2-71c0c08be537-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f61ed9ca-f806-462b-bdb2-71c0c08be537" (UID: "f61ed9ca-f806-462b-bdb2-71c0c08be537"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:20:13.011855 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.011807    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-data" (OuterVolumeSpecName: "istio-data") pod "f61ed9ca-f806-462b-bdb2-71c0c08be537" (UID: "f61ed9ca-f806-462b-bdb2-71c0c08be537"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:20:13.013369 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.013342    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-token" (OuterVolumeSpecName: "istio-token") pod "f61ed9ca-f806-462b-bdb2-71c0c08be537" (UID: "f61ed9ca-f806-462b-bdb2-71c0c08be537"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:20:13.013623 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.013597    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f61ed9ca-f806-462b-bdb2-71c0c08be537" (UID: "f61ed9ca-f806-462b-bdb2-71c0c08be537"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:20:13.013896 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.013876    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f61ed9ca-f806-462b-bdb2-71c0c08be537-kube-api-access-mccgz" (OuterVolumeSpecName: "kube-api-access-mccgz") pod "f61ed9ca-f806-462b-bdb2-71c0c08be537" (UID: "f61ed9ca-f806-462b-bdb2-71c0c08be537"). InnerVolumeSpecName "kube-api-access-mccgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:20:13.013962 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.013898    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f61ed9ca-f806-462b-bdb2-71c0c08be537" (UID: "f61ed9ca-f806-462b-bdb2-71c0c08be537"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:20:13.112398 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.112369    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f61ed9ca-f806-462b-bdb2-71c0c08be537-istiod-ca-cert\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:20:13.112398 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.112393    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-workload-certs\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:20:13.112398 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.112402    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-token\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:20:13.112641 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.112411    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-data\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:20:13.112641 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.112421    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-credential-socket\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:20:13.112641 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.112428    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-podinfo\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:20:13.112641 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.112436    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-istio-envoy\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:20:13.112641 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.112443    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f61ed9ca-f806-462b-bdb2-71c0c08be537-workload-socket\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:20:13.112641 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.112451    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mccgz\" (UniqueName: \"kubernetes.io/projected/f61ed9ca-f806-462b-bdb2-71c0c08be537-kube-api-access-mccgz\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:20:13.415832 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.415739    2562 generic.go:356] "Generic (PLEG): container finished" podID="f61ed9ca-f806-462b-bdb2-71c0c08be537" containerID="b677a8677607474a9a4aa0cb4bf9e409d90169cce73ef2d8c42804217f97d1e3" exitCode=0
Jul 09 19:20:13.415832 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.415786    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"
Jul 09 19:20:13.416024 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.415821    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz" event={"ID":"f61ed9ca-f806-462b-bdb2-71c0c08be537","Type":"ContainerDied","Data":"b677a8677607474a9a4aa0cb4bf9e409d90169cce73ef2d8c42804217f97d1e3"}
Jul 09 19:20:13.416024 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.415879    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz" event={"ID":"f61ed9ca-f806-462b-bdb2-71c0c08be537","Type":"ContainerDied","Data":"e2278833af869a9c00a724cd1beca4af9ef43319259916ca724013aabf266909"}
Jul 09 19:20:13.416024 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.415901    2562 scope.go:117] "RemoveContainer" containerID="b677a8677607474a9a4aa0cb4bf9e409d90169cce73ef2d8c42804217f97d1e3"
Jul 09 19:20:13.432288 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.432267    2562 scope.go:117] "RemoveContainer" containerID="b4337a06a5f98bdc758a8b2ef12b0621cc5298812df9593a83fdc68b1e9388ce"
Jul 09 19:20:13.440089 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.440061    2562 scope.go:117] "RemoveContainer" containerID="b677a8677607474a9a4aa0cb4bf9e409d90169cce73ef2d8c42804217f97d1e3"
Jul 09 19:20:13.440448 ip-10-0-141-47 kubenswrapper[2562]: E0709 19:20:13.440423    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b677a8677607474a9a4aa0cb4bf9e409d90169cce73ef2d8c42804217f97d1e3\": container with ID starting with b677a8677607474a9a4aa0cb4bf9e409d90169cce73ef2d8c42804217f97d1e3 not found: ID does not exist" containerID="b677a8677607474a9a4aa0cb4bf9e409d90169cce73ef2d8c42804217f97d1e3"
Jul 09 19:20:13.440534 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.440467    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b677a8677607474a9a4aa0cb4bf9e409d90169cce73ef2d8c42804217f97d1e3"} err="failed to get container status \"b677a8677607474a9a4aa0cb4bf9e409d90169cce73ef2d8c42804217f97d1e3\": rpc error: code = NotFound desc = could not find container \"b677a8677607474a9a4aa0cb4bf9e409d90169cce73ef2d8c42804217f97d1e3\": container with ID starting with b677a8677607474a9a4aa0cb4bf9e409d90169cce73ef2d8c42804217f97d1e3 not found: ID does not exist"
Jul 09 19:20:13.440534 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.440500    2562 scope.go:117] "RemoveContainer" containerID="b4337a06a5f98bdc758a8b2ef12b0621cc5298812df9593a83fdc68b1e9388ce"
Jul 09 19:20:13.440774 ip-10-0-141-47 kubenswrapper[2562]: E0709 19:20:13.440751    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4337a06a5f98bdc758a8b2ef12b0621cc5298812df9593a83fdc68b1e9388ce\": container with ID starting with b4337a06a5f98bdc758a8b2ef12b0621cc5298812df9593a83fdc68b1e9388ce not found: ID does not exist" containerID="b4337a06a5f98bdc758a8b2ef12b0621cc5298812df9593a83fdc68b1e9388ce"
Jul 09 19:20:13.440824 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.440784    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4337a06a5f98bdc758a8b2ef12b0621cc5298812df9593a83fdc68b1e9388ce"} err="failed to get container status \"b4337a06a5f98bdc758a8b2ef12b0621cc5298812df9593a83fdc68b1e9388ce\": rpc error: code = NotFound desc = could not find container \"b4337a06a5f98bdc758a8b2ef12b0621cc5298812df9593a83fdc68b1e9388ce\": container with ID starting with b4337a06a5f98bdc758a8b2ef12b0621cc5298812df9593a83fdc68b1e9388ce not found: ID does not exist"
Jul 09 19:20:13.443060 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.443038    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"]
Jul 09 19:20:13.448832 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:13.448813    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-reuse-8e4d4c-openshift-default-65f7d6b76c-5rzqz"]
Jul 09 19:20:14.152969 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:14.152932    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f61ed9ca-f806-462b-bdb2-71c0c08be537" path="/var/lib/kubelet/pods/f61ed9ca-f806-462b-bdb2-71c0c08be537/volumes"
Jul 09 19:20:24.875806 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:24.875745    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785" podUID="499f4daf-1d84-4da6-9862-a483b6d1e5a5" containerName="main" containerID="cri-o://dea81d0ebc4cfe5f5de79ff7f3e6218894d2e21ae227ee6d16cdf211a631eefd" gracePeriod=45
Jul 09 19:20:25.122018 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.121991    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:20:25.216703 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.216634    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/499f4daf-1d84-4da6-9862-a483b6d1e5a5-tls-certs\") pod \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") "
Jul 09 19:20:25.216703 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.216672    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-home\") pod \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") "
Jul 09 19:20:25.216703 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.216692    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-model-cache\") pod \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") "
Jul 09 19:20:25.216973 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.216717    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blsch\" (UniqueName: \"kubernetes.io/projected/499f4daf-1d84-4da6-9862-a483b6d1e5a5-kube-api-access-blsch\") pod \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") "
Jul 09 19:20:25.216973 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.216737    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-dshm\") pod \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") "
Jul 09 19:20:25.216973 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.216793    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-tmp-dir\") pod \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\" (UID: \"499f4daf-1d84-4da6-9862-a483b6d1e5a5\") "
Jul 09 19:20:25.216973 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.216950    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-model-cache" (OuterVolumeSpecName: "model-cache") pod "499f4daf-1d84-4da6-9862-a483b6d1e5a5" (UID: "499f4daf-1d84-4da6-9862-a483b6d1e5a5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:20:25.217172 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.216965    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-home" (OuterVolumeSpecName: "home") pod "499f4daf-1d84-4da6-9862-a483b6d1e5a5" (UID: "499f4daf-1d84-4da6-9862-a483b6d1e5a5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:20:25.217172 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.217030    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-model-cache\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:20:25.217172 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.217091    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "499f4daf-1d84-4da6-9862-a483b6d1e5a5" (UID: "499f4daf-1d84-4da6-9862-a483b6d1e5a5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:20:25.219082 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.219047    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-dshm" (OuterVolumeSpecName: "dshm") pod "499f4daf-1d84-4da6-9862-a483b6d1e5a5" (UID: "499f4daf-1d84-4da6-9862-a483b6d1e5a5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:20:25.219216 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.219099    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/499f4daf-1d84-4da6-9862-a483b6d1e5a5-kube-api-access-blsch" (OuterVolumeSpecName: "kube-api-access-blsch") pod "499f4daf-1d84-4da6-9862-a483b6d1e5a5" (UID: "499f4daf-1d84-4da6-9862-a483b6d1e5a5"). InnerVolumeSpecName "kube-api-access-blsch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:20:25.219216 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.219185    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/499f4daf-1d84-4da6-9862-a483b6d1e5a5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "499f4daf-1d84-4da6-9862-a483b6d1e5a5" (UID: "499f4daf-1d84-4da6-9862-a483b6d1e5a5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 19:20:25.317910 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.317886    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-tmp-dir\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:20:25.317910 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.317907    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/499f4daf-1d84-4da6-9862-a483b6d1e5a5-tls-certs\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:20:25.318052 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.317917    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-home\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:20:25.318052 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.317926    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blsch\" (UniqueName: \"kubernetes.io/projected/499f4daf-1d84-4da6-9862-a483b6d1e5a5-kube-api-access-blsch\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:20:25.318052 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.317935    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/499f4daf-1d84-4da6-9862-a483b6d1e5a5-dshm\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:20:25.478834 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.478748    2562 generic.go:356] "Generic (PLEG): container finished" podID="499f4daf-1d84-4da6-9862-a483b6d1e5a5" containerID="dea81d0ebc4cfe5f5de79ff7f3e6218894d2e21ae227ee6d16cdf211a631eefd" exitCode=0
Jul 09 19:20:25.478834 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.478788    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"
Jul 09 19:20:25.478834 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.478794    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785" event={"ID":"499f4daf-1d84-4da6-9862-a483b6d1e5a5","Type":"ContainerDied","Data":"dea81d0ebc4cfe5f5de79ff7f3e6218894d2e21ae227ee6d16cdf211a631eefd"}
Jul 09 19:20:25.478834 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.478827    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785" event={"ID":"499f4daf-1d84-4da6-9862-a483b6d1e5a5","Type":"ContainerDied","Data":"f02bd222cf96b653ae0c69962e704d9f9500812198cf39bc7947dbc02a47352d"}
Jul 09 19:20:25.479106 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.478842    2562 scope.go:117] "RemoveContainer" containerID="dea81d0ebc4cfe5f5de79ff7f3e6218894d2e21ae227ee6d16cdf211a631eefd"
Jul 09 19:20:25.491154 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.491122    2562 scope.go:117] "RemoveContainer" containerID="dea81d0ebc4cfe5f5de79ff7f3e6218894d2e21ae227ee6d16cdf211a631eefd"
Jul 09 19:20:25.491474 ip-10-0-141-47 kubenswrapper[2562]: E0709 19:20:25.491450    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dea81d0ebc4cfe5f5de79ff7f3e6218894d2e21ae227ee6d16cdf211a631eefd\": container with ID starting with dea81d0ebc4cfe5f5de79ff7f3e6218894d2e21ae227ee6d16cdf211a631eefd not found: ID does not exist" containerID="dea81d0ebc4cfe5f5de79ff7f3e6218894d2e21ae227ee6d16cdf211a631eefd"
Jul 09 19:20:25.491539 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.491486    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea81d0ebc4cfe5f5de79ff7f3e6218894d2e21ae227ee6d16cdf211a631eefd"} err="failed to get container status \"dea81d0ebc4cfe5f5de79ff7f3e6218894d2e21ae227ee6d16cdf211a631eefd\": rpc error: code = NotFound desc = could not find container \"dea81d0ebc4cfe5f5de79ff7f3e6218894d2e21ae227ee6d16cdf211a631eefd\": container with ID starting with dea81d0ebc4cfe5f5de79ff7f3e6218894d2e21ae227ee6d16cdf211a631eefd not found: ID does not exist"
Jul 09 19:20:25.504925 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.504899    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"]
Jul 09 19:20:25.508878 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:25.508855    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-8d3645/test-model-8d3645-kserve-5844946865-gm785"]
Jul 09 19:20:26.152565 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:20:26.152525    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="499f4daf-1d84-4da6-9862-a483b6d1e5a5" path="/var/lib/kubelet/pods/499f4daf-1d84-4da6-9862-a483b6d1e5a5/volumes"
Jul 09 19:21:01.895089 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.895060    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"]
Jul 09 19:21:01.895584 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.895409    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61ed9ca-f806-462b-bdb2-71c0c08be537" containerName="istio-proxy"
Jul 09 19:21:01.895584 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.895422    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61ed9ca-f806-462b-bdb2-71c0c08be537" containerName="istio-proxy"
Jul 09 19:21:01.895584 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.895435    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61ed9ca-f806-462b-bdb2-71c0c08be537" containerName="istio-proxy"
Jul 09 19:21:01.895584 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.895441    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61ed9ca-f806-462b-bdb2-71c0c08be537" containerName="istio-proxy"
Jul 09 19:21:01.895584 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.895450    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="499f4daf-1d84-4da6-9862-a483b6d1e5a5" containerName="main"
Jul 09 19:21:01.895584 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.895456    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="499f4daf-1d84-4da6-9862-a483b6d1e5a5" containerName="main"
Jul 09 19:21:01.895584 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.895461    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" containerName="istio-proxy"
Jul 09 19:21:01.895584 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.895466    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" containerName="istio-proxy"
Jul 09 19:21:01.895584 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.895473    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" containerName="istio-proxy"
Jul 09 19:21:01.895584 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.895478    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" containerName="istio-proxy"
Jul 09 19:21:01.895584 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.895533    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f61ed9ca-f806-462b-bdb2-71c0c08be537" containerName="istio-proxy"
Jul 09 19:21:01.895584 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.895541    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" containerName="istio-proxy"
Jul 09 19:21:01.895584 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.895547    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f61ed9ca-f806-462b-bdb2-71c0c08be537" containerName="istio-proxy"
Jul 09 19:21:01.895584 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.895554    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="499f4daf-1d84-4da6-9862-a483b6d1e5a5" containerName="main"
Jul 09 19:21:01.895584 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.895561    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d804b66-e7ed-4f72-8bc0-2c9d98dab1c9" containerName="istio-proxy"
Jul 09 19:21:01.898416 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.898399    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:01.901199 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.901176    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-2f44fe-openshift-default-dockercfg-htwqj\""
Jul 09 19:21:01.911671 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:01.911651    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"]
Jul 09 19:21:02.006341 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.006308    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-workload-certs\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.006518 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.006374    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-istio-data\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.006518 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.006413    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac22e397-978d-41e5-9537-45766fc4c51e-istiod-ca-cert\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.006518 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.006436    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qft9j\" (UniqueName: \"kubernetes.io/projected/ac22e397-978d-41e5-9537-45766fc4c51e-kube-api-access-qft9j\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.006518 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.006460    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac22e397-978d-41e5-9537-45766fc4c51e-istio-token\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.006518 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.006488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-istio-envoy\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.006724 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.006529    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac22e397-978d-41e5-9537-45766fc4c51e-istio-podinfo\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.006724 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.006581    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-credential-socket\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.006724 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.006636    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-workload-socket\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.107635 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.107603    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-istio-data\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.107635 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.107632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac22e397-978d-41e5-9537-45766fc4c51e-istiod-ca-cert\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.107859 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.107648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qft9j\" (UniqueName: \"kubernetes.io/projected/ac22e397-978d-41e5-9537-45766fc4c51e-kube-api-access-qft9j\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.107859 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.107670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac22e397-978d-41e5-9537-45766fc4c51e-istio-token\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.107859 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.107696    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-istio-envoy\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.107859 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.107742    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac22e397-978d-41e5-9537-45766fc4c51e-istio-podinfo\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.107859 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.107768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-credential-socket\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.107859 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.107796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-workload-socket\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.107859 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.107825    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-workload-certs\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.108261 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.108005    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-istio-data\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.108261 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.108091    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-credential-socket\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.108261 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.108198    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-workload-certs\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.108390 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.108274    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-workload-socket\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.108576 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.108560    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac22e397-978d-41e5-9537-45766fc4c51e-istiod-ca-cert\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.110162 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.110128    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-istio-envoy\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.110556 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.110539    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac22e397-978d-41e5-9537-45766fc4c51e-istio-podinfo\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.118918 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.118890    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac22e397-978d-41e5-9537-45766fc4c51e-istio-token\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.119378 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.119360    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qft9j\" (UniqueName: \"kubernetes.io/projected/ac22e397-978d-41e5-9537-45766fc4c51e-kube-api-access-qft9j\") pod \"e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") " pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.208055 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.207962    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:02.352719 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.352606    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"]
Jul 09 19:21:02.355423 ip-10-0-141-47 kubenswrapper[2562]: W0709 19:21:02.355398    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac22e397_978d_41e5_9537_45766fc4c51e.slice/crio-5131d8af479842adfae63c7eb3ac6c1140f912ab7f8ad1fde16b78afebe730c8 WatchSource:0}: Error finding container 5131d8af479842adfae63c7eb3ac6c1140f912ab7f8ad1fde16b78afebe730c8: Status 404 returned error can't find the container with id 5131d8af479842adfae63c7eb3ac6c1140f912ab7f8ad1fde16b78afebe730c8
Jul 09 19:21:02.357345 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.357311    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:21:02.357424 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.357374    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:21:02.357424 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.357409    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:21:02.660376 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.660338    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv" event={"ID":"ac22e397-978d-41e5-9537-45766fc4c51e","Type":"ContainerStarted","Data":"016f196a7ed5a7668a392bda2d2285c533723c655cc1ca95f236b65444e7aaf9"}
Jul 09 19:21:02.660590 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.660402    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv" event={"ID":"ac22e397-978d-41e5-9537-45766fc4c51e","Type":"ContainerStarted","Data":"5131d8af479842adfae63c7eb3ac6c1140f912ab7f8ad1fde16b78afebe730c8"}
Jul 09 19:21:02.683304 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:02.683260    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv" podStartSLOduration=1.68324473 podStartE2EDuration="1.68324473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:21:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:21:02.680383037 +0000 UTC m=+2397.041530218" watchObservedRunningTime="2026-07-09 19:21:02.68324473 +0000 UTC m=+2397.044391910"
Jul 09 19:21:03.208728 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:03.208696    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:03.214040 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:03.214015    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:03.665539 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:03.665504    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:03.666448 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:03.666431    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:06.579280 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:06.579248    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 19:21:06.584997 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:06.584969    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 19:21:19.707281 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:19.707241    2562 patch_prober.go:28] interesting pod/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 19:21:19.707663 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:19.707294    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv" podUID="ac22e397-978d-41e5-9537-45766fc4c51e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 19:21:20.751588 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:20.751551    2562 generic.go:356] "Generic (PLEG): container finished" podID="ac22e397-978d-41e5-9537-45766fc4c51e" containerID="016f196a7ed5a7668a392bda2d2285c533723c655cc1ca95f236b65444e7aaf9" exitCode=0
Jul 09 19:21:20.752163 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:20.751615    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv" event={"ID":"ac22e397-978d-41e5-9537-45766fc4c51e","Type":"ContainerDied","Data":"016f196a7ed5a7668a392bda2d2285c533723c655cc1ca95f236b65444e7aaf9"}
Jul 09 19:21:20.752163 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:20.751977    2562 scope.go:117] "RemoveContainer" containerID="016f196a7ed5a7668a392bda2d2285c533723c655cc1ca95f236b65444e7aaf9"
Jul 09 19:21:20.752968 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:20.752941    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:21:20.753028 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:20.753009    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:21:20.753073 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:20.753041    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:21:21.759500 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:21.759462    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv" event={"ID":"ac22e397-978d-41e5-9537-45766fc4c51e","Type":"ContainerStarted","Data":"74d59f25de66560f633cbab43277ff9e34e20f181855da1ffa77d5072f90e123"}
Jul 09 19:21:22.208897 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:22.208805    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:22.212322 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:22.209184    2562 patch_prober.go:28] interesting pod/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 09 19:21:22.212322 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:22.212212    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv" podUID="ac22e397-978d-41e5-9537-45766fc4c51e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 09 19:21:23.209217 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:23.209181    2562 patch_prober.go:28] interesting pod/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 09 19:21:23.210200 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:23.209784    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv" podUID="ac22e397-978d-41e5-9537-45766fc4c51e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 09 19:21:24.208522 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:24.208478    2562 patch_prober.go:28] interesting pod/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 09 19:21:24.208740 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:24.208547    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv" podUID="ac22e397-978d-41e5-9537-45766fc4c51e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 09 19:21:25.208907 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:25.208861    2562 patch_prober.go:28] interesting pod/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 09 19:21:25.209453 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:25.208926    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv" podUID="ac22e397-978d-41e5-9537-45766fc4c51e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 09 19:21:26.211921 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:26.211892    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:26.212339 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:26.212160    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:26.212820 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:26.212805    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:32.745913 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:32.745725    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"]
Jul 09 19:21:32.746714 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:32.746680    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv" podUID="ac22e397-978d-41e5-9537-45766fc4c51e" containerName="istio-proxy" containerID="cri-o://74d59f25de66560f633cbab43277ff9e34e20f181855da1ffa77d5072f90e123" gracePeriod=30
Jul 09 19:21:38.012040 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.011980    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:38.118462 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.118430    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac22e397-978d-41e5-9537-45766fc4c51e-istiod-ca-cert\") pod \"ac22e397-978d-41e5-9537-45766fc4c51e\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") "
Jul 09 19:21:38.118624 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.118473    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac22e397-978d-41e5-9537-45766fc4c51e-istio-podinfo\") pod \"ac22e397-978d-41e5-9537-45766fc4c51e\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") "
Jul 09 19:21:38.118624 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.118518    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-workload-certs\") pod \"ac22e397-978d-41e5-9537-45766fc4c51e\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") "
Jul 09 19:21:38.118624 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.118544    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-credential-socket\") pod \"ac22e397-978d-41e5-9537-45766fc4c51e\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") "
Jul 09 19:21:38.118624 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.118576    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac22e397-978d-41e5-9537-45766fc4c51e-istio-token\") pod \"ac22e397-978d-41e5-9537-45766fc4c51e\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") "
Jul 09 19:21:38.118624 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.118593    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-istio-envoy\") pod \"ac22e397-978d-41e5-9537-45766fc4c51e\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") "
Jul 09 19:21:38.118624 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.118617    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-istio-data\") pod \"ac22e397-978d-41e5-9537-45766fc4c51e\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") "
Jul 09 19:21:38.118920 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.118644    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qft9j\" (UniqueName: \"kubernetes.io/projected/ac22e397-978d-41e5-9537-45766fc4c51e-kube-api-access-qft9j\") pod \"ac22e397-978d-41e5-9537-45766fc4c51e\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") "
Jul 09 19:21:38.118920 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.118670    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-workload-socket\") pod \"ac22e397-978d-41e5-9537-45766fc4c51e\" (UID: \"ac22e397-978d-41e5-9537-45766fc4c51e\") "
Jul 09 19:21:38.118920 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.118830    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac22e397-978d-41e5-9537-45766fc4c51e" (UID: "ac22e397-978d-41e5-9537-45766fc4c51e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:38.118920 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.118846    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac22e397-978d-41e5-9537-45766fc4c51e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac22e397-978d-41e5-9537-45766fc4c51e" (UID: "ac22e397-978d-41e5-9537-45766fc4c51e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:21:38.119096 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.118931    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac22e397-978d-41e5-9537-45766fc4c51e" (UID: "ac22e397-978d-41e5-9537-45766fc4c51e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:38.119096 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.119020    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac22e397-978d-41e5-9537-45766fc4c51e" (UID: "ac22e397-978d-41e5-9537-45766fc4c51e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:38.119096 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.119025    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac22e397-978d-41e5-9537-45766fc4c51e-istiod-ca-cert\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:21:38.119096 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.119070    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-workload-certs\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:21:38.119931 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.119896    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac22e397-978d-41e5-9537-45766fc4c51e" (UID: "ac22e397-978d-41e5-9537-45766fc4c51e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:38.121015 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.120978    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac22e397-978d-41e5-9537-45766fc4c51e" (UID: "ac22e397-978d-41e5-9537-45766fc4c51e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:21:38.121119 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.121013    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac22e397-978d-41e5-9537-45766fc4c51e-kube-api-access-qft9j" (OuterVolumeSpecName: "kube-api-access-qft9j") pod "ac22e397-978d-41e5-9537-45766fc4c51e" (UID: "ac22e397-978d-41e5-9537-45766fc4c51e"). InnerVolumeSpecName "kube-api-access-qft9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:21:38.121119 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.121045    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac22e397-978d-41e5-9537-45766fc4c51e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac22e397-978d-41e5-9537-45766fc4c51e" (UID: "ac22e397-978d-41e5-9537-45766fc4c51e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:21:38.121119 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.121073    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac22e397-978d-41e5-9537-45766fc4c51e-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac22e397-978d-41e5-9537-45766fc4c51e" (UID: "ac22e397-978d-41e5-9537-45766fc4c51e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:21:38.219808 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.219770    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac22e397-978d-41e5-9537-45766fc4c51e-istio-podinfo\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:21:38.219808 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.219802    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-credential-socket\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:21:38.219808 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.219814    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac22e397-978d-41e5-9537-45766fc4c51e-istio-token\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:21:38.220046 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.219829    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-istio-envoy\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:21:38.220046 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.219840    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-istio-data\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:21:38.220046 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.219852    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qft9j\" (UniqueName: \"kubernetes.io/projected/ac22e397-978d-41e5-9537-45766fc4c51e-kube-api-access-qft9j\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:21:38.220046 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.219865    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac22e397-978d-41e5-9537-45766fc4c51e-workload-socket\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:21:38.845334 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.845301    2562 generic.go:356] "Generic (PLEG): container finished" podID="ac22e397-978d-41e5-9537-45766fc4c51e" containerID="74d59f25de66560f633cbab43277ff9e34e20f181855da1ffa77d5072f90e123" exitCode=0
Jul 09 19:21:38.845503 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.845354    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"
Jul 09 19:21:38.845503 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.845379    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv" event={"ID":"ac22e397-978d-41e5-9537-45766fc4c51e","Type":"ContainerDied","Data":"74d59f25de66560f633cbab43277ff9e34e20f181855da1ffa77d5072f90e123"}
Jul 09 19:21:38.845503 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.845430    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv" event={"ID":"ac22e397-978d-41e5-9537-45766fc4c51e","Type":"ContainerDied","Data":"5131d8af479842adfae63c7eb3ac6c1140f912ab7f8ad1fde16b78afebe730c8"}
Jul 09 19:21:38.845503 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.845461    2562 scope.go:117] "RemoveContainer" containerID="74d59f25de66560f633cbab43277ff9e34e20f181855da1ffa77d5072f90e123"
Jul 09 19:21:38.854222 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.854194    2562 scope.go:117] "RemoveContainer" containerID="016f196a7ed5a7668a392bda2d2285c533723c655cc1ca95f236b65444e7aaf9"
Jul 09 19:21:38.861991 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.861976    2562 scope.go:117] "RemoveContainer" containerID="74d59f25de66560f633cbab43277ff9e34e20f181855da1ffa77d5072f90e123"
Jul 09 19:21:38.862299 ip-10-0-141-47 kubenswrapper[2562]: E0709 19:21:38.862279    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74d59f25de66560f633cbab43277ff9e34e20f181855da1ffa77d5072f90e123\": container with ID starting with 74d59f25de66560f633cbab43277ff9e34e20f181855da1ffa77d5072f90e123 not found: ID does not exist" containerID="74d59f25de66560f633cbab43277ff9e34e20f181855da1ffa77d5072f90e123"
Jul 09 19:21:38.862373 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.862306    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74d59f25de66560f633cbab43277ff9e34e20f181855da1ffa77d5072f90e123"} err="failed to get container status \"74d59f25de66560f633cbab43277ff9e34e20f181855da1ffa77d5072f90e123\": rpc error: code = NotFound desc = could not find container \"74d59f25de66560f633cbab43277ff9e34e20f181855da1ffa77d5072f90e123\": container with ID starting with 74d59f25de66560f633cbab43277ff9e34e20f181855da1ffa77d5072f90e123 not found: ID does not exist"
Jul 09 19:21:38.862373 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.862322    2562 scope.go:117] "RemoveContainer" containerID="016f196a7ed5a7668a392bda2d2285c533723c655cc1ca95f236b65444e7aaf9"
Jul 09 19:21:38.862558 ip-10-0-141-47 kubenswrapper[2562]: E0709 19:21:38.862539    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"016f196a7ed5a7668a392bda2d2285c533723c655cc1ca95f236b65444e7aaf9\": container with ID starting with 016f196a7ed5a7668a392bda2d2285c533723c655cc1ca95f236b65444e7aaf9 not found: ID does not exist" containerID="016f196a7ed5a7668a392bda2d2285c533723c655cc1ca95f236b65444e7aaf9"
Jul 09 19:21:38.862604 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.862566    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"016f196a7ed5a7668a392bda2d2285c533723c655cc1ca95f236b65444e7aaf9"} err="failed to get container status \"016f196a7ed5a7668a392bda2d2285c533723c655cc1ca95f236b65444e7aaf9\": rpc error: code = NotFound desc = could not find container \"016f196a7ed5a7668a392bda2d2285c533723c655cc1ca95f236b65444e7aaf9\": container with ID starting with 016f196a7ed5a7668a392bda2d2285c533723c655cc1ca95f236b65444e7aaf9 not found: ID does not exist"
Jul 09 19:21:38.872407 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.872388    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"]
Jul 09 19:21:38.880105 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:38.880086    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-2f44fe-openshift-default-5b679499bf-rd9mv"]
Jul 09 19:21:40.152932 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:40.152888    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac22e397-978d-41e5-9537-45766fc4c51e" path="/var/lib/kubelet/pods/ac22e397-978d-41e5-9537-45766fc4c51e/volumes"
Jul 09 19:21:41.387837 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.387801    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"]
Jul 09 19:21:41.388348 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.388332    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac22e397-978d-41e5-9537-45766fc4c51e" containerName="istio-proxy"
Jul 09 19:21:41.388442 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.388350    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac22e397-978d-41e5-9537-45766fc4c51e" containerName="istio-proxy"
Jul 09 19:21:41.388442 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.388363    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac22e397-978d-41e5-9537-45766fc4c51e" containerName="istio-proxy"
Jul 09 19:21:41.388442 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.388371    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac22e397-978d-41e5-9537-45766fc4c51e" containerName="istio-proxy"
Jul 09 19:21:41.388566 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.388455    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac22e397-978d-41e5-9537-45766fc4c51e" containerName="istio-proxy"
Jul 09 19:21:41.388566 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.388468    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac22e397-978d-41e5-9537-45766fc4c51e" containerName="istio-proxy"
Jul 09 19:21:41.393075 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.393055    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.396102 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.396085    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-18e258-openshift-default-dockercfg-fbpk8\""
Jul 09 19:21:41.405350 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.405329    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"]
Jul 09 19:21:41.548271 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.548227    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-podinfo\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.548678 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.548471    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istiod-ca-cert\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.548678 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.548511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-workload-socket\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.548678 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.548548    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-credential-socket\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.548678 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.548599    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-workload-certs\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.548678 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.548629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-envoy\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.548678 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.548662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-data\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.549159 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.548686    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-token\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.549159 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.548716    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqhsh\" (UniqueName: \"kubernetes.io/projected/02049853-03cd-4fed-bb8d-86ff52f7ef1e-kube-api-access-sqhsh\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.650123 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.650038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-credential-socket\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.650123 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.650089    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-workload-certs\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.650123 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.650116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-envoy\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.650450 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.650168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-data\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.650450 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.650186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-token\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.650450 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.650208    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqhsh\" (UniqueName: \"kubernetes.io/projected/02049853-03cd-4fed-bb8d-86ff52f7ef1e-kube-api-access-sqhsh\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.650450 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.650239    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-podinfo\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.650450 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.650298    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istiod-ca-cert\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.650450 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.650328    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-workload-socket\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.650788 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.650497    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-workload-certs\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.650788 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.650562    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-credential-socket\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.650948 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.650924    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-workload-socket\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.651012 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.650960    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-data\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.651053 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.651028    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istiod-ca-cert\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.652599 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.652578    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-envoy\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.652802 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.652782    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-podinfo\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.660035 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.660007    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqhsh\" (UniqueName: \"kubernetes.io/projected/02049853-03cd-4fed-bb8d-86ff52f7ef1e-kube-api-access-sqhsh\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.660186 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.660136    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-token\") pod \"e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") " pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.703194 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.703167    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:41.849988 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.849964    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"]
Jul 09 19:21:41.851199 ip-10-0-141-47 kubenswrapper[2562]: W0709 19:21:41.851167    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02049853_03cd_4fed_bb8d_86ff52f7ef1e.slice/crio-607f53f1581a513b6505ef8ca727ce5ae6fa44a5a946d2c67431ccc622030360 WatchSource:0}: Error finding container 607f53f1581a513b6505ef8ca727ce5ae6fa44a5a946d2c67431ccc622030360: Status 404 returned error can't find the container with id 607f53f1581a513b6505ef8ca727ce5ae6fa44a5a946d2c67431ccc622030360
Jul 09 19:21:41.853251 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.853216    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:21:41.853356 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.853298    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:21:41.853356 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.853345    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:21:41.862983 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:41.862940    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9" event={"ID":"02049853-03cd-4fed-bb8d-86ff52f7ef1e","Type":"ContainerStarted","Data":"607f53f1581a513b6505ef8ca727ce5ae6fa44a5a946d2c67431ccc622030360"}
Jul 09 19:21:42.869277 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:42.869237    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9" event={"ID":"02049853-03cd-4fed-bb8d-86ff52f7ef1e","Type":"ContainerStarted","Data":"716d3bbfffe019dd3645a37590e864f7418da8c1bdaaf517adb45ea9f212a3bc"}
Jul 09 19:21:42.892775 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:42.892722    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9" podStartSLOduration=1.892703736 podStartE2EDuration="1.892703736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:21:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:21:42.891316988 +0000 UTC m=+2437.252464169" watchObservedRunningTime="2026-07-09 19:21:42.892703736 +0000 UTC m=+2437.253850920"
Jul 09 19:21:43.703345 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:43.703304    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:43.708003 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:43.707980    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:43.879861 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:43.879825    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:43.880696 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:43.880674    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:49.973941 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:49.973911    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"]
Jul 09 19:21:49.977748 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:49.977729    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:49.980492 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:49.980475    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-2ac82b-openshift-default-dockercfg-jps8q\""
Jul 09 19:21:49.995164 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:49.994244    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"]
Jul 09 19:21:50.123353 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.123309    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-data\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.123353 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.123353    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-podinfo\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.123635 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.123374    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-envoy\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.123635 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.123414    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q27n\" (UniqueName: \"kubernetes.io/projected/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-kube-api-access-2q27n\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.123635 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.123458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-credential-socket\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.123635 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.123476    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-workload-certs\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.123635 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.123491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-workload-socket\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.123635 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.123532    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-token\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.123635 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.123598    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istiod-ca-cert\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.224306 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.224216    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-workload-socket\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.224306 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.224275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-token\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.224306 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.224297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istiod-ca-cert\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.224594 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.224340    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-data\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.224594 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.224357    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-podinfo\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.224594 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.224375    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-envoy\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.224594 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.224396    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q27n\" (UniqueName: \"kubernetes.io/projected/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-kube-api-access-2q27n\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.224594 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.224436    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-credential-socket\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.224594 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.224462    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-workload-certs\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.224893 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.224687    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-workload-socket\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.224893 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.224812    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-data\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.225098 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.225073    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-credential-socket\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.225197 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.225077    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istiod-ca-cert\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.225518 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.225492    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-workload-certs\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.226976 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.226958    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-envoy\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.227234 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.227215    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-podinfo\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.233725 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.233704    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-token\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.234074 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.234055    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q27n\" (UniqueName: \"kubernetes.io/projected/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-kube-api-access-2q27n\") pod \"e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") " pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.322162 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.322114    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:50.508348 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.507386    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"]
Jul 09 19:21:50.511753 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.510631    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:21:50.511753 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.510713    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:21:50.511753 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.510752    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:21:50.923618 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.923534    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r" event={"ID":"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce","Type":"ContainerStarted","Data":"a3f8f6eb54d1ad9d310ea96516c315728bba056a1fb22717a6fcd8467b08251e"}
Jul 09 19:21:50.923618 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.923582    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r" event={"ID":"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce","Type":"ContainerStarted","Data":"4b02e0691173b55b62c1a9095cee5b7172f6a2cabd8b365264d58c979fd5dd0e"}
Jul 09 19:21:50.948426 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:50.948380    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r" podStartSLOduration=1.9483652280000001 podStartE2EDuration="1.948365228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 19:21:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:21:50.947726168 +0000 UTC m=+2445.308873351" watchObservedRunningTime="2026-07-09 19:21:50.948365228 +0000 UTC m=+2445.309512407"
Jul 09 19:21:51.323176 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:51.323118    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:51.327807 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:51.327783    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:51.929204 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:51.929173    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:51.930097 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:51.930073    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:21:55.954104 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:55.954014    2562 generic.go:356] "Generic (PLEG): container finished" podID="02049853-03cd-4fed-bb8d-86ff52f7ef1e" containerID="716d3bbfffe019dd3645a37590e864f7418da8c1bdaaf517adb45ea9f212a3bc" exitCode=0
Jul 09 19:21:55.954104 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:55.954055    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9" event={"ID":"02049853-03cd-4fed-bb8d-86ff52f7ef1e","Type":"ContainerDied","Data":"716d3bbfffe019dd3645a37590e864f7418da8c1bdaaf517adb45ea9f212a3bc"}
Jul 09 19:21:55.954688 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:55.954566    2562 scope.go:117] "RemoveContainer" containerID="716d3bbfffe019dd3645a37590e864f7418da8c1bdaaf517adb45ea9f212a3bc"
Jul 09 19:21:55.955630 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:55.955602    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:21:55.955696 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:55.955671    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:21:55.955745 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:55.955703    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:21:56.960907 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:56.960874    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9" event={"ID":"02049853-03cd-4fed-bb8d-86ff52f7ef1e","Type":"ContainerStarted","Data":"177c4b2d7f2cc3cf3c3aa617b855ce3daf36821b5f80559e3d42cc6b85a3dafc"}
Jul 09 19:21:57.705565 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:57.705523    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:57.705762 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:57.705707    2562 patch_prober.go:28] interesting pod/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 09 19:21:57.705841 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:57.705763    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9" podUID="02049853-03cd-4fed-bb8d-86ff52f7ef1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 19:21:58.704026 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:58.703990    2562 patch_prober.go:28] interesting pod/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 09 19:21:58.704614 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:58.704582    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9" podUID="02049853-03cd-4fed-bb8d-86ff52f7ef1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 19:21:58.880219 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:58.880184    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:21:59.704003 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:59.703953    2562 patch_prober.go:28] interesting pod/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 09 19:21:59.704256 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:21:59.704027    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9" podUID="02049853-03cd-4fed-bb8d-86ff52f7ef1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 19:22:00.703765 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:00.703724    2562 patch_prober.go:28] interesting pod/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 09 19:22:00.704077 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:00.704045    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9" podUID="02049853-03cd-4fed-bb8d-86ff52f7ef1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 09 19:22:01.711304 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:01.711252    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:22:01.712901 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:01.712872    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:22:06.930962 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:06.930927    2562 patch_prober.go:28] interesting pod/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 09 19:22:06.931422 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:06.930984    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r" podUID="be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 09 19:22:07.019957 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:07.019921    2562 generic.go:356] "Generic (PLEG): container finished" podID="be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" containerID="a3f8f6eb54d1ad9d310ea96516c315728bba056a1fb22717a6fcd8467b08251e" exitCode=0
Jul 09 19:22:07.019957 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:07.019958    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r" event={"ID":"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce","Type":"ContainerDied","Data":"a3f8f6eb54d1ad9d310ea96516c315728bba056a1fb22717a6fcd8467b08251e"}
Jul 09 19:22:07.020341 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:07.020328    2562 scope.go:117] "RemoveContainer" containerID="a3f8f6eb54d1ad9d310ea96516c315728bba056a1fb22717a6fcd8467b08251e"
Jul 09 19:22:07.023973 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:07.023939    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:22:07.024102 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:07.024018    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:22:07.024102 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:07.024061    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 09 19:22:08.027251 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:08.027219    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r" event={"ID":"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce","Type":"ContainerStarted","Data":"096ee9a3b39b5d1e1fef06a4b1501302497d32a57e05f5a019150b9ea1a187e9"}
Jul 09 19:22:08.322850 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:08.322761    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:22:08.323042 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:08.323020    2562 patch_prober.go:28] interesting pod/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 09 19:22:08.323086 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:08.323070    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r" podUID="be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 09 19:22:09.323499 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:09.323462    2562 patch_prober.go:28] interesting pod/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 09 19:22:09.323903 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:09.323520    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r" podUID="be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 09 19:22:10.323071 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:10.323031    2562 patch_prober.go:28] interesting pod/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 09 19:22:10.323273 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:10.323089    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r" podUID="be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 09 19:22:11.322968 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:11.322930    2562 patch_prober.go:28] interesting pod/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 09 19:22:11.323424 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:11.323001    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r" podUID="be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 09 19:22:12.327121 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:12.327087    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:22:12.327541 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:12.327517    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:22:12.328209 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:22:12.328188    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:26:06.616460 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:26:06.616383    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 19:26:06.624087 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:26:06.624070    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrbn6_e0e5ba40-3cfa-43fc-920f-b8257e57f5d5/ovn-acl-logging/0.log"
Jul 09 19:27:45.812599 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:45.812566    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"]
Jul 09 19:27:45.813126 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:45.812853    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9" podUID="02049853-03cd-4fed-bb8d-86ff52f7ef1e" containerName="istio-proxy" containerID="cri-o://177c4b2d7f2cc3cf3c3aa617b855ce3daf36821b5f80559e3d42cc6b85a3dafc" gracePeriod=30
Jul 09 19:27:46.714018 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:46.713979    2562 patch_prober.go:28] interesting pod/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 19:27:46.714206 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:46.714063    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9" podUID="02049853-03cd-4fed-bb8d-86ff52f7ef1e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 19:27:51.068460 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.068437    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:27:51.159797 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.159709    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istiod-ca-cert\") pod \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") "
Jul 09 19:27:51.159797 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.159776    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-workload-socket\") pod \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") "
Jul 09 19:27:51.159797 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.159797    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-credential-socket\") pod \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") "
Jul 09 19:27:51.160082 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.159816    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-envoy\") pod \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") "
Jul 09 19:27:51.160082 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.159833    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqhsh\" (UniqueName: \"kubernetes.io/projected/02049853-03cd-4fed-bb8d-86ff52f7ef1e-kube-api-access-sqhsh\") pod \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") "
Jul 09 19:27:51.160082 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.159854    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-token\") pod \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") "
Jul 09 19:27:51.160082 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.159877    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-podinfo\") pod \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") "
Jul 09 19:27:51.160082 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.159892    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-workload-certs\") pod \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") "
Jul 09 19:27:51.160082 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.159906    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-data\") pod \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\" (UID: \"02049853-03cd-4fed-bb8d-86ff52f7ef1e\") "
Jul 09 19:27:51.160082 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.160006    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "02049853-03cd-4fed-bb8d-86ff52f7ef1e" (UID: "02049853-03cd-4fed-bb8d-86ff52f7ef1e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:51.160475 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.160239    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "02049853-03cd-4fed-bb8d-86ff52f7ef1e" (UID: "02049853-03cd-4fed-bb8d-86ff52f7ef1e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:51.160475 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.160262    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "02049853-03cd-4fed-bb8d-86ff52f7ef1e" (UID: "02049853-03cd-4fed-bb8d-86ff52f7ef1e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:27:51.160475 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.160285    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-workload-socket\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:51.160475 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.160388    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "02049853-03cd-4fed-bb8d-86ff52f7ef1e" (UID: "02049853-03cd-4fed-bb8d-86ff52f7ef1e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:51.160863 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.160825    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-data" (OuterVolumeSpecName: "istio-data") pod "02049853-03cd-4fed-bb8d-86ff52f7ef1e" (UID: "02049853-03cd-4fed-bb8d-86ff52f7ef1e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:51.162313 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.162271    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "02049853-03cd-4fed-bb8d-86ff52f7ef1e" (UID: "02049853-03cd-4fed-bb8d-86ff52f7ef1e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:27:51.162432 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.162344    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02049853-03cd-4fed-bb8d-86ff52f7ef1e-kube-api-access-sqhsh" (OuterVolumeSpecName: "kube-api-access-sqhsh") pod "02049853-03cd-4fed-bb8d-86ff52f7ef1e" (UID: "02049853-03cd-4fed-bb8d-86ff52f7ef1e"). InnerVolumeSpecName "kube-api-access-sqhsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:51.162725 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.162708    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "02049853-03cd-4fed-bb8d-86ff52f7ef1e" (UID: "02049853-03cd-4fed-bb8d-86ff52f7ef1e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:51.162808 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.162722    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-token" (OuterVolumeSpecName: "istio-token") pod "02049853-03cd-4fed-bb8d-86ff52f7ef1e" (UID: "02049853-03cd-4fed-bb8d-86ff52f7ef1e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:51.260948 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.260918    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istiod-ca-cert\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:51.260948 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.260942    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-credential-socket\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:51.261186 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.260956    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-envoy\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:51.261186 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.260969    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqhsh\" (UniqueName: \"kubernetes.io/projected/02049853-03cd-4fed-bb8d-86ff52f7ef1e-kube-api-access-sqhsh\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:51.261186 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.260980    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-token\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:51.261186 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.260991    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-podinfo\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:51.261186 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.261002    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-workload-certs\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:51.261186 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.261012    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02049853-03cd-4fed-bb8d-86ff52f7ef1e-istio-data\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:51.757075 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.757037    2562 generic.go:356] "Generic (PLEG): container finished" podID="02049853-03cd-4fed-bb8d-86ff52f7ef1e" containerID="177c4b2d7f2cc3cf3c3aa617b855ce3daf36821b5f80559e3d42cc6b85a3dafc" exitCode=0
Jul 09 19:27:51.757285 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.757083    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9" event={"ID":"02049853-03cd-4fed-bb8d-86ff52f7ef1e","Type":"ContainerDied","Data":"177c4b2d7f2cc3cf3c3aa617b855ce3daf36821b5f80559e3d42cc6b85a3dafc"}
Jul 09 19:27:51.757285 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.757089    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"
Jul 09 19:27:51.757285 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.757126    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9" event={"ID":"02049853-03cd-4fed-bb8d-86ff52f7ef1e","Type":"ContainerDied","Data":"607f53f1581a513b6505ef8ca727ce5ae6fa44a5a946d2c67431ccc622030360"}
Jul 09 19:27:51.757285 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.757163    2562 scope.go:117] "RemoveContainer" containerID="177c4b2d7f2cc3cf3c3aa617b855ce3daf36821b5f80559e3d42cc6b85a3dafc"
Jul 09 19:27:51.766463 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.766446    2562 scope.go:117] "RemoveContainer" containerID="716d3bbfffe019dd3645a37590e864f7418da8c1bdaaf517adb45ea9f212a3bc"
Jul 09 19:27:51.775981 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.775966    2562 scope.go:117] "RemoveContainer" containerID="177c4b2d7f2cc3cf3c3aa617b855ce3daf36821b5f80559e3d42cc6b85a3dafc"
Jul 09 19:27:51.776260 ip-10-0-141-47 kubenswrapper[2562]: E0709 19:27:51.776241    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"177c4b2d7f2cc3cf3c3aa617b855ce3daf36821b5f80559e3d42cc6b85a3dafc\": container with ID starting with 177c4b2d7f2cc3cf3c3aa617b855ce3daf36821b5f80559e3d42cc6b85a3dafc not found: ID does not exist" containerID="177c4b2d7f2cc3cf3c3aa617b855ce3daf36821b5f80559e3d42cc6b85a3dafc"
Jul 09 19:27:51.776334 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.776268    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"177c4b2d7f2cc3cf3c3aa617b855ce3daf36821b5f80559e3d42cc6b85a3dafc"} err="failed to get container status \"177c4b2d7f2cc3cf3c3aa617b855ce3daf36821b5f80559e3d42cc6b85a3dafc\": rpc error: code = NotFound desc = could not find container \"177c4b2d7f2cc3cf3c3aa617b855ce3daf36821b5f80559e3d42cc6b85a3dafc\": container with ID starting with 177c4b2d7f2cc3cf3c3aa617b855ce3daf36821b5f80559e3d42cc6b85a3dafc not found: ID does not exist"
Jul 09 19:27:51.776334 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.776285    2562 scope.go:117] "RemoveContainer" containerID="716d3bbfffe019dd3645a37590e864f7418da8c1bdaaf517adb45ea9f212a3bc"
Jul 09 19:27:51.776528 ip-10-0-141-47 kubenswrapper[2562]: E0709 19:27:51.776505    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"716d3bbfffe019dd3645a37590e864f7418da8c1bdaaf517adb45ea9f212a3bc\": container with ID starting with 716d3bbfffe019dd3645a37590e864f7418da8c1bdaaf517adb45ea9f212a3bc not found: ID does not exist" containerID="716d3bbfffe019dd3645a37590e864f7418da8c1bdaaf517adb45ea9f212a3bc"
Jul 09 19:27:51.776570 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.776535    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"716d3bbfffe019dd3645a37590e864f7418da8c1bdaaf517adb45ea9f212a3bc"} err="failed to get container status \"716d3bbfffe019dd3645a37590e864f7418da8c1bdaaf517adb45ea9f212a3bc\": rpc error: code = NotFound desc = could not find container \"716d3bbfffe019dd3645a37590e864f7418da8c1bdaaf517adb45ea9f212a3bc\": container with ID starting with 716d3bbfffe019dd3645a37590e864f7418da8c1bdaaf517adb45ea9f212a3bc not found: ID does not exist"
Jul 09 19:27:51.781619 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.781599    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"]
Jul 09 19:27:51.787587 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:51.787567    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-18e258-openshift-default-5f5df7f679-rwmk9"]
Jul 09 19:27:52.152620 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:52.152544    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02049853-03cd-4fed-bb8d-86ff52f7ef1e" path="/var/lib/kubelet/pods/02049853-03cd-4fed-bb8d-86ff52f7ef1e/volumes"
Jul 09 19:27:53.618435 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:53.618402    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"]
Jul 09 19:27:53.618816 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:53.618669    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r" podUID="be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" containerName="istio-proxy" containerID="cri-o://096ee9a3b39b5d1e1fef06a4b1501302497d32a57e05f5a019150b9ea1a187e9" gracePeriod=30
Jul 09 19:27:57.329970 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:57.329935    2562 patch_prober.go:28] interesting pod/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 19:27:57.330355 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:57.329995    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r" podUID="be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 19:27:58.797825 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:58.797792    2562 generic.go:356] "Generic (PLEG): container finished" podID="be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" containerID="096ee9a3b39b5d1e1fef06a4b1501302497d32a57e05f5a019150b9ea1a187e9" exitCode=0
Jul 09 19:27:58.798207 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:58.797839    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r" event={"ID":"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce","Type":"ContainerDied","Data":"096ee9a3b39b5d1e1fef06a4b1501302497d32a57e05f5a019150b9ea1a187e9"}
Jul 09 19:27:58.798207 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:58.797897    2562 scope.go:117] "RemoveContainer" containerID="a3f8f6eb54d1ad9d310ea96516c315728bba056a1fb22717a6fcd8467b08251e"
Jul 09 19:27:58.874417 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:58.874394    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:27:59.023480 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.023450    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-data\") pod \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") "
Jul 09 19:27:59.023676 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.023489    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istiod-ca-cert\") pod \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") "
Jul 09 19:27:59.023676 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.023511    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-workload-socket\") pod \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") "
Jul 09 19:27:59.023676 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.023555    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-envoy\") pod \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") "
Jul 09 19:27:59.023676 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.023574    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-token\") pod \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") "
Jul 09 19:27:59.023676 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.023606    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-podinfo\") pod \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") "
Jul 09 19:27:59.023676 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.023660    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q27n\" (UniqueName: \"kubernetes.io/projected/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-kube-api-access-2q27n\") pod \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") "
Jul 09 19:27:59.024023 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.023681    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-workload-certs\") pod \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") "
Jul 09 19:27:59.024023 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.023719    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-credential-socket\") pod \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\" (UID: \"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce\") "
Jul 09 19:27:59.024023 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.023901    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" (UID: "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 19:27:59.024215 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.024134    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" (UID: "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:59.024215 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.024176    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" (UID: "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:59.024548 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.024348    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" (UID: "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:59.024718 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.024690    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-data" (OuterVolumeSpecName: "istio-data") pod "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" (UID: "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:59.026013 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.025990    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" (UID: "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 19:27:59.026112 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.026059    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-token" (OuterVolumeSpecName: "istio-token") pod "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" (UID: "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:59.026112 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.026060    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" (UID: "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 19:27:59.026399 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.026375    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-kube-api-access-2q27n" (OuterVolumeSpecName: "kube-api-access-2q27n") pod "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" (UID: "be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce"). InnerVolumeSpecName "kube-api-access-2q27n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 19:27:59.124818 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.124790    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q27n\" (UniqueName: \"kubernetes.io/projected/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-kube-api-access-2q27n\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:59.124818 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.124815    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-workload-certs\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:59.124969 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.124824    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-credential-socket\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:59.124969 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.124832    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-data\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:59.124969 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.124841    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istiod-ca-cert\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:59.124969 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.124848    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-workload-socket\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:59.124969 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.124855    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-envoy\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:59.124969 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.124863    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-token\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:59.124969 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.124871    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce-istio-podinfo\") on node \"ip-10-0-141-47.ec2.internal\" DevicePath \"\""
Jul 09 19:27:59.325981 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.325907    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7r547_cc86467c-2b93-41bd-bc91-c4aa34391ad8/manager/0.log"
Jul 09 19:27:59.447238 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.447210    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gbv8b_29cc67ca-be89-4bca-92bd-b7c56da729e5/manager/0.log"
Jul 09 19:27:59.804042 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.804010    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"
Jul 09 19:27:59.804496 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.804049    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r" event={"ID":"be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce","Type":"ContainerDied","Data":"4b02e0691173b55b62c1a9095cee5b7172f6a2cabd8b365264d58c979fd5dd0e"}
Jul 09 19:27:59.804496 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.804165    2562 scope.go:117] "RemoveContainer" containerID="096ee9a3b39b5d1e1fef06a4b1501302497d32a57e05f5a019150b9ea1a187e9"
Jul 09 19:27:59.819959 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.819932    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jg66j_97abeaaa-d4cc-46c9-96d3-76ae5b72a3de/manager/0.log"
Jul 09 19:27:59.828976 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.828954    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"]
Jul 09 19:27:59.836479 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:27:59.836457    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-2ac82b-openshift-default-69986db995-87h8r"]
Jul 09 19:28:00.068222 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:00.068117    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fbd77dc5f-nmvjq_c5cc68d5-7e0c-462f-ad82-32482f62b2a9/copy-manifests/0.log"
Jul 09 19:28:00.076483 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:00.076461    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fbd77dc5f-nmvjq_c5cc68d5-7e0c-462f-ad82-32482f62b2a9/manager/0.log"
Jul 09 19:28:00.152833 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:00.152804    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" path="/var/lib/kubelet/pods/be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce/volumes"
Jul 09 19:28:01.512424 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:01.512390    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n_f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3/util/0.log"
Jul 09 19:28:01.520884 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:01.520862    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n_f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3/pull/0.log"
Jul 09 19:28:01.529429 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:01.529408    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n_f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3/extract/0.log"
Jul 09 19:28:01.646317 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:01.646291    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t_2a9bb699-058d-4816-ae3e-bf20d9112c0d/util/0.log"
Jul 09 19:28:01.654039 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:01.654015    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t_2a9bb699-058d-4816-ae3e-bf20d9112c0d/pull/0.log"
Jul 09 19:28:01.661648 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:01.661628    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t_2a9bb699-058d-4816-ae3e-bf20d9112c0d/extract/0.log"
Jul 09 19:28:01.780447 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:01.780371    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh_a14f86b3-8b1c-4f49-a038-ea3d4ea695d6/util/0.log"
Jul 09 19:28:01.787845 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:01.787823    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh_a14f86b3-8b1c-4f49-a038-ea3d4ea695d6/pull/0.log"
Jul 09 19:28:01.795011 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:01.794995    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh_a14f86b3-8b1c-4f49-a038-ea3d4ea695d6/extract/0.log"
Jul 09 19:28:01.911739 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:01.911710    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62_26d8c542-1981-4013-89eb-c287c6aeba73/util/0.log"
Jul 09 19:28:01.919281 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:01.919256    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62_26d8c542-1981-4013-89eb-c287c6aeba73/pull/0.log"
Jul 09 19:28:01.926844 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:01.926827    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62_26d8c542-1981-4013-89eb-c287c6aeba73/extract/0.log"
Jul 09 19:28:02.670420 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:02.670392    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-85r5m_036b8ff4-e821-41f4-8e5a-d78073a534c8/manager/0.log"
Jul 09 19:28:02.911980 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:02.911955    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gp5lw_7d57e33b-dd0c-45b0-a38a-2a263eb205fb/manager/0.log"
Jul 09 19:28:03.386191 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:03.386164    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gt69d_d0d6a4b2-ee86-4779-841d-aea2539d7bff/discovery/0.log"
Jul 09 19:28:03.618317 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:03.618295    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74785d646-vbb6l_6a8c8745-aacd-445d-9863-47221b2a35fd/kube-auth-proxy/0.log"
Jul 09 19:28:04.446663 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:04.446630    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-d7xqv_f2291855-afd9-4c14-8bea-49dd71ef6927/main/0.log"
Jul 09 19:28:04.681336 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:04.681307    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-sghmf_abae2b00-f04a-454c-956b-abf14f1e7a79/main/0.log"
Jul 09 19:28:11.654847 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:11.654804    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-smq6d_0dd7d302-1a20-4cda-9624-0ca2fcf630c2/global-pull-secret-syncer/0.log"
Jul 09 19:28:11.746734 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:11.746704    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lfhlt_905732ad-cc05-4aab-8221-55a67a47993b/konnectivity-agent/0.log"
Jul 09 19:28:11.837919 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:11.837892    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-47.ec2.internal_9d53067e3c408632770d4f8c1feeef25/haproxy/0.log"
Jul 09 19:28:15.679711 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:15.679679    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n_f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3/extract/0.log"
Jul 09 19:28:15.706043 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:15.706021    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n_f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3/util/0.log"
Jul 09 19:28:15.744555 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:15.744528    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759md79n_f0331ff0-f0dc-4c9d-a9c9-f653885fa4c3/pull/0.log"
Jul 09 19:28:15.780535 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:15.780500    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t_2a9bb699-058d-4816-ae3e-bf20d9112c0d/extract/0.log"
Jul 09 19:28:15.815157 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:15.815114    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t_2a9bb699-058d-4816-ae3e-bf20d9112c0d/util/0.log"
Jul 09 19:28:15.845580 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:15.845558    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f6j8t_2a9bb699-058d-4816-ae3e-bf20d9112c0d/pull/0.log"
Jul 09 19:28:15.880201 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:15.880180    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh_a14f86b3-8b1c-4f49-a038-ea3d4ea695d6/extract/0.log"
Jul 09 19:28:15.916659 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:15.916638    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh_a14f86b3-8b1c-4f49-a038-ea3d4ea695d6/util/0.log"
Jul 09 19:28:15.953023 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:15.952966    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hdplh_a14f86b3-8b1c-4f49-a038-ea3d4ea695d6/pull/0.log"
Jul 09 19:28:16.000509 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:16.000485    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62_26d8c542-1981-4013-89eb-c287c6aeba73/extract/0.log"
Jul 09 19:28:16.035521 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:16.035496    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62_26d8c542-1981-4013-89eb-c287c6aeba73/util/0.log"
Jul 09 19:28:16.062948 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:16.062928    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ndp62_26d8c542-1981-4013-89eb-c287c6aeba73/pull/0.log"
Jul 09 19:28:16.643123 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:16.643094    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-85r5m_036b8ff4-e821-41f4-8e5a-d78073a534c8/manager/0.log"
Jul 09 19:28:16.739297 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:16.739225    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-gp5lw_7d57e33b-dd0c-45b0-a38a-2a263eb205fb/manager/0.log"
Jul 09 19:28:19.167656 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:19.167627    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6qxqh_02cd4500-cf5d-4276-a68a-1843a80b4763/node-exporter/0.log"
Jul 09 19:28:19.195203 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:19.195171    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6qxqh_02cd4500-cf5d-4276-a68a-1843a80b4763/kube-rbac-proxy/0.log"
Jul 09 19:28:19.224296 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:19.224278    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6qxqh_02cd4500-cf5d-4276-a68a-1843a80b4763/init-textfile/0.log"
Jul 09 19:28:21.265114 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.265075    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"]
Jul 09 19:28:21.265517 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.265395    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" containerName="istio-proxy"
Jul 09 19:28:21.265517 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.265406    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" containerName="istio-proxy"
Jul 09 19:28:21.265517 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.265415    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02049853-03cd-4fed-bb8d-86ff52f7ef1e" containerName="istio-proxy"
Jul 09 19:28:21.265517 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.265421    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="02049853-03cd-4fed-bb8d-86ff52f7ef1e" containerName="istio-proxy"
Jul 09 19:28:21.265517 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.265441    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02049853-03cd-4fed-bb8d-86ff52f7ef1e" containerName="istio-proxy"
Jul 09 19:28:21.265517 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.265447    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="02049853-03cd-4fed-bb8d-86ff52f7ef1e" containerName="istio-proxy"
Jul 09 19:28:21.265517 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.265496    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="02049853-03cd-4fed-bb8d-86ff52f7ef1e" containerName="istio-proxy"
Jul 09 19:28:21.265517 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.265504    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="02049853-03cd-4fed-bb8d-86ff52f7ef1e" containerName="istio-proxy"
Jul 09 19:28:21.265517 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.265511    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" containerName="istio-proxy"
Jul 09 19:28:21.265517 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.265517    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="be7fadd9-a01e-40e6-b85a-ddb1b7c6bdce" containerName="istio-proxy"
Jul 09 19:28:21.268469 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.268454    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.271302 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.271282    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b6jw8\"/\"kube-root-ca.crt\""
Jul 09 19:28:21.272322 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.272297    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b6jw8\"/\"default-dockercfg-fk46d\""
Jul 09 19:28:21.272434 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.272396    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b6jw8\"/\"openshift-service-ca.crt\""
Jul 09 19:28:21.280163 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.280127    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"]
Jul 09 19:28:21.283025 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.283004    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81c6cc82-d55b-4e07-88df-e07798165726-sys\") pod \"perf-node-gather-daemonset-x2g6h\" (UID: \"81c6cc82-d55b-4e07-88df-e07798165726\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.283129 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.283050    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kz7s\" (UniqueName: \"kubernetes.io/projected/81c6cc82-d55b-4e07-88df-e07798165726-kube-api-access-9kz7s\") pod \"perf-node-gather-daemonset-x2g6h\" (UID: \"81c6cc82-d55b-4e07-88df-e07798165726\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.283129 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.283085    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81c6cc82-d55b-4e07-88df-e07798165726-proc\") pod \"perf-node-gather-daemonset-x2g6h\" (UID: \"81c6cc82-d55b-4e07-88df-e07798165726\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.283285 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.283264    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81c6cc82-d55b-4e07-88df-e07798165726-podres\") pod \"perf-node-gather-daemonset-x2g6h\" (UID: \"81c6cc82-d55b-4e07-88df-e07798165726\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.283344 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.283302    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81c6cc82-d55b-4e07-88df-e07798165726-lib-modules\") pod \"perf-node-gather-daemonset-x2g6h\" (UID: \"81c6cc82-d55b-4e07-88df-e07798165726\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.384392 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.384363    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kz7s\" (UniqueName: \"kubernetes.io/projected/81c6cc82-d55b-4e07-88df-e07798165726-kube-api-access-9kz7s\") pod \"perf-node-gather-daemonset-x2g6h\" (UID: \"81c6cc82-d55b-4e07-88df-e07798165726\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.384548 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.384403    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81c6cc82-d55b-4e07-88df-e07798165726-proc\") pod \"perf-node-gather-daemonset-x2g6h\" (UID: \"81c6cc82-d55b-4e07-88df-e07798165726\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.384548 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.384432    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81c6cc82-d55b-4e07-88df-e07798165726-podres\") pod \"perf-node-gather-daemonset-x2g6h\" (UID: \"81c6cc82-d55b-4e07-88df-e07798165726\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.384548 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.384449    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81c6cc82-d55b-4e07-88df-e07798165726-lib-modules\") pod \"perf-node-gather-daemonset-x2g6h\" (UID: \"81c6cc82-d55b-4e07-88df-e07798165726\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.384548 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.384471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81c6cc82-d55b-4e07-88df-e07798165726-sys\") pod \"perf-node-gather-daemonset-x2g6h\" (UID: \"81c6cc82-d55b-4e07-88df-e07798165726\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.384548 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.384494    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/81c6cc82-d55b-4e07-88df-e07798165726-proc\") pod \"perf-node-gather-daemonset-x2g6h\" (UID: \"81c6cc82-d55b-4e07-88df-e07798165726\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.384548 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.384527    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81c6cc82-d55b-4e07-88df-e07798165726-sys\") pod \"perf-node-gather-daemonset-x2g6h\" (UID: \"81c6cc82-d55b-4e07-88df-e07798165726\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.384548 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.384544    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/81c6cc82-d55b-4e07-88df-e07798165726-podres\") pod \"perf-node-gather-daemonset-x2g6h\" (UID: \"81c6cc82-d55b-4e07-88df-e07798165726\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.384862 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.384621    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81c6cc82-d55b-4e07-88df-e07798165726-lib-modules\") pod \"perf-node-gather-daemonset-x2g6h\" (UID: \"81c6cc82-d55b-4e07-88df-e07798165726\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.397656 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.397627    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kz7s\" (UniqueName: \"kubernetes.io/projected/81c6cc82-d55b-4e07-88df-e07798165726-kube-api-access-9kz7s\") pod \"perf-node-gather-daemonset-x2g6h\" (UID: \"81c6cc82-d55b-4e07-88df-e07798165726\") " pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.578156 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.578048    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.711169 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.711124    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"]
Jul 09 19:28:21.713119 ip-10-0-141-47 kubenswrapper[2562]: W0709 19:28:21.713089    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod81c6cc82_d55b_4e07_88df_e07798165726.slice/crio-a0b6523afab73aaaf5d055022e0a0eced0b52b8279f5bff4683dd6cb6c305752 WatchSource:0}: Error finding container a0b6523afab73aaaf5d055022e0a0eced0b52b8279f5bff4683dd6cb6c305752: Status 404 returned error can't find the container with id a0b6523afab73aaaf5d055022e0a0eced0b52b8279f5bff4683dd6cb6c305752
Jul 09 19:28:21.908031 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.907937    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h" event={"ID":"81c6cc82-d55b-4e07-88df-e07798165726","Type":"ContainerStarted","Data":"14bce3d1c33f48074bcf90b2787c523bc31f002d0377f4ee4d6cd8a3a5ffadec"}
Jul 09 19:28:21.908031 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.908000    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:21.908031 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.908021    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h" event={"ID":"81c6cc82-d55b-4e07-88df-e07798165726","Type":"ContainerStarted","Data":"a0b6523afab73aaaf5d055022e0a0eced0b52b8279f5bff4683dd6cb6c305752"}
Jul 09 19:28:21.929768 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:21.929724    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h" podStartSLOduration=0.929708404 podStartE2EDuration="929.708404ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 19:28:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 19:28:21.927027237 +0000 UTC m=+2836.288174419" watchObservedRunningTime="2026-07-09 19:28:21.929708404 +0000 UTC m=+2836.290855586"
Jul 09 19:28:22.427862 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:22.427837    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-867d8958b9-dmghn_58791f9c-d4d6-4ffd-8fa2-316478c5bf9a/console/0.log"
Jul 09 19:28:24.238186 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:24.238132    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8fz5c_29a841a1-eb99-4d6d-9b45-3b3c9a179692/dns/0.log"
Jul 09 19:28:24.264569 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:24.264535    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8fz5c_29a841a1-eb99-4d6d-9b45-3b3c9a179692/kube-rbac-proxy/0.log"
Jul 09 19:28:24.348694 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:24.348669    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m7pwm_336b9318-00cd-482e-9705-569526f009d1/dns-node-resolver/0.log"
Jul 09 19:28:25.058032 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:25.058008    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qg8vv_287d24b2-f189-4492-bd7f-cfbd8eccf639/node-ca/0.log"
Jul 09 19:28:26.204527 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:26.204493    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gt69d_d0d6a4b2-ee86-4779-841d-aea2539d7bff/discovery/0.log"
Jul 09 19:28:26.266914 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:26.266889    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74785d646-vbb6l_6a8c8745-aacd-445d-9863-47221b2a35fd/kube-auth-proxy/0.log"
Jul 09 19:28:27.195001 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:27.194972    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cbcpb_3d4366a5-595b-4864-8916-55bf0b2e8fa7/serve-healthcheck-canary/0.log"
Jul 09 19:28:27.852950 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:27.852919    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hjrpq_7aa21fba-2be2-47eb-b842-788e9df26b67/kube-rbac-proxy/0.log"
Jul 09 19:28:27.883603 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:27.883573    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hjrpq_7aa21fba-2be2-47eb-b842-788e9df26b67/exporter/0.log"
Jul 09 19:28:27.911892 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:27.911871    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hjrpq_7aa21fba-2be2-47eb-b842-788e9df26b67/extractor/0.log"
Jul 09 19:28:27.923062 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:27.923044    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b6jw8/perf-node-gather-daemonset-x2g6h"
Jul 09 19:28:30.318308 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:30.318277    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7r547_cc86467c-2b93-41bd-bc91-c4aa34391ad8/manager/0.log"
Jul 09 19:28:30.471584 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:30.471538    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-gbv8b_29cc67ca-be89-4bca-92bd-b7c56da729e5/manager/0.log"
Jul 09 19:28:30.679433 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:30.679403    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jg66j_97abeaaa-d4cc-46c9-96d3-76ae5b72a3de/manager/0.log"
Jul 09 19:28:30.781789 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:30.781760    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fbd77dc5f-nmvjq_c5cc68d5-7e0c-462f-ad82-32482f62b2a9/manager/0.log"
Jul 09 19:28:30.813692 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:30.813669    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fbd77dc5f-nmvjq_c5cc68d5-7e0c-462f-ad82-32482f62b2a9/copy-manifests/0.log"
Jul 09 19:28:31.768896 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:31.768859    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gt69d_d0d6a4b2-ee86-4779-841d-aea2539d7bff/discovery/0.log"
Jul 09 19:28:31.799411 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:31.799388    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74785d646-vbb6l_6a8c8745-aacd-445d-9863-47221b2a35fd/kube-auth-proxy/0.log"
Jul 09 19:28:33.301959 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:33.301928    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gt69d_d0d6a4b2-ee86-4779-841d-aea2539d7bff/discovery/0.log"
Jul 09 19:28:33.342586 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:33.342564    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-74785d646-vbb6l_6a8c8745-aacd-445d-9863-47221b2a35fd/kube-auth-proxy/0.log"
Jul 09 19:28:37.938204 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:37.938171    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-z2mjx_f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6/kube-storage-version-migrator-operator/1.log"
Jul 09 19:28:37.939228 ip-10-0-141-47 kubenswrapper[2562]: I0709 19:28:37.939205    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-z2mjx_f09921b9-de59-41bb-bf2f-9e9d6dd5d4b6/kube-storage-version-migrator-operator/0.log"