Jul 09 22:08:21.275299 ip-10-0-143-205 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 22:08:21.275312 ip-10-0-143-205 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 22:08:21.275324 ip-10-0-143-205 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 22:08:21.275672 ip-10-0-143-205 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 22:08:31.524170 ip-10-0-143-205 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 22:08:31.524190 ip-10-0-143-205 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4da81f13566d486ea41773864415307d --
Jul 09 22:10:30.450039 ip-10-0-143-205 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 22:10:32.194788 ip-10-0-143-205 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 22:10:32.194788 ip-10-0-143-205 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 22:10:32.194788 ip-10-0-143-205 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 22:10:32.194788 ip-10-0-143-205 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 22:10:32.194788 ip-10-0-143-205 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 22:10:32.195830 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.195741    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 22:10:32.201309 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201290    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:10:32.201309 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201310    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201313    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201317    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201320    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201323    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201326    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201330    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201333    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201335    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201340    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201344    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201347    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201350    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201353    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201356    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201359    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201362    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201365    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201367    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:10:32.201387 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201370    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201373    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201376    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201378    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201382    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201385    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201388    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201391    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201393    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201396    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201401    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201404    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201406    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201409    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201411    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201414    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201417    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201420    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201422    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201425    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201427    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:10:32.201874 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201430    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201432    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201435    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201437    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201441    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201443    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201445    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201448    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201450    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201453    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201455    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201458    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201460    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201463    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201466    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201469    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201472    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201474    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201477    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201479    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:10:32.202403 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201482    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201484    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201489    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201492    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201495    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201497    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201500    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201502    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201505    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201507    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201509    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201512    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201515    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201517    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201519    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201522    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201524    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201528    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201530    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:10:32.202891 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201534    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201538    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201540    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201543    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201545    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201547    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201551    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201554    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201557    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201560    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201563    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201565    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201568    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201570    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201573    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201575    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201578    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201581    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.201583    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202346    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:10:32.203361 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202353    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202357    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202360    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202363    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202366    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202369    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202372    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202374    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202377    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202380    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202382    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202385    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202388    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202391    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202393    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202396    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202399    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202402    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202406    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202408    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:10:32.203830 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202412    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202414    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202417    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202420    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202422    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202425    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202427    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202430    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202432    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202437    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202440    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202443    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202445    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202448    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202450    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202453    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202457    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202461    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202464    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:10:32.204574 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202467    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202470    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202474    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202478    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202480    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202483    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202485    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202488    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202490    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202493    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202496    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202499    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202501    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202504    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202507    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202510    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202512    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202515    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202518    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202520    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:10:32.205336 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202523    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202525    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202528    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202533    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202535    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202538    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202540    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202543    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202545    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202548    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202550    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202553    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202555    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202558    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202561    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202563    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202566    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202568    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202571    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:10:32.205946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202575    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202579    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202584    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202587    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202592    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202595    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202597    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202600    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202602    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202605    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202608    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202610    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202612    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202615    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202618    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202620    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202623    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202626    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202629    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.202631    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:10:32.206537 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203006    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203011    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203013    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203016    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203018    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203021    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203023    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203026    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203029    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203031    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203034    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203037    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203039    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203042    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203044    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203047    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203050    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203053    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203056    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203058    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:10:32.207025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203061    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203066    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203069    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203073    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203076    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203078    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203082    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203084    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203104    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203107    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203110    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203112    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203115    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203119    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203123    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203126    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203129    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203132    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203134    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:10:32.207536 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203137    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203139    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203142    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203145    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203148    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203150    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203153    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203155    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203158    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203161    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203164    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203166    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203169    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203171    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203174    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203176    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203179    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203181    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203184    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203186    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:10:32.208021 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203189    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203191    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203194    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203197    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203199    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203202    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203204    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203207    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203209    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203213    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203216    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203218    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203221    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203223    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203226    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203228    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203231    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203234    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203236    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203239    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:10:32.208515 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203241    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203244    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203247    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203250    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203252    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203255    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203258    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203260    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203262    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203265    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203267    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203270    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203272    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203275    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203277    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203280    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203287    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203290    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203293    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:10:32.208999 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.203296    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203372    2583 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203379    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203386    2583 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203390    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203395    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203398    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203403    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203407    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203410    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203414    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203417    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203421    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203424    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203427    2583 flags.go:64] FLAG: --cgroup-root=""
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203430    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203434    2583 flags.go:64] FLAG: --client-ca-file=""
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203436    2583 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203439    2583 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203443    2583 flags.go:64] FLAG: --cluster-domain=""
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203445    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203448    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203452    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203455    2583 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 22:10:32.209501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203459    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203462    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203465    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203468    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203471    2583 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203475    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203479    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203482    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203484    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203489    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203492    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203495    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203498    2583 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203501    2583 flags.go:64] FLAG: --enable-server="true"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203504    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203508    2583 flags.go:64] FLAG: --event-burst="100"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203511    2583 flags.go:64] FLAG: --event-qps="50"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203514    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203517    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203520    2583 flags.go:64] FLAG: --eviction-hard=""
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203524    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203527    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203530    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203533    2583 flags.go:64] FLAG: --eviction-soft=""
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203536    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 22:10:32.210075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203539    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203542    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203545    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203547    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203550    2583 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203553    2583 flags.go:64] FLAG: --feature-gates=""
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203556    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203559    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203562    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203565    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203569    2583 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203572    2583 flags.go:64] FLAG: --help="false"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203575    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203578    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203582    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203585    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203588    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203591    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203597    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203600    2583 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203602    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203605    2583 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203608    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203611    2583 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 22:10:32.210692 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203614    2583 flags.go:64] FLAG: --kube-reserved=""
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203617    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203620    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203623    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203626    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203628    2583 flags.go:64] FLAG: --lock-file=""
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203631    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203634    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203637    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203642    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203645    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203648    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203651    2583 flags.go:64] FLAG: --logging-format="text"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203653    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203657    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203659    2583 flags.go:64] FLAG: --manifest-url=""
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203662    2583 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203667    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203670    2583 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203678    2583 flags.go:64] FLAG: --max-pods="110"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203682    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203685    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203688    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203692    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203695    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 22:10:32.211300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203698    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203702    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203709    2583 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203712    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203715    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203718    2583 flags.go:64] FLAG: --pod-cidr=""
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203721    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203727    2583 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203730    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203733    2583 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203736    2583 flags.go:64] FLAG: --port="10250"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203739    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203743    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0640f8f8ae8e598ae"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203746    2583 flags.go:64] FLAG: --qos-reserved=""
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203749    2583 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203752    2583 flags.go:64] FLAG: --register-node="true"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203755    2583 flags.go:64] FLAG: --register-with-taints=""
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203758    2583 flags.go:64] FLAG: --registry-burst="10"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203761    2583 flags.go:64] FLAG: --registry-qps="5"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203764    2583 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203767    2583 flags.go:64] FLAG: --reserved-memory=""
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203770    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203773    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203776    2583 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203779    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 22:10:32.211906 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203782    2583 flags.go:64] FLAG: --runonce="false"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203784    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203788    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203791    2583 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203794    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203796    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203800    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203803    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203807    2583 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203811    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203813    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203816    2583 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203819    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203822    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203825    2583 flags.go:64] FLAG: --system-cgroups=""
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203828    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203833    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203836    2583 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203839    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203843    2583 flags.go:64] FLAG: --tls-min-version=""
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203846    2583 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203848    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203851    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203854    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203857    2583 flags.go:64] FLAG: --v="2"
Jul 09 22:10:32.213042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203862    2583 flags.go:64] FLAG: --version="false"
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203866    2583 flags.go:64] FLAG: --vmodule=""
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203869    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.203872    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204722    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204747    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204753    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204759    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204763    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204771    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204776    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204781    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204786    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204796    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204801    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204805    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204813    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204817    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204822    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204826    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204831    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:10:32.213717 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204835    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204839    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204843    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204848    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204852    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204860    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204865    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204870    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204874    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204878    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204883    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204887    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204892    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204896    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204900    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204905    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204909    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204918    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204923    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204927    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:10:32.214239 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204933    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204938    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204942    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204946    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204950    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204954    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204959    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204966    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204970    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204975    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204984    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204989    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204993    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.204997    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205002    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205007    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205011    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205015    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205020    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:10:32.214735 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205024    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205028    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205034    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205038    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205049    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205054    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205059    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205063    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205067    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205072    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205076    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205081    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205101    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205108    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205112    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205117    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205126    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205131    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205138    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:10:32.215209 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205144    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205151    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205157    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205161    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205165    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205170    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205174    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205178    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205182    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205191    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205195    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205199    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205203    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205207    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205212    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205216    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205220    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205225    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205229    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:10:32.215669 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205233    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:10:32.216146 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205240    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:10:32.216146 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205246    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:10:32.216146 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205255    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:10:32.216146 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.205260    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:10:32.216146 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.205918    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 22:10:32.216146 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.212704    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 22:10:32.216146 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.212721    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 22:10:32.216146 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.213435    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 22:10:32.216146 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.213443    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 22:10:32.216146 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213503    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:10:32.216146 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213508    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:10:32.216146 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213512    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:10:32.216146 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213515    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:10:32.216146 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213518    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213521    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213524    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213527    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213530    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213533    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213536    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213539    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213542    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213545    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213547    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213551    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213553    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213556    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213559    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213562    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213564    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213567    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213569    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213573    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:10:32.216492 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213575    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213579    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213581    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213584    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213588    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213591    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213593    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213596    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213599    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213602    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213605    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213619    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213623    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213626    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213629    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213633    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213636    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213639    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213641    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213644    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:10:32.216979 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213647    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213650    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213652    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213655    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213658    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213661    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213663    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213666    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213678    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213682    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213685    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213688    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213690    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213693    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213696    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213700    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213703    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213705    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213708    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:10:32.217501 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213712    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213716    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213719    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213722    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213724    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213727    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213730    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213733    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213736    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213738    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213741    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213743    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213747    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213750    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213753    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213756    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213759    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213762    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213765    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:10:32.217967 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213768    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:10:32.218464 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213770    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:10:32.218464 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213773    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:10:32.218464 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213775    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:10:32.218464 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213778    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:10:32.218464 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213781    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:10:32.218464 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213783    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:10:32.218464 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213786    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:10:32.218464 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213788    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:10:32.218464 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213791    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:10:32.218464 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213794    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:10:32.218464 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213797    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:10:32.218464 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213799    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:10:32.218464 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213802    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:10:32.218464 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213805    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:10:32.218464 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213807    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:10:32.218464 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213810    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:10:32.218853 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.213815    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 22:10:32.218853 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213939    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 22:10:32.218853 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213944    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 22:10:32.218853 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213948    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 22:10:32.218853 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213951    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 22:10:32.218853 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213954    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 22:10:32.218853 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213956    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 22:10:32.218853 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213959    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 22:10:32.218853 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213962    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 22:10:32.218853 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213965    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 22:10:32.218853 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213967    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 22:10:32.218853 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213970    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 22:10:32.218853 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213973    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 22:10:32.218853 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213976    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 22:10:32.218853 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213979    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213982    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213984    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213987    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213989    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213992    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213995    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.213997    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214000    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214003    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214005    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214008    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214011    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214013    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214016    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214019    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214022    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214024    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214027    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214030    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 22:10:32.219241 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214032    2583 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214034    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214038    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214042    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214046    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214050    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214053    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214056    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214058    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214061    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214064    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214067    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214069    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214072    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214074    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214077    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214079    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214082    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214084    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 22:10:32.219761 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214099    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214102    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214104    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214107    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214110    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214113    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214116    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214119    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214123    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214126    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214129    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214132    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214135    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214138    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214141    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214143    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214147    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214150    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214152    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 22:10:32.220238 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214155    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214157    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214160    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214162    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214165    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214168    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214170    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214173    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214176    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214178    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214181    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214183    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214185    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214188    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214191    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214193    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214196    2583 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214199    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214201    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214204    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 22:10:32.220697 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214207    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 22:10:32.221189 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214209    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 22:10:32.221189 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214212    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 22:10:32.221189 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214214    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 22:10:32.221189 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214217    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 22:10:32.221189 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214219    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 22:10:32.221189 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214222    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 22:10:32.221189 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:32.214224    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 22:10:32.221189 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.214230    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 22:10:32.221189 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.214367    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 22:10:32.221189 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.216503    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 22:10:32.221189 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.217990    2583 server.go:1019] "Starting client certificate rotation"
Jul 09 22:10:32.221189 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.218107    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 22:10:32.221189 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.218145    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 22:10:32.221519 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.220395    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 22:10:32.224840 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.224821    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 22:10:32.233306 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.233289    2583 log.go:25] "Validated CRI v1 runtime API"
Jul 09 22:10:32.236644 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.236629    2583 log.go:25] "Validated CRI v1 image API"
Jul 09 22:10:32.237464 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.237450    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 22:10:32.241395 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.241368    2583 fs.go:135] Filesystem UUIDs: map[29f62610-fa13-40e4-b2f7-180ec0dd598a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b0cf28b1-3707-46bc-81ed-50ad572a8f59:/dev/nvme0n1p4]
Jul 09 22:10:32.241450 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.241394    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 22:10:32.246838 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.246692    2583 manager.go:216] Machine: {Timestamp:2026-07-09 22:10:32.245278765 +0000 UTC m=+0.324048587 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100308 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fec82b1b6eebd3c190d0c4f354c76 SystemUUID:ec2fec82-b1b6-eebd-3c19-0d0c4f354c76 BootID:4da81f13-566d-486e-a417-73864415307d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fc:51:3b:f4:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fc:51:3b:f4:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:4d:9b:2f:7f:4c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 22:10:32.246838 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.246830    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 22:10:32.246989 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.246971    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 22:10:32.249440 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.249420    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 22:10:32.250285 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.250255    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 22:10:32.250419 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.250288    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-205.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 22:10:32.251469 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.251457    2583 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 22:10:32.251501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.251474    2583 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 22:10:32.251501 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.251482    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 22:10:32.252196 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.252185    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 22:10:32.253345 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.253335    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 22:10:32.257143 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.257130    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 22:10:32.257269 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.257260    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 22:10:32.257299 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.257291    2583 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 22:10:32.257326 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.257301    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 22:10:32.257326 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.257313    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 22:10:32.257326 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.257321    2583 kubelet.go:398] "Adding apiserver pod source"
Jul 09 22:10:32.257473 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.257330    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 22:10:32.257734 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.257721    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 22:10:32.257775 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.257746    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 22:10:32.259921 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.259890    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 22:10:32.261924 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.261910    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 22:10:32.261969 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.261941    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 22:10:32.263082 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.263070    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 22:10:32.263136 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.263100    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 22:10:32.263136 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.263110    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 22:10:32.263136 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.263118    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 22:10:32.263136 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.263126    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 22:10:32.263136 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.263132    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 22:10:32.263272 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.263140    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 22:10:32.263272 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.263145    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 22:10:32.263272 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.263153    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 22:10:32.263272 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.263159    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 22:10:32.263272 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.263167    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 22:10:32.263272 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.263173    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 22:10:32.263902 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.263889    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 22:10:32.263931 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.263907    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 22:10:32.267422 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.267407    2583 server.go:1268] "Started kubelet"
Jul 09 22:10:32.267626 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.267590    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 22:10:32.267744 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.267615    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 22:10:32.267853 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.267829    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 22:10:32.268477 ip-10-0-143-205 systemd[1]: Started Kubernetes Kubelet.
Jul 09 22:10:32.269251 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.269044    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-205.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 22:10:32.269251 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.269100    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 22:10:32.269251 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.269105    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 22:10:32.269978 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.269963    2583 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 22:10:32.270999 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.270981    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v5phz"
Jul 09 22:10:32.272474 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.272456    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 22:10:32.272759 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.271883    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-205.ec2.internal.18c0be9c9b3d439c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-205.ec2.internal,UID:ip-10-0-143-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-205.ec2.internal,},FirstTimestamp:2026-07-09 22:10:32.267375516 +0000 UTC m=+0.346145186,LastTimestamp:2026-07-09 22:10:32.267375516 +0000 UTC m=+0.346145186,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-205.ec2.internal,}"
Jul 09 22:10:32.273760 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.273741    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 22:10:32.276623 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.276609    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v5phz"
Jul 09 22:10:32.276933 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.276919    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 22:10:32.276996 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.276936    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 22:10:32.277136 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.277120    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 09 22:10:32.277987 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.277950    2583 factory.go:55] Registering systemd factory
Jul 09 22:10:32.277987 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.277971    2583 factory.go:223] Registration of the systemd container factory successfully
Jul 09 22:10:32.277987 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.277989    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 22:10:32.278199 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.277993    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 22:10:32.278199 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.278050    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 22:10:32.278199 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.278140    2583 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 22:10:32.278199 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.278149    2583 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 22:10:32.278329 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.278216    2583 factory.go:153] Registering CRI-O factory
Jul 09 22:10:32.278329 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.278227    2583 factory.go:223] Registration of the crio container factory successfully
Jul 09 22:10:32.278329 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.278281    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 22:10:32.278329 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.278301    2583 factory.go:103] Registering Raw factory
Jul 09 22:10:32.278329 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.278313    2583 manager.go:1196] Started watching for new ooms in manager
Jul 09 22:10:32.279040 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.279009    2583 manager.go:349] Starting recovery of all containers
Jul 09 22:10:32.282424 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.282390    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 22:10:32.282551 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.282526    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 22:10:32.292536 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.292380    2583 manager.go:354] Recovery completed
Jul 09 22:10:32.296874 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.296859    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:10:32.298745 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.298725    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:10:32.298816 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.298757    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:10:32.298816 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.298767    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:10:32.299338 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.299322    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 22:10:32.299393 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.299345    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:10:32.299393 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.299347    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 22:10:32.299393 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.299381    2583 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 22:10:32.299999 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.299984    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:10:32.300052 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.300010    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:10:32.300052 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.300022    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:10:32.301475 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.301463    2583 policy_none.go:49] "None policy: Start"
Jul 09 22:10:32.301511 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.301480    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 22:10:32.301511 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.301490    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 22:10:32.303451 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.303436    2583 policy_none.go:47] "Start"
Jul 09 22:10:32.343894 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.343872    2583 manager.go:337] "Starting Device Plugin manager"
Jul 09 22:10:32.344038 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.343919    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 22:10:32.344038 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.343929    2583 server.go:87] "Starting device plugin registration server"
Jul 09 22:10:32.344274 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.344256    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 22:10:32.344385 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.344274    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 22:10:32.344441 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.344379    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 22:10:32.344486 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.344467    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 22:10:32.344486 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.344476    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 22:10:32.345032 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.345008    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 22:10:32.345144 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.345070    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 09 22:10:32.445370 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.445315    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:10:32.447385 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.447081    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:10:32.447385 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.447123    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:10:32.447385 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.447134    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:10:32.447385 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.447172    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.455738 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.455709    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.455738 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.455744    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-205.ec2.internal\": node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 09 22:10:32.471949 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.471923    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 09 22:10:32.478708 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.478679    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 22:10:32.479905 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.479887    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 22:10:32.480002 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.479944    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 22:10:32.480002 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.479969    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 22:10:32.480083 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.480009    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 22:10:32.482270 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.482249    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:10:32.572339 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.572305    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 09 22:10:32.580683 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.580630    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"]
Jul 09 22:10:32.580748 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.580709    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:10:32.582933 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.582915    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:10:32.583045 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.582953    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:10:32.583045 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.582967    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:10:32.585247 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.585232    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:10:32.585374 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.585347    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.585421 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.585388    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:10:32.585935 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.585917    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:10:32.586019 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.585939    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:10:32.586019 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.585952    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:10:32.586107 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.585951    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:10:32.586107 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.586041    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:10:32.586107 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.586052    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:10:32.588250 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.588235    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.588396 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.588259    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 22:10:32.589523 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.589509    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 22:10:32.589621 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.589534    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 22:10:32.589621 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.589547    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeHasSufficientPID"
Jul 09 22:10:32.613906 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.613874    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-205.ec2.internal\" not found" node="ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.618392 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.618372    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-205.ec2.internal\" not found" node="ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.672778 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.672742    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 09 22:10:32.680055 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.680026    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/443b95f9a11c785c66a6608d9d6fba98-config\") pod \"kube-apiserver-proxy-ip-10-0-143-205.ec2.internal\" (UID: \"443b95f9a11c785c66a6608d9d6fba98\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.680210 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.680061    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98feeb3b547af7c850dfc4e76f035021-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"98feeb3b547af7c850dfc4e76f035021\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.680210 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.680112    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98feeb3b547af7c850dfc4e76f035021-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"98feeb3b547af7c850dfc4e76f035021\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.773518 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.773476    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 09 22:10:32.780932 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.780903    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/443b95f9a11c785c66a6608d9d6fba98-config\") pod \"kube-apiserver-proxy-ip-10-0-143-205.ec2.internal\" (UID: \"443b95f9a11c785c66a6608d9d6fba98\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.781030 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.780940    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98feeb3b547af7c850dfc4e76f035021-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"98feeb3b547af7c850dfc4e76f035021\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.781030 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.780966    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98feeb3b547af7c850dfc4e76f035021-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"98feeb3b547af7c850dfc4e76f035021\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.781030 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.781009    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98feeb3b547af7c850dfc4e76f035021-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"98feeb3b547af7c850dfc4e76f035021\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.781030 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.781023    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/443b95f9a11c785c66a6608d9d6fba98-config\") pod \"kube-apiserver-proxy-ip-10-0-143-205.ec2.internal\" (UID: \"443b95f9a11c785c66a6608d9d6fba98\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.781195 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.781011    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98feeb3b547af7c850dfc4e76f035021-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal\" (UID: \"98feeb3b547af7c850dfc4e76f035021\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.874171 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.874077    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 09 22:10:32.917661 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.917629    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.922450 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:32.922299    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 09 22:10:32.974696 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:32.974652    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 09 22:10:33.075281 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:33.075249    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 09 22:10:33.175876 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:33.175797    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 09 22:10:33.217358 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:33.217312    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 22:10:33.217947 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:33.217491    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 22:10:33.275998 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:33.275967    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 09 22:10:33.282015 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:33.281987    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 22:05:32 +0000 UTC" deadline="2028-04-08 01:04:29.753827852 +0000 UTC"
Jul 09 22:10:33.282113 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:33.282015    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15314h53m56.471816847s"
Jul 09 22:10:33.376374 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:33.376339    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 09 22:10:33.476878 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:33.476847    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 09 22:10:33.577387 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:33.577361    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 09 22:10:33.583762 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:33.583711    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98feeb3b547af7c850dfc4e76f035021.slice/crio-c31e651f81ac0be7dfe05bbb13afe0d86d32e8275dd5016e3a98f9633183b18c WatchSource:0}: Error finding container c31e651f81ac0be7dfe05bbb13afe0d86d32e8275dd5016e3a98f9633183b18c: Status 404 returned error can't find the container with id c31e651f81ac0be7dfe05bbb13afe0d86d32e8275dd5016e3a98f9633183b18c
Jul 09 22:10:33.583995 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:33.583975    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod443b95f9a11c785c66a6608d9d6fba98.slice/crio-91bdd7daed4f5314cf05fae9f030b08910e97429bc6a7c3b38450b4efa58e697 WatchSource:0}: Error finding container 91bdd7daed4f5314cf05fae9f030b08910e97429bc6a7c3b38450b4efa58e697: Status 404 returned error can't find the container with id 91bdd7daed4f5314cf05fae9f030b08910e97429bc6a7c3b38450b4efa58e697
Jul 09 22:10:33.588526 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:33.588504    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:10:33.658372 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:33.658340    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:10:33.678414 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:33.678371    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-205.ec2.internal\" not found"
Jul 09 22:10:33.690412 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:33.690380    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:10:33.728030 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:33.727967    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:10:33.777708 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:33.777669    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal"
Jul 09 22:10:33.787901 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:33.787873    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 22:10:33.788835 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:33.788821    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal"
Jul 09 22:10:33.796118 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:33.796083    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 22:10:34.258468 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.258434    2583 apiserver.go:52] "Watching apiserver"
Jul 09 22:10:34.264143 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.264113    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 22:10:34.265482 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.265446    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal","openshift-multus/multus-additional-cni-plugins-vmrx9","openshift-multus/multus-z44pj","openshift-multus/network-metrics-daemon-f7pqt","openshift-network-diagnostics/network-check-target-hg95s","kube-system/konnectivity-agent-szwg5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr","openshift-cluster-node-tuning-operator/tuned-d9jgn","openshift-dns/node-resolver-psgll","openshift-image-registry/node-ca-cfzct","openshift-network-operator/iptables-alerter-5ftfk","openshift-ovn-kubernetes/ovnkube-node-8tn8n","kube-system/global-pull-secret-syncer-p6khq"]
Jul 09 22:10:34.268308 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.268285    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-szwg5"
Jul 09 22:10:34.270343 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.270322    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vfwm7\""
Jul 09 22:10:34.270580 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.270562    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 22:10:34.270786 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.270770    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 22:10:34.271057 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.271029    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.274065 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.273146    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 22:10:34.274065 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.273197    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 22:10:34.274065 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.273293    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 22:10:34.274065 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.273392    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 22:10:34.274065 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.273499    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 22:10:34.274065 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.273806    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dr7vx\""
Jul 09 22:10:34.274065 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.274045    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 22:10:34.274569 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.274049    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.275491 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.275474    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.275872 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.275854    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s55gs\""
Jul 09 22:10:34.276293 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.276277    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 22:10:34.276495 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.276473    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 22:10:34.276711 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.276695    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 22:10:34.276884 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.276870    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 22:10:34.277523 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.277258    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 22:10:34.277523 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.277514    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 22:10:34.279115 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.277710    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8l6qk\""
Jul 09 22:10:34.279115 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.277945    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:34.279115 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:34.278014    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:10:34.279115 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.278263    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 22:10:34.280849 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.280833    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:34.281040 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:34.281020    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:10:34.283355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.283335    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.285827 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.285701    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:34.285827 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:34.285770    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:10:34.286270 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.286047    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b5fbb\""
Jul 09 22:10:34.286393 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.286355    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 22:10:34.286602 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.286583    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:10:34.289387 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.289251    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.290715 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.290121    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-etc-kubernetes\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.290715 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.290167    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-var-lib-openvswitch\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.290715 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.290194    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-run-ovn\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.290715 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.290226    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqtfr\" (UniqueName: \"kubernetes.io/projected/ed1f8267-9041-450b-9d31-a2f42b2c8f59-kube-api-access-zqtfr\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.290715 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.290348    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-var-lib-cni-multus\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.290715 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.290375    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-var-lib-kubelet\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.290715 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.290406    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.290715 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.290430    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-node-log\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.290715 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.290474    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed1f8267-9041-450b-9d31-a2f42b2c8f59-env-overrides\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.290715 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.290696    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-multus-cni-dir\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.291239 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.290728    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-cnibin\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.291239 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.290758    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-multus-socket-dir-parent\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.291340 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291265    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 22:10:34.291389 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291340    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a62328f6-9c5a-495a-ab45-07f1540010ee-multus-daemon-config\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.291389 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291382    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5rcn\" (UniqueName: \"kubernetes.io/projected/a62328f6-9c5a-495a-ab45-07f1540010ee-kube-api-access-m5rcn\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.291545 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-run-openvswitch\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.291545 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291405    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vx9jf\""
Jul 09 22:10:34.291545 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291446    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-cni-bin\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.291545 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291493    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed1f8267-9041-450b-9d31-a2f42b2c8f59-ovnkube-config\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.291545 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291520    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 22:10:34.292057 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291553    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-system-cni-dir\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.292057 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291603    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a62328f6-9c5a-495a-ab45-07f1540010ee-cni-binary-copy\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.292057 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291663    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-var-lib-cni-bin\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.292057 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291720    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-multus-conf-dir\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.292057 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291756    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs\") pod \"network-metrics-daemon-f7pqt\" (UID: \"6fd3da1e-960c-4bee-99b1-a621408855fe\") " pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:34.292057 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291786    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-slash\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.292057 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291836    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-etc-openvswitch\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.292057 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291889    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-run-ovn-kubernetes\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.292057 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291920    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed1f8267-9041-450b-9d31-a2f42b2c8f59-ovn-node-metrics-cert\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.292057 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.291999    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-cnibin\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.292057 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292038    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-hostroot\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.292765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292072    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcf1ce0b-19bb-4020-848a-9fc663ce7136-agent-certs\") pod \"konnectivity-agent-szwg5\" (UID: \"dcf1ce0b-19bb-4020-848a-9fc663ce7136\") " pod="kube-system/konnectivity-agent-szwg5"
Jul 09 22:10:34.292765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292117    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 22:10:34.292765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292120    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-kubelet\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.292765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292151    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.292765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292185    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.292765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292215    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-os-release\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.292765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292248    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-os-release\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.292765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292279    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-systemd-units\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.292765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292320    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-run-netns\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.292765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292375    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-log-socket\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.292765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292408    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-cni-netd\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.292765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292438    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-system-cni-dir\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.292765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292475    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.292765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292511    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxnx7\" (UniqueName: \"kubernetes.io/projected/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-kube-api-access-dxnx7\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.292765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292542    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-run-k8s-cni-cncf-io\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.292765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292583    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj54z\" (UniqueName: \"kubernetes.io/projected/6fd3da1e-960c-4bee-99b1-a621408855fe-kube-api-access-cj54z\") pod \"network-metrics-daemon-f7pqt\" (UID: \"6fd3da1e-960c-4bee-99b1-a621408855fe\") " pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:34.293479 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292607    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrd2q\" (UniqueName: \"kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q\") pod \"network-check-target-hg95s\" (UID: \"d961f45b-9c6d-4c31-8b5a-8f7fa95107ee\") " pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:34.293479 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292634    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcf1ce0b-19bb-4020-848a-9fc663ce7136-konnectivity-ca\") pod \"konnectivity-agent-szwg5\" (UID: \"dcf1ce0b-19bb-4020-848a-9fc663ce7136\") " pod="kube-system/konnectivity-agent-szwg5"
Jul 09 22:10:34.293479 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292663    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-run-systemd\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.293479 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292692    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed1f8267-9041-450b-9d31-a2f42b2c8f59-ovnkube-script-lib\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.293479 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292799    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.293479 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292826    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-run-netns\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.293479 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.292855    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-run-multus-certs\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.293479 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.293162    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-psgll"
Jul 09 22:10:34.295052 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.295031    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 22:10:34.295500 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.295481    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-prqwd\""
Jul 09 22:10:34.295767 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.295600    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 22:10:34.295868 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.295811    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cfzct"
Jul 09 22:10:34.298043 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.298022    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 22:10:34.298151 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.298047    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 22:10:34.298151 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.298083    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6rjwr\""
Jul 09 22:10:34.298488 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.298312    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 22:10:34.299421 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.299399    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5ftfk"
Jul 09 22:10:34.301847 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.301635    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 22:10:34.301847 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.301643    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:10:34.301847 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.301798    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 22:10:34.302386 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.302367    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hwhtg\""
Jul 09 22:10:34.327077 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.327057    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 22:10:34.327218 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.327147    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f66sj"
Jul 09 22:10:34.330627 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.330606    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f66sj"
Jul 09 22:10:34.379829 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.379791    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 22:10:34.393205 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393166    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrd2q\" (UniqueName: \"kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q\") pod \"network-check-target-hg95s\" (UID: \"d961f45b-9c6d-4c31-8b5a-8f7fa95107ee\") " pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:34.393205 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393209    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc28x\" (UniqueName: \"kubernetes.io/projected/1f1cf532-03a5-4ce5-b9ae-e71789ef7111-kube-api-access-tc28x\") pod \"node-ca-cfzct\" (UID: \"1f1cf532-03a5-4ce5-b9ae-e71789ef7111\") " pod="openshift-image-registry/node-ca-cfzct"
Jul 09 22:10:34.393451 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393235    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86h2p\" (UniqueName: \"kubernetes.io/projected/fdee50e0-0243-41d9-8360-11b3e4749a09-kube-api-access-86h2p\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.393451 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393262    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-run-k8s-cni-cncf-io\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.393451 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393285    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-kubernetes\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.393451 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393304    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-sysctl-conf\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.393451 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-run-systemd\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.393451 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393365    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed1f8267-9041-450b-9d31-a2f42b2c8f59-ovnkube-script-lib\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.393451 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393400    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-run-multus-certs\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.393451 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393425    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f1cf532-03a5-4ce5-b9ae-e71789ef7111-serviceca\") pod \"node-ca-cfzct\" (UID: \"1f1cf532-03a5-4ce5-b9ae-e71789ef7111\") " pod="openshift-image-registry/node-ca-cfzct"
Jul 09 22:10:34.393451 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393449    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-kubelet-config\") pod \"global-pull-secret-syncer-p6khq\" (UID: \"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1\") " pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:34.393904 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393472    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-run-ovn\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.393904 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393498    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-var-lib-cni-multus\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.393904 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393521    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-device-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.393904 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393544    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-run-systemd\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.393904 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393550    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.393904 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393585    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-node-log\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.393904 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393618    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-multus-cni-dir\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.393904 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393640    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-run-k8s-cni-cncf-io\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.393904 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393643    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5rcn\" (UniqueName: \"kubernetes.io/projected/a62328f6-9c5a-495a-ab45-07f1540010ee-kube-api-access-m5rcn\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.393904 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393732    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-run-ovn\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.394387 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.393947    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-var-lib-cni-multus\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.394387 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394146    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.394387 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394170    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-run-multus-certs\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.394387 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394208    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-node-log\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.394387 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394277    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-sysconfig\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.394387 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394303    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-run\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.394387 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-run-openvswitch\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.394387 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394348    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-multus-cni-dir\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.394387 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394371    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a62328f6-9c5a-495a-ab45-07f1540010ee-cni-binary-copy\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.394387 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394377    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ed1f8267-9041-450b-9d31-a2f42b2c8f59-ovnkube-script-lib\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.394842 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394421    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-multus-conf-dir\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.394842 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394456    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-729s8\" (UniqueName: \"kubernetes.io/projected/02fa67f4-019f-47f2-b81c-6a5d1f456664-kube-api-access-729s8\") pod \"node-resolver-psgll\" (UID: \"02fa67f4-019f-47f2-b81c-6a5d1f456664\") " pod="openshift-dns/node-resolver-psgll"
Jul 09 22:10:34.394842 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394485    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-slash\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.394842 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394497    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-multus-conf-dir\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.394842 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed1f8267-9041-450b-9d31-a2f42b2c8f59-ovn-node-metrics-cert\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.394842 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394556    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-cnibin\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.394842 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394599    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-run-openvswitch\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.394842 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394626    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-hostroot\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.394842 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394656    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-registration-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.394842 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394696    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-hostroot\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.394842 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394723    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-lib-modules\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.394842 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394752    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.394842 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394790    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.394842 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394814    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-etc-selinux\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.394842 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394839    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3465ea6f-d1af-4e92-a60b-1708df6f6bdd-iptables-alerter-script\") pod \"iptables-alerter-5ftfk\" (UID: \"3465ea6f-d1af-4e92-a60b-1708df6f6bdd\") " pod="openshift-network-operator/iptables-alerter-5ftfk"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394856    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394916    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394953    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-cnibin\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.394863    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2s29\" (UniqueName: \"kubernetes.io/projected/3465ea6f-d1af-4e92-a60b-1708df6f6bdd-kube-api-access-t2s29\") pod \"iptables-alerter-5ftfk\" (UID: \"3465ea6f-d1af-4e92-a60b-1708df6f6bdd\") " pod="openshift-network-operator/iptables-alerter-5ftfk"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395070    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-host\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395125    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-os-release\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395154    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-run-netns\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395191    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395224    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj54z\" (UniqueName: \"kubernetes.io/projected/6fd3da1e-960c-4bee-99b1-a621408855fe-kube-api-access-cj54z\") pod \"network-metrics-daemon-f7pqt\" (UID: \"6fd3da1e-960c-4bee-99b1-a621408855fe\") " pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395223    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-run-netns\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395266    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcf1ce0b-19bb-4020-848a-9fc663ce7136-konnectivity-ca\") pod \"konnectivity-agent-szwg5\" (UID: \"dcf1ce0b-19bb-4020-848a-9fc663ce7136\") " pod="kube-system/konnectivity-agent-szwg5"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395329    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395354    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-sys-fs\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395383    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3465ea6f-d1af-4e92-a60b-1708df6f6bdd-host-slash\") pod \"iptables-alerter-5ftfk\" (UID: \"3465ea6f-d1af-4e92-a60b-1708df6f6bdd\") " pod="openshift-network-operator/iptables-alerter-5ftfk"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395405    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-systemd\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395406    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a62328f6-9c5a-495a-ab45-07f1540010ee-cni-binary-copy\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.395553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395425    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-dbus\") pod \"global-pull-secret-syncer-p6khq\" (UID: \"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1\") " pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395466    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-slash\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395497    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-os-release\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395501    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395495    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395752    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/dcf1ce0b-19bb-4020-848a-9fc663ce7136-konnectivity-ca\") pod \"konnectivity-agent-szwg5\" (UID: \"dcf1ce0b-19bb-4020-848a-9fc663ce7136\") " pod="kube-system/konnectivity-agent-szwg5"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395929    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-run-netns\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.395998    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-etc-kubernetes\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396010    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-run-netns\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396042    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-var-lib-kubelet\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396070    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-etc-kubernetes\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-var-lib-openvswitch\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396122    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-var-lib-openvswitch\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396124    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqtfr\" (UniqueName: \"kubernetes.io/projected/ed1f8267-9041-450b-9d31-a2f42b2c8f59-kube-api-access-zqtfr\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-var-lib-kubelet\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396186    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-sysctl-d\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.396355 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396211    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs\") pod \"network-metrics-daemon-f7pqt\" (UID: \"6fd3da1e-960c-4bee-99b1-a621408855fe\") " pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396234    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-socket-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396245    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-var-lib-kubelet\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396276    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed1f8267-9041-450b-9d31-a2f42b2c8f59-env-overrides\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396300    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-cnibin\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396305    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396323    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-multus-socket-dir-parent\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:34.396358    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396362    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a62328f6-9c5a-495a-ab45-07f1540010ee-multus-daemon-config\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396374    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-cnibin\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret\") pod \"global-pull-secret-syncer-p6khq\" (UID: \"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1\") " pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:34.396437    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs podName:6fd3da1e-960c-4bee-99b1-a621408855fe nodeName:}" failed. No retries permitted until 2026-07-09 22:10:34.896415688 +0000 UTC m=+2.975185358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs") pod "network-metrics-daemon-f7pqt" (UID: "6fd3da1e-960c-4bee-99b1-a621408855fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396495    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02fa67f4-019f-47f2-b81c-6a5d1f456664-hosts-file\") pod \"node-resolver-psgll\" (UID: \"02fa67f4-019f-47f2-b81c-6a5d1f456664\") " pod="openshift-dns/node-resolver-psgll"
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396531    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-cni-bin\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396563    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed1f8267-9041-450b-9d31-a2f42b2c8f59-ovnkube-config\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396586    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-system-cni-dir\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396628    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-cni-bin\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.397170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396674    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ed1f8267-9041-450b-9d31-a2f42b2c8f59-env-overrides\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396693    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-var-lib-cni-bin\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396727    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-976mb\" (UniqueName: \"kubernetes.io/projected/337856cf-950e-4f3a-906d-13261fce44a5-kube-api-access-976mb\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396739    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-multus-socket-dir-parent\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396748    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-host-var-lib-cni-bin\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396795    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f1cf532-03a5-4ce5-b9ae-e71789ef7111-host\") pod \"node-ca-cfzct\" (UID: \"1f1cf532-03a5-4ce5-b9ae-e71789ef7111\") " pod="openshift-image-registry/node-ca-cfzct"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396819    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-modprobe-d\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396843    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-sys\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396855    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a62328f6-9c5a-495a-ab45-07f1540010ee-multus-daemon-config\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396867    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-system-cni-dir\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396912    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-etc-openvswitch\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396937    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-run-ovn-kubernetes\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396963    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcf1ce0b-19bb-4020-848a-9fc663ce7136-agent-certs\") pod \"konnectivity-agent-szwg5\" (UID: \"dcf1ce0b-19bb-4020-848a-9fc663ce7136\") " pod="kube-system/konnectivity-agent-szwg5"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.396988    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02fa67f4-019f-47f2-b81c-6a5d1f456664-tmp-dir\") pod \"node-resolver-psgll\" (UID: \"02fa67f4-019f-47f2-b81c-6a5d1f456664\") " pod="openshift-dns/node-resolver-psgll"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-kubelet\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397014    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-run-ovn-kubernetes\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397038    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-os-release\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.397964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397053    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-etc-openvswitch\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.398832 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397062    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-tuned\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.398832 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397101    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdee50e0-0243-41d9-8360-11b3e4749a09-tmp\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.398832 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397114    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-kubelet\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.398832 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397127    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-systemd-units\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.398832 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397153    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-log-socket\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.398832 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397176    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-cni-netd\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.398832 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397200    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-system-cni-dir\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.398832 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397225    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxnx7\" (UniqueName: \"kubernetes.io/projected/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-kube-api-access-dxnx7\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.398832 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397338    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ed1f8267-9041-450b-9d31-a2f42b2c8f59-ovnkube-config\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.398832 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397442    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a62328f6-9c5a-495a-ab45-07f1540010ee-os-release\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.398832 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397487    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-systemd-units\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.398832 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397506    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-host-cni-netd\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.398832 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397537    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-system-cni-dir\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.398832 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.397569    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ed1f8267-9041-450b-9d31-a2f42b2c8f59-log-socket\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.399523 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.398994    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ed1f8267-9041-450b-9d31-a2f42b2c8f59-ovn-node-metrics-cert\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.400055 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.400013    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/dcf1ce0b-19bb-4020-848a-9fc663ce7136-agent-certs\") pod \"konnectivity-agent-szwg5\" (UID: \"dcf1ce0b-19bb-4020-848a-9fc663ce7136\") " pod="kube-system/konnectivity-agent-szwg5"
Jul 09 22:10:34.415410 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:34.415371    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:10:34.415410 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:34.415403    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:10:34.415410 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:34.415417    2583 projected.go:196] Error preparing data for projected volume kube-api-access-rrd2q for pod openshift-network-diagnostics/network-check-target-hg95s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:10:34.415675 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:34.415494    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q podName:d961f45b-9c6d-4c31-8b5a-8f7fa95107ee nodeName:}" failed. No retries permitted until 2026-07-09 22:10:34.915470554 +0000 UTC m=+2.994240227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rrd2q" (UniqueName: "kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q") pod "network-check-target-hg95s" (UID: "d961f45b-9c6d-4c31-8b5a-8f7fa95107ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:10:34.420723 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.420693    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5rcn\" (UniqueName: \"kubernetes.io/projected/a62328f6-9c5a-495a-ab45-07f1540010ee-kube-api-access-m5rcn\") pod \"multus-z44pj\" (UID: \"a62328f6-9c5a-495a-ab45-07f1540010ee\") " pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.422603 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.422575    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxnx7\" (UniqueName: \"kubernetes.io/projected/d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612-kube-api-access-dxnx7\") pod \"multus-additional-cni-plugins-vmrx9\" (UID: \"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612\") " pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.423738 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.423712    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqtfr\" (UniqueName: \"kubernetes.io/projected/ed1f8267-9041-450b-9d31-a2f42b2c8f59-kube-api-access-zqtfr\") pod \"ovnkube-node-8tn8n\" (UID: \"ed1f8267-9041-450b-9d31-a2f42b2c8f59\") " pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.423886 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.423858    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj54z\" (UniqueName: \"kubernetes.io/projected/6fd3da1e-960c-4bee-99b1-a621408855fe-kube-api-access-cj54z\") pod \"network-metrics-daemon-f7pqt\" (UID: \"6fd3da1e-960c-4bee-99b1-a621408855fe\") " pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:34.485061 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.485004    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal" event={"ID":"443b95f9a11c785c66a6608d9d6fba98","Type":"ContainerStarted","Data":"91bdd7daed4f5314cf05fae9f030b08910e97429bc6a7c3b38450b4efa58e697"}
Jul 09 22:10:34.487390 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.487320    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal" event={"ID":"98feeb3b547af7c850dfc4e76f035021","Type":"ContainerStarted","Data":"c31e651f81ac0be7dfe05bbb13afe0d86d32e8275dd5016e3a98f9633183b18c"}
Jul 09 22:10:34.498001 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.497972    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc28x\" (UniqueName: \"kubernetes.io/projected/1f1cf532-03a5-4ce5-b9ae-e71789ef7111-kube-api-access-tc28x\") pod \"node-ca-cfzct\" (UID: \"1f1cf532-03a5-4ce5-b9ae-e71789ef7111\") " pod="openshift-image-registry/node-ca-cfzct"
Jul 09 22:10:34.498217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498008    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86h2p\" (UniqueName: \"kubernetes.io/projected/fdee50e0-0243-41d9-8360-11b3e4749a09-kube-api-access-86h2p\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.498217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498031    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-kubernetes\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.498217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498052    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-sysctl-conf\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.498217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498073    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f1cf532-03a5-4ce5-b9ae-e71789ef7111-serviceca\") pod \"node-ca-cfzct\" (UID: \"1f1cf532-03a5-4ce5-b9ae-e71789ef7111\") " pod="openshift-image-registry/node-ca-cfzct"
Jul 09 22:10:34.498217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498109    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-kubelet-config\") pod \"global-pull-secret-syncer-p6khq\" (UID: \"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1\") " pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:34.498217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498133    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-device-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.498217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498159    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-sysconfig\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.498217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498180    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-run\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.498217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498182    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-kubernetes\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.498217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498202    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-729s8\" (UniqueName: \"kubernetes.io/projected/02fa67f4-019f-47f2-b81c-6a5d1f456664-kube-api-access-729s8\") pod \"node-resolver-psgll\" (UID: \"02fa67f4-019f-47f2-b81c-6a5d1f456664\") " pod="openshift-dns/node-resolver-psgll"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498229    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-registration-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498253    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-lib-modules\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498279    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-etc-selinux\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498303    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3465ea6f-d1af-4e92-a60b-1708df6f6bdd-iptables-alerter-script\") pod \"iptables-alerter-5ftfk\" (UID: \"3465ea6f-d1af-4e92-a60b-1708df6f6bdd\") " pod="openshift-network-operator/iptables-alerter-5ftfk"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498328    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2s29\" (UniqueName: \"kubernetes.io/projected/3465ea6f-d1af-4e92-a60b-1708df6f6bdd-kube-api-access-t2s29\") pod \"iptables-alerter-5ftfk\" (UID: \"3465ea6f-d1af-4e92-a60b-1708df6f6bdd\") " pod="openshift-network-operator/iptables-alerter-5ftfk"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498329    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-sysconfig\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498350    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-host\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498382    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498409    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-sys-fs\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498435    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3465ea6f-d1af-4e92-a60b-1708df6f6bdd-host-slash\") pod \"iptables-alerter-5ftfk\" (UID: \"3465ea6f-d1af-4e92-a60b-1708df6f6bdd\") " pod="openshift-network-operator/iptables-alerter-5ftfk"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498459    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-systemd\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498482    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-dbus\") pod \"global-pull-secret-syncer-p6khq\" (UID: \"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1\") " pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498493    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-etc-selinux\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498497    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-sysctl-conf\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498538    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-var-lib-kubelet\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498556    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-run\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.498781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498555    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498568    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-sysctl-d\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498606    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-socket-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498638    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret\") pod \"global-pull-secret-syncer-p6khq\" (UID: \"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1\") " pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498680    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02fa67f4-019f-47f2-b81c-6a5d1f456664-hosts-file\") pod \"node-resolver-psgll\" (UID: \"02fa67f4-019f-47f2-b81c-6a5d1f456664\") " pod="openshift-dns/node-resolver-psgll"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498710    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-976mb\" (UniqueName: \"kubernetes.io/projected/337856cf-950e-4f3a-906d-13261fce44a5-kube-api-access-976mb\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498732    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f1cf532-03a5-4ce5-b9ae-e71789ef7111-host\") pod \"node-ca-cfzct\" (UID: \"1f1cf532-03a5-4ce5-b9ae-e71789ef7111\") " pod="openshift-image-registry/node-ca-cfzct"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498755    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-modprobe-d\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498778    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-sys\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498823    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02fa67f4-019f-47f2-b81c-6a5d1f456664-tmp-dir\") pod \"node-resolver-psgll\" (UID: \"02fa67f4-019f-47f2-b81c-6a5d1f456664\") " pod="openshift-dns/node-resolver-psgll"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498847    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-lib-modules\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498863    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-tuned\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498890    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdee50e0-0243-41d9-8360-11b3e4749a09-tmp\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499106    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-device-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499103    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1f1cf532-03a5-4ce5-b9ae-e71789ef7111-serviceca\") pod \"node-ca-cfzct\" (UID: \"1f1cf532-03a5-4ce5-b9ae-e71789ef7111\") " pod="openshift-image-registry/node-ca-cfzct"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499183    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-host\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499188    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-sys-fs\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.499659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499186    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-registration-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.500531 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499202    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3465ea6f-d1af-4e92-a60b-1708df6f6bdd-iptables-alerter-script\") pod \"iptables-alerter-5ftfk\" (UID: \"3465ea6f-d1af-4e92-a60b-1708df6f6bdd\") " pod="openshift-network-operator/iptables-alerter-5ftfk"
Jul 09 22:10:34.500531 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499252    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3465ea6f-d1af-4e92-a60b-1708df6f6bdd-host-slash\") pod \"iptables-alerter-5ftfk\" (UID: \"3465ea6f-d1af-4e92-a60b-1708df6f6bdd\") " pod="openshift-network-operator/iptables-alerter-5ftfk"
Jul 09 22:10:34.500531 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499254    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-systemd\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.500531 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499257    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f1cf532-03a5-4ce5-b9ae-e71789ef7111-host\") pod \"node-ca-cfzct\" (UID: \"1f1cf532-03a5-4ce5-b9ae-e71789ef7111\") " pod="openshift-image-registry/node-ca-cfzct"
Jul 09 22:10:34.500531 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499266    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-sys\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.500531 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:34.499307    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:10:34.500531 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499355    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-modprobe-d\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.500531 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:34.499370    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret podName:db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1 nodeName:}" failed. No retries permitted until 2026-07-09 22:10:34.999353188 +0000 UTC m=+3.078122860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret") pod "global-pull-secret-syncer-p6khq" (UID: "db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:10:34.500531 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.498556    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-kubelet-config\") pod \"global-pull-secret-syncer-p6khq\" (UID: \"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1\") " pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:34.500531 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499487    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-dbus\") pod \"global-pull-secret-syncer-p6khq\" (UID: \"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1\") " pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:34.500531 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499515    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/337856cf-950e-4f3a-906d-13261fce44a5-socket-dir\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.500531 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499525    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02fa67f4-019f-47f2-b81c-6a5d1f456664-tmp-dir\") pod \"node-resolver-psgll\" (UID: \"02fa67f4-019f-47f2-b81c-6a5d1f456664\") " pod="openshift-dns/node-resolver-psgll"
Jul 09 22:10:34.500531 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499564    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02fa67f4-019f-47f2-b81c-6a5d1f456664-hosts-file\") pod \"node-resolver-psgll\" (UID: \"02fa67f4-019f-47f2-b81c-6a5d1f456664\") " pod="openshift-dns/node-resolver-psgll"
Jul 09 22:10:34.500531 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499571    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-var-lib-kubelet\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.500531 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.499584    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-sysctl-d\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.502230 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.501935    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdee50e0-0243-41d9-8360-11b3e4749a09-tmp\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.502230 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.502185    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fdee50e0-0243-41d9-8360-11b3e4749a09-etc-tuned\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.506787 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.506759    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-729s8\" (UniqueName: \"kubernetes.io/projected/02fa67f4-019f-47f2-b81c-6a5d1f456664-kube-api-access-729s8\") pod \"node-resolver-psgll\" (UID: \"02fa67f4-019f-47f2-b81c-6a5d1f456664\") " pod="openshift-dns/node-resolver-psgll"
Jul 09 22:10:34.507111 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.507045    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc28x\" (UniqueName: \"kubernetes.io/projected/1f1cf532-03a5-4ce5-b9ae-e71789ef7111-kube-api-access-tc28x\") pod \"node-ca-cfzct\" (UID: \"1f1cf532-03a5-4ce5-b9ae-e71789ef7111\") " pod="openshift-image-registry/node-ca-cfzct"
Jul 09 22:10:34.507383 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.507355    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86h2p\" (UniqueName: \"kubernetes.io/projected/fdee50e0-0243-41d9-8360-11b3e4749a09-kube-api-access-86h2p\") pod \"tuned-d9jgn\" (UID: \"fdee50e0-0243-41d9-8360-11b3e4749a09\") " pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.508856 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.508803    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-976mb\" (UniqueName: \"kubernetes.io/projected/337856cf-950e-4f3a-906d-13261fce44a5-kube-api-access-976mb\") pod \"aws-ebs-csi-driver-node-kczjr\" (UID: \"337856cf-950e-4f3a-906d-13261fce44a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.509308 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.509275    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2s29\" (UniqueName: \"kubernetes.io/projected/3465ea6f-d1af-4e92-a60b-1708df6f6bdd-kube-api-access-t2s29\") pod \"iptables-alerter-5ftfk\" (UID: \"3465ea6f-d1af-4e92-a60b-1708df6f6bdd\") " pod="openshift-network-operator/iptables-alerter-5ftfk"
Jul 09 22:10:34.581386 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.581347    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-szwg5"
Jul 09 22:10:34.591676 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.591648    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:10:34.594869 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:34.594840    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf1ce0b_19bb_4020_848a_9fc663ce7136.slice/crio-cf6d70b5fcc3e8a17f4088db0150b45cf31a3c0c7e2308ca106e19bea26ba5d5 WatchSource:0}: Error finding container cf6d70b5fcc3e8a17f4088db0150b45cf31a3c0c7e2308ca106e19bea26ba5d5: Status 404 returned error can't find the container with id cf6d70b5fcc3e8a17f4088db0150b45cf31a3c0c7e2308ca106e19bea26ba5d5
Jul 09 22:10:34.601418 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:34.601391    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded1f8267_9041_450b_9d31_a2f42b2c8f59.slice/crio-ef442ea3611cb4db581273e343869032743ff008e946622191da2553129c6bf8 WatchSource:0}: Error finding container ef442ea3611cb4db581273e343869032743ff008e946622191da2553129c6bf8: Status 404 returned error can't find the container with id ef442ea3611cb4db581273e343869032743ff008e946622191da2553129c6bf8
Jul 09 22:10:34.602043 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.602000    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vmrx9"
Jul 09 22:10:34.603878 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.603859    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 22:10:34.609238 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.609216    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z44pj"
Jul 09 22:10:34.619062 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.619028    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d9jgn"
Jul 09 22:10:34.623991 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.623964    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr"
Jul 09 22:10:34.631785 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.631755    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-psgll"
Jul 09 22:10:34.637918 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.637895    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cfzct"
Jul 09 22:10:34.643721 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.643701    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5ftfk"
Jul 09 22:10:34.901023 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:34.900934    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs\") pod \"network-metrics-daemon-f7pqt\" (UID: \"6fd3da1e-960c-4bee-99b1-a621408855fe\") " pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:34.901193 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:34.901121    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:10:34.901193 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:34.901190    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs podName:6fd3da1e-960c-4bee-99b1-a621408855fe nodeName:}" failed. No retries permitted until 2026-07-09 22:10:35.901170345 +0000 UTC m=+3.979940019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs") pod "network-metrics-daemon-f7pqt" (UID: "6fd3da1e-960c-4bee-99b1-a621408855fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:10:35.001694 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:35.001659    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret\") pod \"global-pull-secret-syncer-p6khq\" (UID: \"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1\") " pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:35.001875 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:35.001728    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrd2q\" (UniqueName: \"kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q\") pod \"network-check-target-hg95s\" (UID: \"d961f45b-9c6d-4c31-8b5a-8f7fa95107ee\") " pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:35.001875 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:35.001773    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:10:35.001875 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:35.001838    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret podName:db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1 nodeName:}" failed. No retries permitted until 2026-07-09 22:10:36.001823206 +0000 UTC m=+4.080592867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret") pod "global-pull-secret-syncer-p6khq" (UID: "db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:10:35.002063 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:35.001887    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:10:35.002063 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:35.001912    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:10:35.002063 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:35.001927    2583 projected.go:196] Error preparing data for projected volume kube-api-access-rrd2q for pod openshift-network-diagnostics/network-check-target-hg95s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:10:35.002063 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:35.001988    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q podName:d961f45b-9c6d-4c31-8b5a-8f7fa95107ee nodeName:}" failed. No retries permitted until 2026-07-09 22:10:36.001971003 +0000 UTC m=+4.080740726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rrd2q" (UniqueName: "kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q") pod "network-check-target-hg95s" (UID: "d961f45b-9c6d-4c31-8b5a-8f7fa95107ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:10:35.333947 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:35.333852    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 22:05:34 +0000 UTC" deadline="2028-01-03 22:47:31.371866904 +0000 UTC"
Jul 09 22:10:35.333947 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:35.333893    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13032h36m56.037977961s"
Jul 09 22:10:35.480801 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:35.480771    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:35.480977 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:35.480885    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:10:35.490558 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:35.490517    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n" event={"ID":"ed1f8267-9041-450b-9d31-a2f42b2c8f59","Type":"ContainerStarted","Data":"ef442ea3611cb4db581273e343869032743ff008e946622191da2553129c6bf8"}
Jul 09 22:10:35.491820 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:35.491788    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-szwg5" event={"ID":"dcf1ce0b-19bb-4020-848a-9fc663ce7136","Type":"ContainerStarted","Data":"cf6d70b5fcc3e8a17f4088db0150b45cf31a3c0c7e2308ca106e19bea26ba5d5"}
Jul 09 22:10:35.652552 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:35.652481    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1cf532_03a5_4ce5_b9ae_e71789ef7111.slice/crio-3ea865e940f637697e063610c86fbe5ff37a7e1d65321d6d418d2224aa5f9410 WatchSource:0}: Error finding container 3ea865e940f637697e063610c86fbe5ff37a7e1d65321d6d418d2224aa5f9410: Status 404 returned error can't find the container with id 3ea865e940f637697e063610c86fbe5ff37a7e1d65321d6d418d2224aa5f9410
Jul 09 22:10:35.663912 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:35.662768    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdee50e0_0243_41d9_8360_11b3e4749a09.slice/crio-02685f2c89d1613e4083ab98af4bb07d7097473586c7337df85a0c90686264a1 WatchSource:0}: Error finding container 02685f2c89d1613e4083ab98af4bb07d7097473586c7337df85a0c90686264a1: Status 404 returned error can't find the container with id 02685f2c89d1613e4083ab98af4bb07d7097473586c7337df85a0c90686264a1
Jul 09 22:10:35.664411 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:10:35.664260    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b9d0ad_68d0_47bb_a77c_b8b50a0dd612.slice/crio-7fc1db5ce7626a3717cc2be51a547b4c35edd62dbfe989909e2671e6a7ede5cd WatchSource:0}: Error finding container 7fc1db5ce7626a3717cc2be51a547b4c35edd62dbfe989909e2671e6a7ede5cd: Status 404 returned error can't find the container with id 7fc1db5ce7626a3717cc2be51a547b4c35edd62dbfe989909e2671e6a7ede5cd
Jul 09 22:10:35.908174 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:35.907824    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs\") pod \"network-metrics-daemon-f7pqt\" (UID: \"6fd3da1e-960c-4bee-99b1-a621408855fe\") " pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:35.908174 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:35.908023    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:10:35.908409 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:35.908208    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs podName:6fd3da1e-960c-4bee-99b1-a621408855fe nodeName:}" failed. No retries permitted until 2026-07-09 22:10:37.908186489 +0000 UTC m=+5.986956164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs") pod "network-metrics-daemon-f7pqt" (UID: "6fd3da1e-960c-4bee-99b1-a621408855fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:10:36.008549 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.008507    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrd2q\" (UniqueName: \"kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q\") pod \"network-check-target-hg95s\" (UID: \"d961f45b-9c6d-4c31-8b5a-8f7fa95107ee\") " pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:36.008670 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.008610    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret\") pod \"global-pull-secret-syncer-p6khq\" (UID: \"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1\") " pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:36.008742 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:36.008718    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:10:36.008792 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:36.008745    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:10:36.008839 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:36.008808    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret podName:db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1 nodeName:}" failed. No retries permitted until 2026-07-09 22:10:38.008789389 +0000 UTC m=+6.087559047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret") pod "global-pull-secret-syncer-p6khq" (UID: "db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:10:36.008839 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:36.008748    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:10:36.008839 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:36.008834    2583 projected.go:196] Error preparing data for projected volume kube-api-access-rrd2q for pod openshift-network-diagnostics/network-check-target-hg95s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:10:36.008999 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:36.008902    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q podName:d961f45b-9c6d-4c31-8b5a-8f7fa95107ee nodeName:}" failed. No retries permitted until 2026-07-09 22:10:38.008873323 +0000 UTC m=+6.087643003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rrd2q" (UniqueName: "kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q") pod "network-check-target-hg95s" (UID: "d961f45b-9c6d-4c31-8b5a-8f7fa95107ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:10:36.335772 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.334626    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 22:05:34 +0000 UTC" deadline="2028-01-06 16:27:05.841602633 +0000 UTC"
Jul 09 22:10:36.335772 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.334693    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13098h16m29.506914192s"
Jul 09 22:10:36.484272 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.483566    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:36.484272 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:36.483719    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:10:36.484272 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.484120    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:36.484272 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:36.484210    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:10:36.509288 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.509204    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal" event={"ID":"443b95f9a11c785c66a6608d9d6fba98","Type":"ContainerStarted","Data":"a81655be9745237b6ef50eff9f23c6cabd573766c4344d0f916ba08ec9d99e8a"}
Jul 09 22:10:36.516454 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.516346    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrx9" event={"ID":"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612","Type":"ContainerStarted","Data":"7fc1db5ce7626a3717cc2be51a547b4c35edd62dbfe989909e2671e6a7ede5cd"}
Jul 09 22:10:36.519075 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.518987    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" event={"ID":"337856cf-950e-4f3a-906d-13261fce44a5","Type":"ContainerStarted","Data":"d743d3bef0a0fffb2fc9014d2536c629c379dc89915787992f9783a3e3f02704"}
Jul 09 22:10:36.523308 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.523082    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-205.ec2.internal" podStartSLOduration=3.523063717 podStartE2EDuration="3.523063717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:10:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:10:36.5221849 +0000 UTC m=+4.600954580" watchObservedRunningTime="2026-07-09 22:10:36.523063717 +0000 UTC m=+4.601833397"
Jul 09 22:10:36.523876 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.523796    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-psgll" event={"ID":"02fa67f4-019f-47f2-b81c-6a5d1f456664","Type":"ContainerStarted","Data":"f2cf89974a904b6590455ababf9182b025dd68a0ffa614c0d73daec62992bb11"}
Jul 09 22:10:36.530905 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.530869    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z44pj" event={"ID":"a62328f6-9c5a-495a-ab45-07f1540010ee","Type":"ContainerStarted","Data":"004e210086f1ee2d9536d997a89aa98cd5c1dfcac697c265cb530247f023bc87"}
Jul 09 22:10:36.541622 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.541588    2583 generic.go:356] "Generic (PLEG): container finished" podID="98feeb3b547af7c850dfc4e76f035021" containerID="056b16beb738ae09a2279c8e3e0f3ba1d0b271f8324fd053e9ae86d4529d3b4e" exitCode=0
Jul 09 22:10:36.541768 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.541687    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal" event={"ID":"98feeb3b547af7c850dfc4e76f035021","Type":"ContainerDied","Data":"056b16beb738ae09a2279c8e3e0f3ba1d0b271f8324fd053e9ae86d4529d3b4e"}
Jul 09 22:10:36.546566 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.546505    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d9jgn" event={"ID":"fdee50e0-0243-41d9-8360-11b3e4749a09","Type":"ContainerStarted","Data":"02685f2c89d1613e4083ab98af4bb07d7097473586c7337df85a0c90686264a1"}
Jul 09 22:10:36.553480 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.553439    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5ftfk" event={"ID":"3465ea6f-d1af-4e92-a60b-1708df6f6bdd","Type":"ContainerStarted","Data":"89afee8cd2ac2888156f3844c260e41383dc4371a1aaab75b81e7a7ec900d0bc"}
Jul 09 22:10:36.557608 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:36.557575    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cfzct" event={"ID":"1f1cf532-03a5-4ce5-b9ae-e71789ef7111","Type":"ContainerStarted","Data":"3ea865e940f637697e063610c86fbe5ff37a7e1d65321d6d418d2224aa5f9410"}
Jul 09 22:10:37.480581 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:37.480540    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:37.481120 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:37.480683    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:10:37.924690 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:37.923967    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs\") pod \"network-metrics-daemon-f7pqt\" (UID: \"6fd3da1e-960c-4bee-99b1-a621408855fe\") " pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:37.924690 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:37.924145    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:10:37.924690 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:37.924241    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs podName:6fd3da1e-960c-4bee-99b1-a621408855fe nodeName:}" failed. No retries permitted until 2026-07-09 22:10:41.924220535 +0000 UTC m=+10.002990194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs") pod "network-metrics-daemon-f7pqt" (UID: "6fd3da1e-960c-4bee-99b1-a621408855fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:10:38.025037 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:38.025005    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret\") pod \"global-pull-secret-syncer-p6khq\" (UID: \"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1\") " pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:38.025224 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:38.025057    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrd2q\" (UniqueName: \"kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q\") pod \"network-check-target-hg95s\" (UID: \"d961f45b-9c6d-4c31-8b5a-8f7fa95107ee\") " pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:38.025224 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:38.025213    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:10:38.025332 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:38.025235    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:10:38.025332 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:38.025248    2583 projected.go:196] Error preparing data for projected volume kube-api-access-rrd2q for pod openshift-network-diagnostics/network-check-target-hg95s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:10:38.025332 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:38.025307    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q podName:d961f45b-9c6d-4c31-8b5a-8f7fa95107ee nodeName:}" failed. No retries permitted until 2026-07-09 22:10:42.025288014 +0000 UTC m=+10.104057688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rrd2q" (UniqueName: "kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q") pod "network-check-target-hg95s" (UID: "d961f45b-9c6d-4c31-8b5a-8f7fa95107ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:10:38.025716 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:38.025694    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:10:38.025812 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:38.025751    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret podName:db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1 nodeName:}" failed. No retries permitted until 2026-07-09 22:10:42.025736555 +0000 UTC m=+10.104506233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret") pod "global-pull-secret-syncer-p6khq" (UID: "db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:10:38.481031 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:38.481001    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:38.481558 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:38.481131    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:10:38.481558 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:38.481428    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:38.481558 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:38.481489    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:10:39.480198 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:39.480159    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:39.480377 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:39.480304    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:10:40.481786 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:40.481202    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:40.481786 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:40.481202    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:40.481786 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:40.481354    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:10:40.481786 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:40.481411    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:10:41.480926 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:41.480890    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:41.481230 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:41.481032    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:10:41.960179 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:41.960119    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs\") pod \"network-metrics-daemon-f7pqt\" (UID: \"6fd3da1e-960c-4bee-99b1-a621408855fe\") " pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:41.960632 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:41.960269    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:10:41.960632 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:41.960358    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs podName:6fd3da1e-960c-4bee-99b1-a621408855fe nodeName:}" failed. No retries permitted until 2026-07-09 22:10:49.960334348 +0000 UTC m=+18.039104014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs") pod "network-metrics-daemon-f7pqt" (UID: "6fd3da1e-960c-4bee-99b1-a621408855fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:10:42.061404 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:42.060751    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret\") pod \"global-pull-secret-syncer-p6khq\" (UID: \"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1\") " pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:42.061404 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:42.060811    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrd2q\" (UniqueName: \"kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q\") pod \"network-check-target-hg95s\" (UID: \"d961f45b-9c6d-4c31-8b5a-8f7fa95107ee\") " pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:42.061404 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:42.060959    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:10:42.061404 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:42.060978    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:10:42.061404 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:42.060992    2583 projected.go:196] Error preparing data for projected volume kube-api-access-rrd2q for pod openshift-network-diagnostics/network-check-target-hg95s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:10:42.061404 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:42.061052    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q podName:d961f45b-9c6d-4c31-8b5a-8f7fa95107ee nodeName:}" failed. No retries permitted until 2026-07-09 22:10:50.061034007 +0000 UTC m=+18.139803670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rrd2q" (UniqueName: "kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q") pod "network-check-target-hg95s" (UID: "d961f45b-9c6d-4c31-8b5a-8f7fa95107ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:10:42.061404 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:42.061287    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:10:42.061903 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:42.061439    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret podName:db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1 nodeName:}" failed. No retries permitted until 2026-07-09 22:10:50.061421197 +0000 UTC m=+18.140190870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret") pod "global-pull-secret-syncer-p6khq" (UID: "db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:10:42.481891 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:42.481855    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:42.482099 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:42.481973    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:10:42.482165 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:42.482137    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:42.482299 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:42.482233    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:10:43.481560 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:43.481061    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:43.481560 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:43.481200    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:10:44.481183 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:44.481051    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:44.481754 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:44.481508    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:10:44.481754 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:44.481613    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:44.484576 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:44.484537    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:10:45.480674 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:45.480591    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:45.480827 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:45.480724    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:10:46.480271 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:46.480215    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:46.480730 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:46.480344    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:10:46.480730 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:46.480224    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:46.480730 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:46.480584    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:10:47.480829 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:47.480789    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:47.481257 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:47.480920    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:10:48.480557 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:48.480516    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:48.480740 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:48.480560    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:48.480740 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:48.480685    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:10:48.480851 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:48.480825    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:10:49.480922 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:49.480888    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:49.481444 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:49.480999    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:10:50.022194 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:50.022149    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs\") pod \"network-metrics-daemon-f7pqt\" (UID: \"6fd3da1e-960c-4bee-99b1-a621408855fe\") " pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:50.022473 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:50.022350    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:10:50.022473 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:50.022430    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs podName:6fd3da1e-960c-4bee-99b1-a621408855fe nodeName:}" failed. No retries permitted until 2026-07-09 22:11:06.022408082 +0000 UTC m=+34.101177746 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs") pod "network-metrics-daemon-f7pqt" (UID: "6fd3da1e-960c-4bee-99b1-a621408855fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:10:50.122744 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:50.122701    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrd2q\" (UniqueName: \"kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q\") pod \"network-check-target-hg95s\" (UID: \"d961f45b-9c6d-4c31-8b5a-8f7fa95107ee\") " pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:50.122921 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:50.122801    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret\") pod \"global-pull-secret-syncer-p6khq\" (UID: \"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1\") " pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:50.122921 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:50.122878    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:10:50.122921 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:50.122903    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:10:50.122921 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:50.122916    2583 projected.go:196] Error preparing data for projected volume kube-api-access-rrd2q for pod openshift-network-diagnostics/network-check-target-hg95s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:10:50.122921 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:50.122917    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:10:50.123145 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:50.122985    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q podName:d961f45b-9c6d-4c31-8b5a-8f7fa95107ee nodeName:}" failed. No retries permitted until 2026-07-09 22:11:06.122967659 +0000 UTC m=+34.201737318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rrd2q" (UniqueName: "kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q") pod "network-check-target-hg95s" (UID: "d961f45b-9c6d-4c31-8b5a-8f7fa95107ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:10:50.123145 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:50.123004    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret podName:db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1 nodeName:}" failed. No retries permitted until 2026-07-09 22:11:06.122996936 +0000 UTC m=+34.201766593 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret") pod "global-pull-secret-syncer-p6khq" (UID: "db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:10:50.481208 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:50.481067    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:50.481575 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:50.481222    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:10:50.481575 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:50.481280    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:50.481575 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:50.481395    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:10:51.480904 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:51.480869    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:51.481119 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:51.480999    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:10:52.481248 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:52.481215    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:52.481746 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:52.481318    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:10:52.481746 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:52.481369    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:52.481746 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:52.481480    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:10:53.480356 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:53.480316    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:53.480526 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:53.480420    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:10:54.481427 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.481103    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:54.482061 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.481126    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:54.482061 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:54.481529    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:10:54.482061 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:54.481603    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:10:54.593830 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.593792    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d9jgn" event={"ID":"fdee50e0-0243-41d9-8360-11b3e4749a09","Type":"ContainerStarted","Data":"7fd12e1de9f0b45a3f488ff48ea1eed58a607073051e9426560de7baf43eb4c4"}
Jul 09 22:10:54.595296 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.595266    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cfzct" event={"ID":"1f1cf532-03a5-4ce5-b9ae-e71789ef7111","Type":"ContainerStarted","Data":"f1cdfca6d82d596655f19855fbc9dd5270c182c7229628927c26649d0fb932ae"}
Jul 09 22:10:54.596686 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.596663    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-szwg5" event={"ID":"dcf1ce0b-19bb-4020-848a-9fc663ce7136","Type":"ContainerStarted","Data":"b51987f11d07af48f41ed4324abf76b4a6b3e810ef968b85e5c3148731b5554b"}
Jul 09 22:10:54.598312 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.598279    2583 generic.go:356] "Generic (PLEG): container finished" podID="d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612" containerID="a34f18deec8ddbeec353962a8389c1f5fb7aec39fa86f2b6cf2370f466fb2ba0" exitCode=0
Jul 09 22:10:54.598413 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.598365    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrx9" event={"ID":"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612","Type":"ContainerDied","Data":"a34f18deec8ddbeec353962a8389c1f5fb7aec39fa86f2b6cf2370f466fb2ba0"}
Jul 09 22:10:54.599878 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.599808    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" event={"ID":"337856cf-950e-4f3a-906d-13261fce44a5","Type":"ContainerStarted","Data":"c86dd944b2f80f41dd7812419ba51a358ead969b485920025efba3e17d1bc756"}
Jul 09 22:10:54.601378 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.601353    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-psgll" event={"ID":"02fa67f4-019f-47f2-b81c-6a5d1f456664","Type":"ContainerStarted","Data":"841c9c4789b3d9f1419a44ec32a6f3e814634524cadfbdfde050ae0e2f4f5f7e"}
Jul 09 22:10:54.602801 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.602780    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z44pj" event={"ID":"a62328f6-9c5a-495a-ab45-07f1540010ee","Type":"ContainerStarted","Data":"f5c6cb6167a2e2ae4aeadb4a08b51ba5ccf5486942be869a77dc758bf3995552"}
Jul 09 22:10:54.606967 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.606938    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal" event={"ID":"98feeb3b547af7c850dfc4e76f035021","Type":"ContainerStarted","Data":"dc7a9aba8a57fa678d84004c5b37d5fa19cc91d130606f7daa85ea02d97f4404"}
Jul 09 22:10:54.610004 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.609966    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d9jgn" podStartSLOduration=4.563334415 podStartE2EDuration="22.609948389s" totalImagesPullingTime="18.046613974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:10:54.609296222 +0000 UTC m=+22.688065901" watchObservedRunningTime="2026-07-09 22:10:54.609948389 +0000 UTC m=+22.688718069"
Jul 09 22:10:54.610141 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.610080    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n" event={"ID":"ed1f8267-9041-450b-9d31-a2f42b2c8f59","Type":"ContainerStarted","Data":"04071eea42d5499f1775c3ce4f4b2df09d6d62968412a0182db615ecc0cae2a0"}
Jul 09 22:10:54.610207 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.610151    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n" event={"ID":"ed1f8267-9041-450b-9d31-a2f42b2c8f59","Type":"ContainerStarted","Data":"c7193b579c306ab6e3e4ae01de5f372de536a9367e71a15ca04ab6f4571b1fa2"}
Jul 09 22:10:54.610207 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.610187    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n" event={"ID":"ed1f8267-9041-450b-9d31-a2f42b2c8f59","Type":"ContainerStarted","Data":"5843cbbdbe4b9ffba1a9bf52ef04d1556285d3f8fc93f1bca3a43688b7e6ebbe"}
Jul 09 22:10:54.610308 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.610216    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n" event={"ID":"ed1f8267-9041-450b-9d31-a2f42b2c8f59","Type":"ContainerStarted","Data":"43a52c0fed3f8c7e87dac84612bb3582e6f3f83ad2a2b25440f6d8ba90398829"}
Jul 09 22:10:54.610308 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.610251    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n" event={"ID":"ed1f8267-9041-450b-9d31-a2f42b2c8f59","Type":"ContainerStarted","Data":"8010918cb6175521c7fb5088565c646fa532d754f6d2ef21cb15a679ace0f751"}
Jul 09 22:10:54.610308 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.610278    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n" event={"ID":"ed1f8267-9041-450b-9d31-a2f42b2c8f59","Type":"ContainerStarted","Data":"b909575af6bcd07e9381e3e99ad87dee99832a329c33a082ab39fab4b74f8c0f"}
Jul 09 22:10:54.622537 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.622496    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-psgll" podStartSLOduration=4.574972417 podStartE2EDuration="22.622484307s" totalImagesPullingTime="18.04751189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:10:54.621903189 +0000 UTC m=+22.700672869" watchObservedRunningTime="2026-07-09 22:10:54.622484307 +0000 UTC m=+22.701253977"
Jul 09 22:10:54.634921 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.634867    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cfzct" podStartSLOduration=4.997020018 podStartE2EDuration="22.63485318s" totalImagesPullingTime="17.637833162s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:10:54.634575789 +0000 UTC m=+22.713345468" watchObservedRunningTime="2026-07-09 22:10:54.63485318 +0000 UTC m=+22.713622923"
Jul 09 22:10:54.647640 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.647592    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-205.ec2.internal" podStartSLOduration=21.647580075 podStartE2EDuration="21.647580075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:10:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:10:54.647285643 +0000 UTC m=+22.726055322" watchObservedRunningTime="2026-07-09 22:10:54.647580075 +0000 UTC m=+22.726349755"
Jul 09 22:10:54.682618 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.682525    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z44pj" podStartSLOduration=4.618520007 podStartE2EDuration="22.682509316s" totalImagesPullingTime="18.063989309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:10:54.682049965 +0000 UTC m=+22.760819644" watchObservedRunningTime="2026-07-09 22:10:54.682509316 +0000 UTC m=+22.761278994"
Jul 09 22:10:54.697747 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:54.697697    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-szwg5" podStartSLOduration=12.122355065 podStartE2EDuration="22.697680243s" totalImagesPullingTime="10.575325178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:10:54.696865536 +0000 UTC m=+22.775635214" watchObservedRunningTime="2026-07-09 22:10:54.697680243 +0000 UTC m=+22.776449921"
Jul 09 22:10:55.480662 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:55.480629    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:55.480835 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:55.480770    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:10:55.580263 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:55.580227    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 22:10:55.616919 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:55.616878    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" event={"ID":"337856cf-950e-4f3a-906d-13261fce44a5","Type":"ContainerStarted","Data":"64a8df2238fd9a7a4f4250c21dfd2d9c0203a0521c9639b2edb2560e32c1dfbe"}
Jul 09 22:10:55.618338 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:55.618302    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5ftfk" event={"ID":"3465ea6f-d1af-4e92-a60b-1708df6f6bdd","Type":"ContainerStarted","Data":"5e6858a9d4eae32b15a218152a83f72f966648da0ddaff5c48b50f8a7576906b"}
Jul 09 22:10:55.632411 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:55.632364    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5ftfk" podStartSLOduration=5.583964982 podStartE2EDuration="23.632345702s" totalImagesPullingTime="18.04838072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:10:55.632046576 +0000 UTC m=+23.710816254" watchObservedRunningTime="2026-07-09 22:10:55.632345702 +0000 UTC m=+23.711115383"
Jul 09 22:10:56.356739 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:56.356611    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T22:10:55.580254261Z","UUID":"8cf24d12-5aab-4c42-8976-bd64745e637c","Handler":null,"Name":"","Endpoint":""}
Jul 09 22:10:56.358497 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:56.358476    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 22:10:56.358631 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:56.358517    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 22:10:56.480723 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:56.480685    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:56.480901 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:56.480829    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:10:56.480901 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:56.480884    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:56.481002 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:56.480980    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:10:57.481488 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:57.481153    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:57.481942 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:57.481578    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:10:57.626328 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:57.626295    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n" event={"ID":"ed1f8267-9041-450b-9d31-a2f42b2c8f59","Type":"ContainerStarted","Data":"f892a06df463985ffe03d70041ef6bde4588dc2796ef98e9cf9510ba24b4b78e"}
Jul 09 22:10:57.628133 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:57.628109    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" event={"ID":"337856cf-950e-4f3a-906d-13261fce44a5","Type":"ContainerStarted","Data":"b0d3bff36402f709fee103788d838d2cd6334cfbe947f3e7da1fe2a664b20363"}
Jul 09 22:10:57.643710 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:57.643663    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kczjr" podStartSLOduration=5.099210151 podStartE2EDuration="25.643646027s" totalImagesPullingTime="20.544435876s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:10:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:10:57.643561506 +0000 UTC m=+25.722331186" watchObservedRunningTime="2026-07-09 22:10:57.643646027 +0000 UTC m=+25.722415705"
Jul 09 22:10:58.480732 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:58.480700    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:10:58.480928 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:58.480742    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:10:58.480928 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:58.480840    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:10:58.481041 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:58.480969    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:10:58.709874 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:58.709845    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-szwg5"
Jul 09 22:10:58.710720 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:58.710703    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-szwg5"
Jul 09 22:10:59.480959 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:10:59.480926    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:10:59.481163 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:10:59.481034    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:11:00.481258 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:00.480988    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:11:00.481868 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:00.481023    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:11:00.481868 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:00.481318    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:11:00.481868 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:00.481353    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:11:00.636335 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:00.636299    2583 generic.go:356] "Generic (PLEG): container finished" podID="d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612" containerID="c011d5a477e3f34ed9bb64c5d01a91f3e3a2a1648b64793fe0b3eeee9abe0794" exitCode=0
Jul 09 22:11:00.636514 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:00.636390    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrx9" event={"ID":"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612","Type":"ContainerDied","Data":"c011d5a477e3f34ed9bb64c5d01a91f3e3a2a1648b64793fe0b3eeee9abe0794"}
Jul 09 22:11:00.640322 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:00.640299    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n" event={"ID":"ed1f8267-9041-450b-9d31-a2f42b2c8f59","Type":"ContainerStarted","Data":"31d29eee9dace0db4657f07164506f4bc1a143f53441e3ca413cdc55350ab076"}
Jul 09 22:11:00.640485 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:00.640472    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:11:00.640536 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:00.640526    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:11:00.656579 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:00.656553    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:11:00.681349 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:00.681297    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n" podStartSLOduration=9.402067916 podStartE2EDuration="28.681280991s" totalImagesPullingTime="19.279213075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:11:00.681069542 +0000 UTC m=+28.759839222" watchObservedRunningTime="2026-07-09 22:11:00.681280991 +0000 UTC m=+28.760050670"
Jul 09 22:11:01.481053 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:01.481024    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:11:01.481289 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:01.481204    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:11:01.643655 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:01.643626    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:11:01.660259 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:01.660222    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:11:01.820722 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:01.820683    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-szwg5"
Jul 09 22:11:01.820839 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:01.820815    2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 09 22:11:01.821347 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:01.821324    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-szwg5"
Jul 09 22:11:01.855736 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:01.855706    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hg95s"]
Jul 09 22:11:01.855995 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:01.855840    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:11:01.856052 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:01.856000    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:11:01.857479 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:01.857457    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p6khq"]
Jul 09 22:11:01.857599 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:01.857563    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:11:01.857707 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:01.857685    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:11:01.858272 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:01.858198    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f7pqt"]
Jul 09 22:11:01.858376 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:01.858313    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:11:01.858472 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:01.858454    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:11:02.646879 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:02.646622    2583 generic.go:356] "Generic (PLEG): container finished" podID="d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612" containerID="93e3e941115cdb99e4ec4162deefa547c6597897879e1c8da7bfe18964c6179c" exitCode=0
Jul 09 22:11:02.647309 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:02.646705    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrx9" event={"ID":"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612","Type":"ContainerDied","Data":"93e3e941115cdb99e4ec4162deefa547c6597897879e1c8da7bfe18964c6179c"}
Jul 09 22:11:03.481217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:03.481182    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:11:03.481391 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:03.481189    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:11:03.481391 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:03.481304    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:11:03.481391 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:03.481189    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:11:03.481543 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:03.481405    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:11:03.481543 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:03.481471    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:11:04.653674 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:04.653643    2583 generic.go:356] "Generic (PLEG): container finished" podID="d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612" containerID="7d5957e60111efef117dcb640c70333c7e0f20c9a5f31aaddc89c9168590c8aa" exitCode=0
Jul 09 22:11:04.654272 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:04.653704    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrx9" event={"ID":"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612","Type":"ContainerDied","Data":"7d5957e60111efef117dcb640c70333c7e0f20c9a5f31aaddc89c9168590c8aa"}
Jul 09 22:11:05.480341 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:05.480303    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:11:05.480341 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:05.480332    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:11:05.480562 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:05.480302    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:11:05.480562 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:05.480410    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg95s" podUID="d961f45b-9c6d-4c31-8b5a-8f7fa95107ee"
Jul 09 22:11:05.480562 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:05.480505    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p6khq" podUID="db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1"
Jul 09 22:11:05.480656 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:05.480600    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:11:06.043465 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.043422    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs\") pod \"network-metrics-daemon-f7pqt\" (UID: \"6fd3da1e-960c-4bee-99b1-a621408855fe\") " pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:11:06.044004 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:06.043539    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:11:06.044004 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:06.043594    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs podName:6fd3da1e-960c-4bee-99b1-a621408855fe nodeName:}" failed. No retries permitted until 2026-07-09 22:11:38.043579579 +0000 UTC m=+66.122349237 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs") pod "network-metrics-daemon-f7pqt" (UID: "6fd3da1e-960c-4bee-99b1-a621408855fe") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 22:11:06.144542 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.144509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret\") pod \"global-pull-secret-syncer-p6khq\" (UID: \"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1\") " pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:11:06.144542 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.144550    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrd2q\" (UniqueName: \"kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q\") pod \"network-check-target-hg95s\" (UID: \"d961f45b-9c6d-4c31-8b5a-8f7fa95107ee\") " pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:11:06.144777 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:06.144664    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 22:11:06.144777 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:06.144677    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 22:11:06.144777 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:06.144685    2583 projected.go:196] Error preparing data for projected volume kube-api-access-rrd2q for pod openshift-network-diagnostics/network-check-target-hg95s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:11:06.144777 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:06.144687    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 22:11:06.144777 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:06.144738    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q podName:d961f45b-9c6d-4c31-8b5a-8f7fa95107ee nodeName:}" failed. No retries permitted until 2026-07-09 22:11:38.144723434 +0000 UTC m=+66.223493091 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rrd2q" (UniqueName: "kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q") pod "network-check-target-hg95s" (UID: "d961f45b-9c6d-4c31-8b5a-8f7fa95107ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 22:11:06.144777 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:06.144753    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret podName:db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1 nodeName:}" failed. No retries permitted until 2026-07-09 22:11:38.144746962 +0000 UTC m=+66.223516618 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret") pod "global-pull-secret-syncer-p6khq" (UID: "db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1") : object "kube-system"/"original-pull-secret" not registered
Jul 09 22:11:06.707288 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.707257    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-205.ec2.internal" event="NodeReady"
Jul 09 22:11:06.707470 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.707456    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 22:11:06.749109 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.749065    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-754cv"]
Jul 09 22:11:06.751514 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.751485    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:06.752178 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.752156    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vlfpb"]
Jul 09 22:11:06.754141 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.753900    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vlfpb"
Jul 09 22:11:06.754141 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.753974    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 22:11:06.754141 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.754003    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 22:11:06.754141 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.754003    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r6x6z\""
Jul 09 22:11:06.756172 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.756155    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-r7pcm\""
Jul 09 22:11:06.756396 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.756377    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 22:11:06.756510 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.756479    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 22:11:06.756580 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.756561    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 22:11:06.763141 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.763118    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-754cv"]
Jul 09 22:11:06.764902 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.764701    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vlfpb"]
Jul 09 22:11:06.849707 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.849668    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5thx4\" (UniqueName: \"kubernetes.io/projected/024d8436-668e-491e-9002-8ec850963901-kube-api-access-5thx4\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:06.849897 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.849716    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21cf5cf6-2e43-4bcb-a03f-de65bbd6929a-cert\") pod \"ingress-canary-vlfpb\" (UID: \"21cf5cf6-2e43-4bcb-a03f-de65bbd6929a\") " pod="openshift-ingress-canary/ingress-canary-vlfpb"
Jul 09 22:11:06.849897 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.849781    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdbt5\" (UniqueName: \"kubernetes.io/projected/21cf5cf6-2e43-4bcb-a03f-de65bbd6929a-kube-api-access-vdbt5\") pod \"ingress-canary-vlfpb\" (UID: \"21cf5cf6-2e43-4bcb-a03f-de65bbd6929a\") " pod="openshift-ingress-canary/ingress-canary-vlfpb"
Jul 09 22:11:06.849897 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.849809    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/024d8436-668e-491e-9002-8ec850963901-tmp-dir\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:06.849897 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.849841    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/024d8436-668e-491e-9002-8ec850963901-config-volume\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:06.850126 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.849907    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:06.951029 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.950981    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5thx4\" (UniqueName: \"kubernetes.io/projected/024d8436-668e-491e-9002-8ec850963901-kube-api-access-5thx4\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:06.951260 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.951071    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21cf5cf6-2e43-4bcb-a03f-de65bbd6929a-cert\") pod \"ingress-canary-vlfpb\" (UID: \"21cf5cf6-2e43-4bcb-a03f-de65bbd6929a\") " pod="openshift-ingress-canary/ingress-canary-vlfpb"
Jul 09 22:11:06.951260 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.951159    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdbt5\" (UniqueName: \"kubernetes.io/projected/21cf5cf6-2e43-4bcb-a03f-de65bbd6929a-kube-api-access-vdbt5\") pod \"ingress-canary-vlfpb\" (UID: \"21cf5cf6-2e43-4bcb-a03f-de65bbd6929a\") " pod="openshift-ingress-canary/ingress-canary-vlfpb"
Jul 09 22:11:06.951260 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.951190    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/024d8436-668e-491e-9002-8ec850963901-tmp-dir\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:06.951260 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.951223    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/024d8436-668e-491e-9002-8ec850963901-config-volume\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:06.951458 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.951283    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:06.951458 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:06.951398    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:11:06.951562 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:06.951465    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls podName:024d8436-668e-491e-9002-8ec850963901 nodeName:}" failed. No retries permitted until 2026-07-09 22:11:07.451446194 +0000 UTC m=+35.530215864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls") pod "dns-default-754cv" (UID: "024d8436-668e-491e-9002-8ec850963901") : secret "dns-default-metrics-tls" not found
Jul 09 22:11:06.951562 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.951543    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/024d8436-668e-491e-9002-8ec850963901-tmp-dir\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:06.951784 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.951764    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/024d8436-668e-491e-9002-8ec850963901-config-volume\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:06.955258 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.955234    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21cf5cf6-2e43-4bcb-a03f-de65bbd6929a-cert\") pod \"ingress-canary-vlfpb\" (UID: \"21cf5cf6-2e43-4bcb-a03f-de65bbd6929a\") " pod="openshift-ingress-canary/ingress-canary-vlfpb"
Jul 09 22:11:06.962988 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.962923    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5thx4\" (UniqueName: \"kubernetes.io/projected/024d8436-668e-491e-9002-8ec850963901-kube-api-access-5thx4\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:06.962988 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:06.962976    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdbt5\" (UniqueName: \"kubernetes.io/projected/21cf5cf6-2e43-4bcb-a03f-de65bbd6929a-kube-api-access-vdbt5\") pod \"ingress-canary-vlfpb\" (UID: \"21cf5cf6-2e43-4bcb-a03f-de65bbd6929a\") " pod="openshift-ingress-canary/ingress-canary-vlfpb"
Jul 09 22:11:07.071951 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:07.071912    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vlfpb"
Jul 09 22:11:07.229054 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:07.228785    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vlfpb"]
Jul 09 22:11:07.234022 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:11:07.233995    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cf5cf6_2e43_4bcb_a03f_de65bbd6929a.slice/crio-edc592a93d7d0a3f322222dbe5eb06b6ad110fd451adbd30a284794c711b7675 WatchSource:0}: Error finding container edc592a93d7d0a3f322222dbe5eb06b6ad110fd451adbd30a284794c711b7675: Status 404 returned error can't find the container with id edc592a93d7d0a3f322222dbe5eb06b6ad110fd451adbd30a284794c711b7675
Jul 09 22:11:07.454655 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:07.454615    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:07.454865 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:07.454785    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:11:07.454865 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:07.454860    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls podName:024d8436-668e-491e-9002-8ec850963901 nodeName:}" failed. No retries permitted until 2026-07-09 22:11:08.454840972 +0000 UTC m=+36.533610634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls") pod "dns-default-754cv" (UID: "024d8436-668e-491e-9002-8ec850963901") : secret "dns-default-metrics-tls" not found
Jul 09 22:11:07.481206 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:07.481120    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:11:07.481206 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:07.481149    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:11:07.481206 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:07.481149    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:11:07.483625 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:07.483600    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 22:11:07.483625 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:07.483614    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sjfh2\""
Jul 09 22:11:07.484137 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:07.484115    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 22:11:07.484233 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:07.484177    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 22:11:07.484297 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:07.484251    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jtrvn\""
Jul 09 22:11:07.484297 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:07.484276    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 22:11:07.662779 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:07.662736    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vlfpb" event={"ID":"21cf5cf6-2e43-4bcb-a03f-de65bbd6929a","Type":"ContainerStarted","Data":"edc592a93d7d0a3f322222dbe5eb06b6ad110fd451adbd30a284794c711b7675"}
Jul 09 22:11:08.464058 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:08.464015    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:08.464551 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:08.464214    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:11:08.464551 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:08.464279    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls podName:024d8436-668e-491e-9002-8ec850963901 nodeName:}" failed. No retries permitted until 2026-07-09 22:11:10.464260033 +0000 UTC m=+38.543029694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls") pod "dns-default-754cv" (UID: "024d8436-668e-491e-9002-8ec850963901") : secret "dns-default-metrics-tls" not found
Jul 09 22:11:10.479376 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:10.479331    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:10.479853 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:10.479495    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:11:10.479853 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:10.479573    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls podName:024d8436-668e-491e-9002-8ec850963901 nodeName:}" failed. No retries permitted until 2026-07-09 22:11:14.479550787 +0000 UTC m=+42.558320444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls") pod "dns-default-754cv" (UID: "024d8436-668e-491e-9002-8ec850963901") : secret "dns-default-metrics-tls" not found
Jul 09 22:11:11.675365 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:11.675324    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vlfpb" event={"ID":"21cf5cf6-2e43-4bcb-a03f-de65bbd6929a","Type":"ContainerStarted","Data":"94f15b4bc080cec76c66beb77c2cbd2728f2e219149017653114862843763f34"}
Jul 09 22:11:11.678593 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:11.678562    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrx9" event={"ID":"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612","Type":"ContainerStarted","Data":"e7caa5a5b84bc508c87a107c7f97d439c4054e75e01b080df068e90ba25c9d33"}
Jul 09 22:11:11.690242 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:11.690197    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vlfpb" podStartSLOduration=1.49633 podStartE2EDuration="5.690180629s" totalImagesPullingTime="4.193850629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:11:11.689242074 +0000 UTC m=+39.768011755" watchObservedRunningTime="2026-07-09 22:11:11.690180629 +0000 UTC m=+39.768950308"
Jul 09 22:11:12.683760 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:12.683728    2583 generic.go:356] "Generic (PLEG): container finished" podID="d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612" containerID="e7caa5a5b84bc508c87a107c7f97d439c4054e75e01b080df068e90ba25c9d33" exitCode=0
Jul 09 22:11:12.683760 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:12.683755    2583 generic.go:356] "Generic (PLEG): container finished" podID="d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612" containerID="9039995c2bd0850887e2b4091d63152bc39b9195e19c2c4672cbf0f179fe8d67" exitCode=0
Jul 09 22:11:12.684181 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:12.683816    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrx9" event={"ID":"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612","Type":"ContainerDied","Data":"e7caa5a5b84bc508c87a107c7f97d439c4054e75e01b080df068e90ba25c9d33"}
Jul 09 22:11:12.684181 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:12.683873    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrx9" event={"ID":"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612","Type":"ContainerDied","Data":"9039995c2bd0850887e2b4091d63152bc39b9195e19c2c4672cbf0f179fe8d67"}
Jul 09 22:11:13.689992 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:13.689962    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrx9" event={"ID":"d2b9d0ad-68d0-47bb-a77c-b8b50a0dd612","Type":"ContainerStarted","Data":"4c10bbd8ee5ce32acacfc4cd28f1d8ac1dd5700785ce927bb0317e46fb44f4fd"}
Jul 09 22:11:13.710668 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:13.710615    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vmrx9" podStartSLOduration=9.387263167 podStartE2EDuration="41.71059795s" totalImagesPullingTime="32.323334783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:10:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:11:13.709341997 +0000 UTC m=+41.788111679" watchObservedRunningTime="2026-07-09 22:11:13.71059795 +0000 UTC m=+41.789367629"
Jul 09 22:11:14.509734 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:14.509696    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:14.509910 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:14.509868    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:11:14.509970 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:14.509946    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls podName:024d8436-668e-491e-9002-8ec850963901 nodeName:}" failed. No retries permitted until 2026-07-09 22:11:22.50992483 +0000 UTC m=+50.588694496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls") pod "dns-default-754cv" (UID: "024d8436-668e-491e-9002-8ec850963901") : secret "dns-default-metrics-tls" not found
Jul 09 22:11:22.567644 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:22.567599    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:22.568153 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:22.567720    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:11:22.568153 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:22.567770    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls podName:024d8436-668e-491e-9002-8ec850963901 nodeName:}" failed. No retries permitted until 2026-07-09 22:11:38.567757254 +0000 UTC m=+66.646526911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls") pod "dns-default-754cv" (UID: "024d8436-668e-491e-9002-8ec850963901") : secret "dns-default-metrics-tls" not found
Jul 09 22:11:30.871387 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:30.871352    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"]
Jul 09 22:11:30.873217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:30.873201    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"
Jul 09 22:11:30.875260 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:30.875234    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 22:11:30.875791 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:30.875769    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 22:11:30.875895 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:30.875768    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 09 22:11:30.875895 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:30.875775    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 22:11:30.887228 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:30.887204    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"]
Jul 09 22:11:30.909305 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:30.909272    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"]
Jul 09 22:11:30.911287 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:30.911272    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:30.913459 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:30.913434    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 09 22:11:30.913592 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:30.913529    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 09 22:11:30.913592 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:30.913555    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 09 22:11:30.913745 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:30.913729    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 09 22:11:30.923483 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:30.923463    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"]
Jul 09 22:11:31.027287 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.027254    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ldbh\" (UniqueName: \"kubernetes.io/projected/0d52b353-b838-466b-b181-7fd976e8e357-kube-api-access-4ldbh\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.027467 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.027324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d52b353-b838-466b-b181-7fd976e8e357-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.027467 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.027345    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0d52b353-b838-466b-b181-7fd976e8e357-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.027467 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.027393    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlw8d\" (UniqueName: \"kubernetes.io/projected/eda03b49-d631-4c7a-9c9e-e2f842383d71-kube-api-access-jlw8d\") pod \"klusterlet-addon-workmgr-5648785686-kbqkp\" (UID: \"eda03b49-d631-4c7a-9c9e-e2f842383d71\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"
Jul 09 22:11:31.027467 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.027410    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/eda03b49-d631-4c7a-9c9e-e2f842383d71-klusterlet-config\") pod \"klusterlet-addon-workmgr-5648785686-kbqkp\" (UID: \"eda03b49-d631-4c7a-9c9e-e2f842383d71\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"
Jul 09 22:11:31.027467 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.027426    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0d52b353-b838-466b-b181-7fd976e8e357-hub\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.027467 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.027442    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eda03b49-d631-4c7a-9c9e-e2f842383d71-tmp\") pod \"klusterlet-addon-workmgr-5648785686-kbqkp\" (UID: \"eda03b49-d631-4c7a-9c9e-e2f842383d71\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"
Jul 09 22:11:31.027645 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.027526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0d52b353-b838-466b-b181-7fd976e8e357-ca\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.027645 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.027558    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d52b353-b838-466b-b181-7fd976e8e357-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.128214 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.128174    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ldbh\" (UniqueName: \"kubernetes.io/projected/0d52b353-b838-466b-b181-7fd976e8e357-kube-api-access-4ldbh\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.128407 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.128264    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d52b353-b838-466b-b181-7fd976e8e357-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.128407 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.128292    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0d52b353-b838-466b-b181-7fd976e8e357-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.128407 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.128335    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlw8d\" (UniqueName: \"kubernetes.io/projected/eda03b49-d631-4c7a-9c9e-e2f842383d71-kube-api-access-jlw8d\") pod \"klusterlet-addon-workmgr-5648785686-kbqkp\" (UID: \"eda03b49-d631-4c7a-9c9e-e2f842383d71\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"
Jul 09 22:11:31.128407 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.128362    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/eda03b49-d631-4c7a-9c9e-e2f842383d71-klusterlet-config\") pod \"klusterlet-addon-workmgr-5648785686-kbqkp\" (UID: \"eda03b49-d631-4c7a-9c9e-e2f842383d71\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"
Jul 09 22:11:31.128407 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.128381    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0d52b353-b838-466b-b181-7fd976e8e357-hub\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.128407 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.128404    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eda03b49-d631-4c7a-9c9e-e2f842383d71-tmp\") pod \"klusterlet-addon-workmgr-5648785686-kbqkp\" (UID: \"eda03b49-d631-4c7a-9c9e-e2f842383d71\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"
Jul 09 22:11:31.128703 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.128437    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0d52b353-b838-466b-b181-7fd976e8e357-ca\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.128703 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.128467    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d52b353-b838-466b-b181-7fd976e8e357-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.128874 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.128848    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eda03b49-d631-4c7a-9c9e-e2f842383d71-tmp\") pod \"klusterlet-addon-workmgr-5648785686-kbqkp\" (UID: \"eda03b49-d631-4c7a-9c9e-e2f842383d71\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"
Jul 09 22:11:31.129264 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.129238    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d52b353-b838-466b-b181-7fd976e8e357-additional-service-ca\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.132428 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.132403    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0d52b353-b838-466b-b181-7fd976e8e357-hub\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.132532 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.132514    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0d52b353-b838-466b-b181-7fd976e8e357-ca\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.132571 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.132545    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0d52b353-b838-466b-b181-7fd976e8e357-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.132571 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.132556    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/eda03b49-d631-4c7a-9c9e-e2f842383d71-klusterlet-config\") pod \"klusterlet-addon-workmgr-5648785686-kbqkp\" (UID: \"eda03b49-d631-4c7a-9c9e-e2f842383d71\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"
Jul 09 22:11:31.132641 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.132598    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d52b353-b838-466b-b181-7fd976e8e357-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.136079 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.136057    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ldbh\" (UniqueName: \"kubernetes.io/projected/0d52b353-b838-466b-b181-7fd976e8e357-kube-api-access-4ldbh\") pod \"cluster-proxy-proxy-agent-66bc997b64-tnhls\" (UID: \"0d52b353-b838-466b-b181-7fd976e8e357\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.136386 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.136364    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlw8d\" (UniqueName: \"kubernetes.io/projected/eda03b49-d631-4c7a-9c9e-e2f842383d71-kube-api-access-jlw8d\") pod \"klusterlet-addon-workmgr-5648785686-kbqkp\" (UID: \"eda03b49-d631-4c7a-9c9e-e2f842383d71\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"
Jul 09 22:11:31.182143 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.182082    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"
Jul 09 22:11:31.231740 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.231669    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:11:31.314199 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.313968    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"]
Jul 09 22:11:31.318295 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:11:31.318264    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda03b49_d631_4c7a_9c9e_e2f842383d71.slice/crio-286a02415502abfce19fb33d95c264114092b89c04996c4a91524fa3b7f62e03 WatchSource:0}: Error finding container 286a02415502abfce19fb33d95c264114092b89c04996c4a91524fa3b7f62e03: Status 404 returned error can't find the container with id 286a02415502abfce19fb33d95c264114092b89c04996c4a91524fa3b7f62e03
Jul 09 22:11:31.362679 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.362644    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"]
Jul 09 22:11:31.367183 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:11:31.367159    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d52b353_b838_466b_b181_7fd976e8e357.slice/crio-fc08377e7ed5ac015004da54cf261bce2c3a5b1459d4b04f3aece6ad529e1d47 WatchSource:0}: Error finding container fc08377e7ed5ac015004da54cf261bce2c3a5b1459d4b04f3aece6ad529e1d47: Status 404 returned error can't find the container with id fc08377e7ed5ac015004da54cf261bce2c3a5b1459d4b04f3aece6ad529e1d47
Jul 09 22:11:31.731738 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.731702    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls" event={"ID":"0d52b353-b838-466b-b181-7fd976e8e357","Type":"ContainerStarted","Data":"fc08377e7ed5ac015004da54cf261bce2c3a5b1459d4b04f3aece6ad529e1d47"}
Jul 09 22:11:31.732764 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:31.732742    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp" event={"ID":"eda03b49-d631-4c7a-9c9e-e2f842383d71","Type":"ContainerStarted","Data":"286a02415502abfce19fb33d95c264114092b89c04996c4a91524fa3b7f62e03"}
Jul 09 22:11:33.661319 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:33.661289    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8tn8n"
Jul 09 22:11:35.746177 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:35.746115    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls" event={"ID":"0d52b353-b838-466b-b181-7fd976e8e357","Type":"ContainerStarted","Data":"e576e7f20aa451cc19556edf6ddaad4f219bf293f13f3f25cbe966997b4fc65f"}
Jul 09 22:11:35.746550 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:35.746189    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls" event={"ID":"0d52b353-b838-466b-b181-7fd976e8e357","Type":"ContainerStarted","Data":"fb92fe45ca0190531417ee11861ea5eb9e421a11d3874f99929fcb1457fd421a"}
Jul 09 22:11:35.746550 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:35.746203    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls" event={"ID":"0d52b353-b838-466b-b181-7fd976e8e357","Type":"ContainerStarted","Data":"f69780100003ecad44019dfe5dabc555c5ca2410a554bc5c68bb24c580c18105"}
Jul 09 22:11:35.762993 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:35.762941    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls" podStartSLOduration=2.217170753 podStartE2EDuration="5.762926133s" totalImagesPullingTime="3.54575538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:11:35.762134478 +0000 UTC m=+63.840904157" watchObservedRunningTime="2026-07-09 22:11:35.762926133 +0000 UTC m=+63.841695791"
Jul 09 22:11:38.076816 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.076779    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs\") pod \"network-metrics-daemon-f7pqt\" (UID: \"6fd3da1e-960c-4bee-99b1-a621408855fe\") " pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:11:38.079210 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.079179    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 22:11:38.087797 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:38.087777    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 22:11:38.087857 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:38.087837    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs podName:6fd3da1e-960c-4bee-99b1-a621408855fe nodeName:}" failed. No retries permitted until 2026-07-09 22:12:42.087820955 +0000 UTC m=+130.166590612 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs") pod "network-metrics-daemon-f7pqt" (UID: "6fd3da1e-960c-4bee-99b1-a621408855fe") : secret "metrics-daemon-secret" not found
Jul 09 22:11:38.177573 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.177542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrd2q\" (UniqueName: \"kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q\") pod \"network-check-target-hg95s\" (UID: \"d961f45b-9c6d-4c31-8b5a-8f7fa95107ee\") " pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:11:38.177682 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.177633    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret\") pod \"global-pull-secret-syncer-p6khq\" (UID: \"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1\") " pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:11:38.179744 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.179722    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 22:11:38.179787 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.179775    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 22:11:38.190107 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.190067    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 22:11:38.190357 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.190341    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1-original-pull-secret\") pod \"global-pull-secret-syncer-p6khq\" (UID: \"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1\") " pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:11:38.200820 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.200789    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrd2q\" (UniqueName: \"kubernetes.io/projected/d961f45b-9c6d-4c31-8b5a-8f7fa95107ee-kube-api-access-rrd2q\") pod \"network-check-target-hg95s\" (UID: \"d961f45b-9c6d-4c31-8b5a-8f7fa95107ee\") " pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:11:38.398291 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.398235    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p6khq"
Jul 09 22:11:38.406405 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.406379    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sjfh2\""
Jul 09 22:11:38.414407 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.414382    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:11:38.530901 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.530868    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p6khq"]
Jul 09 22:11:38.534060 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:11:38.534020    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb27c8e0_acdb_47a0_b8fd_e66cd8a08ae1.slice/crio-ab76520cde7885d36a8267767a50f1163ad6a80b3a5df75741d03fb6b57f8873 WatchSource:0}: Error finding container ab76520cde7885d36a8267767a50f1163ad6a80b3a5df75741d03fb6b57f8873: Status 404 returned error can't find the container with id ab76520cde7885d36a8267767a50f1163ad6a80b3a5df75741d03fb6b57f8873
Jul 09 22:11:38.548305 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.548281    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hg95s"]
Jul 09 22:11:38.551561 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:11:38.551533    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd961f45b_9c6d_4c31_8b5a_8f7fa95107ee.slice/crio-f15a8731fa34eb3eb6dd7d21aac9d8ec16e4727eb99a0e688195d691013909ab WatchSource:0}: Error finding container f15a8731fa34eb3eb6dd7d21aac9d8ec16e4727eb99a0e688195d691013909ab: Status 404 returned error can't find the container with id f15a8731fa34eb3eb6dd7d21aac9d8ec16e4727eb99a0e688195d691013909ab
Jul 09 22:11:38.581046 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.581014    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:11:38.581201 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:38.581143    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:11:38.581201 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:11:38.581195    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls podName:024d8436-668e-491e-9002-8ec850963901 nodeName:}" failed. No retries permitted until 2026-07-09 22:12:10.581181181 +0000 UTC m=+98.659950838 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls") pod "dns-default-754cv" (UID: "024d8436-668e-491e-9002-8ec850963901") : secret "dns-default-metrics-tls" not found
Jul 09 22:11:38.754900 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.754809    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p6khq" event={"ID":"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1","Type":"ContainerStarted","Data":"ab76520cde7885d36a8267767a50f1163ad6a80b3a5df75741d03fb6b57f8873"}
Jul 09 22:11:38.755896 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:38.755869    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hg95s" event={"ID":"d961f45b-9c6d-4c31-8b5a-8f7fa95107ee","Type":"ContainerStarted","Data":"f15a8731fa34eb3eb6dd7d21aac9d8ec16e4727eb99a0e688195d691013909ab"}
Jul 09 22:11:43.771150 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:43.771108    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hg95s" event={"ID":"d961f45b-9c6d-4c31-8b5a-8f7fa95107ee","Type":"ContainerStarted","Data":"c8a105404d0f1d3e14392408f79b2cc78de577b60c5987564b84b4c150372938"}
Jul 09 22:11:43.771553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:43.771192    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:11:43.772625 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:43.772599    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p6khq" event={"ID":"db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1","Type":"ContainerStarted","Data":"88b4c7bf58aeb9e53bc4fa34df9d4313a284cfeb1982bf3edd4b1162f6475ebc"}
Jul 09 22:11:43.786217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:43.786168    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hg95s" podStartSLOduration=66.999307814 podStartE2EDuration="1m11.786154077s" totalImagesPullingTime="4.786846263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:11:43.785297156 +0000 UTC m=+71.864066835" watchObservedRunningTime="2026-07-09 22:11:43.786154077 +0000 UTC m=+71.864923739"
Jul 09 22:11:43.798281 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:11:43.798233    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p6khq" podStartSLOduration=66.990342611 podStartE2EDuration="1m11.798214604s" totalImagesPullingTime="4.807871993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:11:43.797941883 +0000 UTC m=+71.876711562" watchObservedRunningTime="2026-07-09 22:11:43.798214604 +0000 UTC m=+71.876984283"
Jul 09 22:12:01.828813 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:12:01.826829    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp" event={"ID":"eda03b49-d631-4c7a-9c9e-e2f842383d71","Type":"ContainerStarted","Data":"4d2524273100b6940982984304f4e0dfac13e95fc48d39b4f114b5bca190b3e4"}
Jul 09 22:12:01.828813 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:12:01.827021    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"
Jul 09 22:12:01.829291 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:12:01.829233    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"
Jul 09 22:12:01.842663 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:12:01.842609    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp" podStartSLOduration=1.970498358 podStartE2EDuration="31.842594237s" totalImagesPullingTime="29.872095879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:12:01.841196303 +0000 UTC m=+89.919965981" watchObservedRunningTime="2026-07-09 22:12:01.842594237 +0000 UTC m=+89.921363937"
Jul 09 22:12:10.618654 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:12:10.618613    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:12:10.619166 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:12:10.618770    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:12:10.619166 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:12:10.618847    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls podName:024d8436-668e-491e-9002-8ec850963901 nodeName:}" failed. No retries permitted until 2026-07-09 22:13:14.618831541 +0000 UTC m=+162.697601198 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls") pod "dns-default-754cv" (UID: "024d8436-668e-491e-9002-8ec850963901") : secret "dns-default-metrics-tls" not found
Jul 09 22:12:14.778789 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:12:14.778759    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hg95s"
Jul 09 22:12:42.136205 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:12:42.136162    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs\") pod \"network-metrics-daemon-f7pqt\" (UID: \"6fd3da1e-960c-4bee-99b1-a621408855fe\") " pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:12:42.136686 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:12:42.136312    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 22:12:42.136686 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:12:42.136379    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs podName:6fd3da1e-960c-4bee-99b1-a621408855fe nodeName:}" failed. No retries permitted until 2026-07-09 22:14:44.136361509 +0000 UTC m=+252.215131171 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs") pod "network-metrics-daemon-f7pqt" (UID: "6fd3da1e-960c-4bee-99b1-a621408855fe") : secret "metrics-daemon-secret" not found
Jul 09 22:13:09.766174 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:13:09.766122    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-754cv" podUID="024d8436-668e-491e-9002-8ec850963901"
Jul 09 22:13:10.014214 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:13:10.014186    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-754cv"
Jul 09 22:13:10.491718 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:13:10.491684    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:13:14.665404 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:13:14.665363    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:13:14.665911 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:13:14.665525    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 22:13:14.665911 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:13:14.665609    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls podName:024d8436-668e-491e-9002-8ec850963901 nodeName:}" failed. No retries permitted until 2026-07-09 22:15:16.665591624 +0000 UTC m=+284.744361280 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls") pod "dns-default-754cv" (UID: "024d8436-668e-491e-9002-8ec850963901") : secret "dns-default-metrics-tls" not found
Jul 09 22:13:25.481254 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:13:25.481150    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:14:01.827464 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:01.827414    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp" podUID="eda03b49-d631-4c7a-9c9e-e2f842383d71" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused"
Jul 09 22:14:02.160327 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:02.160293    2583 generic.go:356] "Generic (PLEG): container finished" podID="eda03b49-d631-4c7a-9c9e-e2f842383d71" containerID="4d2524273100b6940982984304f4e0dfac13e95fc48d39b4f114b5bca190b3e4" exitCode=1
Jul 09 22:14:02.160486 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:02.160369    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp" event={"ID":"eda03b49-d631-4c7a-9c9e-e2f842383d71","Type":"ContainerDied","Data":"4d2524273100b6940982984304f4e0dfac13e95fc48d39b4f114b5bca190b3e4"}
Jul 09 22:14:02.160733 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:02.160719    2583 scope.go:117] "RemoveContainer" containerID="4d2524273100b6940982984304f4e0dfac13e95fc48d39b4f114b5bca190b3e4"
Jul 09 22:14:03.164665 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:03.164629    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp" event={"ID":"eda03b49-d631-4c7a-9c9e-e2f842383d71","Type":"ContainerStarted","Data":"4e450f7ec83406323f85de889ecd1f415b362cfb3da9d4ffebb65dda2b67e234"}
Jul 09 22:14:03.165156 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:03.164903    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"
Jul 09 22:14:03.165548 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:03.165530    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5648785686-kbqkp"
Jul 09 22:14:35.250668 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.250615    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8tg9t"]
Jul 09 22:14:35.254622 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.254599    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:35.266736 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.266708    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 22:14:35.266874 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.266752    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 22:14:35.266958 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.266938    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rqrfq\""
Jul 09 22:14:35.266958 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.266950    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 22:14:35.267073 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.266947    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 22:14:35.292263 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.292231    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8tg9t"]
Jul 09 22:14:35.429514 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.429473    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:35.429514 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.429515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:35.429738 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.429617    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/637326be-847b-434f-9147-5b7aa3f5f98b-data-volume\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:35.429738 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.429637    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmrz8\" (UniqueName: \"kubernetes.io/projected/637326be-847b-434f-9147-5b7aa3f5f98b-kube-api-access-hmrz8\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:35.429738 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.429697    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/637326be-847b-434f-9147-5b7aa3f5f98b-crio-socket\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:35.530653 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.530567    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/637326be-847b-434f-9147-5b7aa3f5f98b-data-volume\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:35.530653 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.530619    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmrz8\" (UniqueName: \"kubernetes.io/projected/637326be-847b-434f-9147-5b7aa3f5f98b-kube-api-access-hmrz8\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:35.530653 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.530653    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/637326be-847b-434f-9147-5b7aa3f5f98b-crio-socket\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:35.530823 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.530674    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:35.530823 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.530695    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:35.530823 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.530776    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/637326be-847b-434f-9147-5b7aa3f5f98b-crio-socket\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:35.530823 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:35.530800    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:14:35.530944 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:35.530823    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:14:35.530944 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:35.530875    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm podName:637326be-847b-434f-9147-5b7aa3f5f98b nodeName:}" failed. No retries permitted until 2026-07-09 22:14:36.030854002 +0000 UTC m=+244.109623659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8tg9t" (UID: "637326be-847b-434f-9147-5b7aa3f5f98b") : configmap "kube-rbac-proxy" not found
Jul 09 22:14:35.530944 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:35.530891    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls podName:637326be-847b-434f-9147-5b7aa3f5f98b nodeName:}" failed. No retries permitted until 2026-07-09 22:14:36.030884429 +0000 UTC m=+244.109654085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tg9t" (UID: "637326be-847b-434f-9147-5b7aa3f5f98b") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:14:35.530944 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.530884    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/637326be-847b-434f-9147-5b7aa3f5f98b-data-volume\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:35.551605 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:35.551572    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmrz8\" (UniqueName: \"kubernetes.io/projected/637326be-847b-434f-9147-5b7aa3f5f98b-kube-api-access-hmrz8\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:36.034709 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:36.034658    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:36.034709 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:36.034719    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:36.034930 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:36.034823    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:14:36.034930 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:36.034872    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:14:36.034930 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:36.034879    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls podName:637326be-847b-434f-9147-5b7aa3f5f98b nodeName:}" failed. No retries permitted until 2026-07-09 22:14:37.034864756 +0000 UTC m=+245.113634416 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tg9t" (UID: "637326be-847b-434f-9147-5b7aa3f5f98b") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:14:36.035079 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:36.034954    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm podName:637326be-847b-434f-9147-5b7aa3f5f98b nodeName:}" failed. No retries permitted until 2026-07-09 22:14:37.034937608 +0000 UTC m=+245.113707266 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8tg9t" (UID: "637326be-847b-434f-9147-5b7aa3f5f98b") : configmap "kube-rbac-proxy" not found
Jul 09 22:14:37.041361 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:37.041328    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:37.041361 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:37.041366    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:37.041774 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:37.041470    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:14:37.041774 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:37.041494    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:14:37.041774 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:37.041523    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm podName:637326be-847b-434f-9147-5b7aa3f5f98b nodeName:}" failed. No retries permitted until 2026-07-09 22:14:39.041508536 +0000 UTC m=+247.120278192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8tg9t" (UID: "637326be-847b-434f-9147-5b7aa3f5f98b") : configmap "kube-rbac-proxy" not found
Jul 09 22:14:37.041774 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:37.041550    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls podName:637326be-847b-434f-9147-5b7aa3f5f98b nodeName:}" failed. No retries permitted until 2026-07-09 22:14:39.04153702 +0000 UTC m=+247.120306696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tg9t" (UID: "637326be-847b-434f-9147-5b7aa3f5f98b") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:14:37.375654 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:37.375627    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-psgll_02fa67f4-019f-47f2-b81c-6a5d1f456664/dns-node-resolver/0.log"
Jul 09 22:14:37.968036 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:37.968006    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cfzct_1f1cf532-03a5-4ce5-b9ae-e71789ef7111/node-ca/0.log"
Jul 09 22:14:39.057545 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:39.057498    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:39.057545 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:39.057553    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:39.057988 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:39.057672    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:14:39.057988 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:39.057743    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls podName:637326be-847b-434f-9147-5b7aa3f5f98b nodeName:}" failed. No retries permitted until 2026-07-09 22:14:43.05772988 +0000 UTC m=+251.136499542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tg9t" (UID: "637326be-847b-434f-9147-5b7aa3f5f98b") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:14:39.057988 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:39.057672    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:14:39.057988 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:39.057823    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm podName:637326be-847b-434f-9147-5b7aa3f5f98b nodeName:}" failed. No retries permitted until 2026-07-09 22:14:43.057803394 +0000 UTC m=+251.136573053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8tg9t" (UID: "637326be-847b-434f-9147-5b7aa3f5f98b") : configmap "kube-rbac-proxy" not found
Jul 09 22:14:39.177859 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:39.177832    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vlfpb_21cf5cf6-2e43-4bcb-a03f-de65bbd6929a/serve-healthcheck-canary/0.log"
Jul 09 22:14:43.085050 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:43.085008    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:43.085050 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:43.085053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:43.085550 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:43.085211    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:14:43.085550 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:43.085286    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls podName:637326be-847b-434f-9147-5b7aa3f5f98b nodeName:}" failed. No retries permitted until 2026-07-09 22:14:51.085268532 +0000 UTC m=+259.164038193 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tg9t" (UID: "637326be-847b-434f-9147-5b7aa3f5f98b") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:14:43.085550 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:43.085209    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 22:14:43.085550 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:43.085347    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm podName:637326be-847b-434f-9147-5b7aa3f5f98b nodeName:}" failed. No retries permitted until 2026-07-09 22:14:51.085335442 +0000 UTC m=+259.164105098 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8tg9t" (UID: "637326be-847b-434f-9147-5b7aa3f5f98b") : configmap "kube-rbac-proxy" not found
Jul 09 22:14:44.193216 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:44.193172    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs\") pod \"network-metrics-daemon-f7pqt\" (UID: \"6fd3da1e-960c-4bee-99b1-a621408855fe\") " pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:14:44.193637 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:44.193308    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 22:14:44.193637 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:44.193369    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs podName:6fd3da1e-960c-4bee-99b1-a621408855fe nodeName:}" failed. No retries permitted until 2026-07-09 22:16:46.19334938 +0000 UTC m=+374.272119053 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs") pod "network-metrics-daemon-f7pqt" (UID: "6fd3da1e-960c-4bee-99b1-a621408855fe") : secret "metrics-daemon-secret" not found
Jul 09 22:14:51.145825 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:51.145779    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:51.145825 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:51.145826    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:14:51.146398 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:51.145935    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 22:14:51.146398 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:14:51.146002    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls podName:637326be-847b-434f-9147-5b7aa3f5f98b nodeName:}" failed. No retries permitted until 2026-07-09 22:15:07.145984927 +0000 UTC m=+275.224754588 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8tg9t" (UID: "637326be-847b-434f-9147-5b7aa3f5f98b") : secret "insights-runtime-extractor-tls" not found
Jul 09 22:14:51.146546 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:14:51.146524    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/637326be-847b-434f-9147-5b7aa3f5f98b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:15:05.998029 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:05.997946    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tnhsz"]
Jul 09 22:15:06.000902 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:06.000882    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tnhsz"
Jul 09 22:15:06.003678 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:06.003657    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rd7dw\""
Jul 09 22:15:06.004629 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:06.004613    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 09 22:15:06.035637 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:06.035602    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tnhsz"]
Jul 09 22:15:06.054811 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:06.054778    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/25d2ce90-d384-45ea-8900-d05e38364143-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-tnhsz\" (UID: \"25d2ce90-d384-45ea-8900-d05e38364143\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tnhsz"
Jul 09 22:15:06.155393 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:06.155360    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/25d2ce90-d384-45ea-8900-d05e38364143-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-tnhsz\" (UID: \"25d2ce90-d384-45ea-8900-d05e38364143\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tnhsz"
Jul 09 22:15:06.155650 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:15:06.155509    2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 09 22:15:06.155650 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:15:06.155587    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d2ce90-d384-45ea-8900-d05e38364143-tls-certificates podName:25d2ce90-d384-45ea-8900-d05e38364143 nodeName:}" failed. No retries permitted until 2026-07-09 22:15:06.655569138 +0000 UTC m=+274.734338812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/25d2ce90-d384-45ea-8900-d05e38364143-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-tnhsz" (UID: "25d2ce90-d384-45ea-8900-d05e38364143") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 09 22:15:06.659798 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:06.659761    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/25d2ce90-d384-45ea-8900-d05e38364143-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-tnhsz\" (UID: \"25d2ce90-d384-45ea-8900-d05e38364143\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tnhsz"
Jul 09 22:15:06.663462 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:06.663428    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/25d2ce90-d384-45ea-8900-d05e38364143-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-tnhsz\" (UID: \"25d2ce90-d384-45ea-8900-d05e38364143\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tnhsz"
Jul 09 22:15:06.909985 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:06.909891    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tnhsz"
Jul 09 22:15:07.056039 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:07.056001    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tnhsz"]
Jul 09 22:15:07.059466 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:15:07.059439    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d2ce90_d384_45ea_8900_d05e38364143.slice/crio-6de175b676ae3e5750ce8fa2044a610f7dafd6ce16718f6ace5584cef11d00da WatchSource:0}: Error finding container 6de175b676ae3e5750ce8fa2044a610f7dafd6ce16718f6ace5584cef11d00da: Status 404 returned error can't find the container with id 6de175b676ae3e5750ce8fa2044a610f7dafd6ce16718f6ace5584cef11d00da
Jul 09 22:15:07.165122 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:07.164999    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:15:07.167398 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:07.167373    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/637326be-847b-434f-9147-5b7aa3f5f98b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8tg9t\" (UID: \"637326be-847b-434f-9147-5b7aa3f5f98b\") " pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:15:07.343228 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:07.343190    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tnhsz" event={"ID":"25d2ce90-d384-45ea-8900-d05e38364143","Type":"ContainerStarted","Data":"6de175b676ae3e5750ce8fa2044a610f7dafd6ce16718f6ace5584cef11d00da"}
Jul 09 22:15:07.363392 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:07.363363    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8tg9t"
Jul 09 22:15:07.510188 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:07.510156    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8tg9t"]
Jul 09 22:15:07.513940 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:15:07.513914    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod637326be_847b_434f_9147_5b7aa3f5f98b.slice/crio-8d9cf8d16fd6669bffbf9af10ef5e980b5c209abbe0633d60bfcfc31d4d56509 WatchSource:0}: Error finding container 8d9cf8d16fd6669bffbf9af10ef5e980b5c209abbe0633d60bfcfc31d4d56509: Status 404 returned error can't find the container with id 8d9cf8d16fd6669bffbf9af10ef5e980b5c209abbe0633d60bfcfc31d4d56509
Jul 09 22:15:08.348850 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:08.348764    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tnhsz" event={"ID":"25d2ce90-d384-45ea-8900-d05e38364143","Type":"ContainerStarted","Data":"6e9d98e7a6e038484f9501a6d13d01908f9acabd22b8a2589caa9ecc5a3c0992"}
Jul 09 22:15:08.349743 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:08.349657    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tnhsz"
Jul 09 22:15:08.352134 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:08.352050    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8tg9t" event={"ID":"637326be-847b-434f-9147-5b7aa3f5f98b","Type":"ContainerStarted","Data":"8d9cf8d16fd6669bffbf9af10ef5e980b5c209abbe0633d60bfcfc31d4d56509"}
Jul 09 22:15:08.356685 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:08.356425    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tnhsz"
Jul 09 22:15:08.371948 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:08.371439    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-tnhsz" podStartSLOduration=2.370912838 podStartE2EDuration="3.371417412s" totalImagesPullingTime="1.000504574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:15:08.371051885 +0000 UTC m=+276.449821565" watchObservedRunningTime="2026-07-09 22:15:08.371417412 +0000 UTC m=+276.450187092"
Jul 09 22:15:12.367378 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:12.367290    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8tg9t" event={"ID":"637326be-847b-434f-9147-5b7aa3f5f98b","Type":"ContainerStarted","Data":"4371291c3d39e15eba91ba89c6cd68a24e6a036074213b610b534cc4736466d1"}
Jul 09 22:15:12.367378 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:12.367350    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8tg9t" event={"ID":"637326be-847b-434f-9147-5b7aa3f5f98b","Type":"ContainerStarted","Data":"a822e3437d234a4b837ba236f67f58aace62ce5481c24735f7d4dcf73983dbdf"}
Jul 09 22:15:13.015461 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:15:13.015417    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-754cv" podUID="024d8436-668e-491e-9002-8ec850963901"
Jul 09 22:15:13.370818 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:13.370741    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-754cv"
Jul 09 22:15:15.378742 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.378704    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8tg9t" event={"ID":"637326be-847b-434f-9147-5b7aa3f5f98b","Type":"ContainerStarted","Data":"314ed17bc25763afc8a4d78435a0704ffe8d03e22e49bac222ec91a22f039ef6"}
Jul 09 22:15:15.394994 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.394943    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8tg9t" podStartSLOduration=32.846370985 podStartE2EDuration="40.39492652s" totalImagesPullingTime="7.548555535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:14:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:15:15.393872837 +0000 UTC m=+283.472642516" watchObservedRunningTime="2026-07-09 22:15:15.39492652 +0000 UTC m=+283.473696198"
Jul 09 22:15:15.560765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.560683    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f68cf7595-6gnrr"]
Jul 09 22:15:15.563637 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.563621    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.566345 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.566321    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 22:15:15.567597 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.567571    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 22:15:15.567597 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.567594    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 22:15:15.567770 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.567606    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l6k92\""
Jul 09 22:15:15.567869 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.567853    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 22:15:15.567943 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.567928    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 22:15:15.567994 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.567982    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 22:15:15.568067 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.568050    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 22:15:15.574634 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.574616    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 22:15:15.586072 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.586047    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f68cf7595-6gnrr"]
Jul 09 22:15:15.634589 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.634555    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-trusted-ca-bundle\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.634773 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.634625    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-serving-cert\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.634773 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.634657    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-service-ca\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.634773 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.634681    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-oauth-serving-cert\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.634773 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.634753    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-config\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.634924 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.634783    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvptj\" (UniqueName: \"kubernetes.io/projected/37f5fcff-508f-4e07-b2a6-c155755adf8f-kube-api-access-kvptj\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.634924 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.634820    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-oauth-config\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.735213 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.735179    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-config\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.735213 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.735214    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvptj\" (UniqueName: \"kubernetes.io/projected/37f5fcff-508f-4e07-b2a6-c155755adf8f-kube-api-access-kvptj\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.735446 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.735243    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-oauth-config\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.735446 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.735291    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-trusted-ca-bundle\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.735446 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.735341    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-serving-cert\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.735446 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.735364    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-service-ca\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.735446 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.735387    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-oauth-serving-cert\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.735903 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.735874    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-config\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.736070 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.736017    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-oauth-serving-cert\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.736189 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.736156    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-service-ca\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.736331 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.736309    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-trusted-ca-bundle\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.738216 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.738117    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-oauth-config\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.738653 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.738632    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-serving-cert\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.744765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.744742    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvptj\" (UniqueName: \"kubernetes.io/projected/37f5fcff-508f-4e07-b2a6-c155755adf8f-kube-api-access-kvptj\") pod \"console-6f68cf7595-6gnrr\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") " pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:15.872913 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:15.872876    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:16.003909 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:16.003881    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f68cf7595-6gnrr"]
Jul 09 22:15:16.007808 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:15:16.007780    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f5fcff_508f_4e07_b2a6_c155755adf8f.slice/crio-e20b20fe8a18531a66aaa075e0b58f47b515510c6fc88d7e4d38593f97108eed WatchSource:0}: Error finding container e20b20fe8a18531a66aaa075e0b58f47b515510c6fc88d7e4d38593f97108eed: Status 404 returned error can't find the container with id e20b20fe8a18531a66aaa075e0b58f47b515510c6fc88d7e4d38593f97108eed
Jul 09 22:15:16.382681 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:16.382645    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f68cf7595-6gnrr" event={"ID":"37f5fcff-508f-4e07-b2a6-c155755adf8f","Type":"ContainerStarted","Data":"e20b20fe8a18531a66aaa075e0b58f47b515510c6fc88d7e4d38593f97108eed"}
Jul 09 22:15:16.741473 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:16.741380    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:15:16.743897 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:16.743873    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/024d8436-668e-491e-9002-8ec850963901-metrics-tls\") pod \"dns-default-754cv\" (UID: \"024d8436-668e-491e-9002-8ec850963901\") " pod="openshift-dns/dns-default-754cv"
Jul 09 22:15:16.974023 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:16.973995    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r6x6z\""
Jul 09 22:15:16.981902 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:16.981876    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-754cv"
Jul 09 22:15:17.126020 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:17.125974    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-754cv"]
Jul 09 22:15:17.130322 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:15:17.130253    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod024d8436_668e_491e_9002_8ec850963901.slice/crio-23555bb4dc5632652999c1a6bb679a4099fc76ebce8d15c72bfcaeddc529c483 WatchSource:0}: Error finding container 23555bb4dc5632652999c1a6bb679a4099fc76ebce8d15c72bfcaeddc529c483: Status 404 returned error can't find the container with id 23555bb4dc5632652999c1a6bb679a4099fc76ebce8d15c72bfcaeddc529c483
Jul 09 22:15:17.387640 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:17.387575    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-754cv" event={"ID":"024d8436-668e-491e-9002-8ec850963901","Type":"ContainerStarted","Data":"23555bb4dc5632652999c1a6bb679a4099fc76ebce8d15c72bfcaeddc529c483"}
Jul 09 22:15:20.400526 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:20.400483    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f68cf7595-6gnrr" event={"ID":"37f5fcff-508f-4e07-b2a6-c155755adf8f","Type":"ContainerStarted","Data":"aa7523de647bdbcc22f156e08093c1bcafb993a2580dc6b653d37d2a39249802"}
Jul 09 22:15:20.402164 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:20.402137    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-754cv" event={"ID":"024d8436-668e-491e-9002-8ec850963901","Type":"ContainerStarted","Data":"1fa6e5c5880ab0a35316c820bd89a37e96522cb5989df4c5b65e5fcdfc8718ba"}
Jul 09 22:15:20.402261 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:20.402180    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-754cv" event={"ID":"024d8436-668e-491e-9002-8ec850963901","Type":"ContainerStarted","Data":"7d8daac67a013af855c9145bb2a4dce5fcc339f4e4840d5382842a3b7efd92c1"}
Jul 09 22:15:20.402300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:20.402262    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-754cv"
Jul 09 22:15:20.420451 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:20.420408    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f68cf7595-6gnrr" podStartSLOduration=2.0626285109999998 podStartE2EDuration="5.420394309s" totalImagesPullingTime="3.357765798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:15:20.419849725 +0000 UTC m=+288.498619404" watchObservedRunningTime="2026-07-09 22:15:20.420394309 +0000 UTC m=+288.499163990"
Jul 09 22:15:20.441010 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:20.440882    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-754cv" podStartSLOduration=252.205810599 podStartE2EDuration="4m14.440863065s" totalImagesPullingTime="2.235052466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:15:20.440369181 +0000 UTC m=+288.519138860" watchObservedRunningTime="2026-07-09 22:15:20.440863065 +0000 UTC m=+288.519632746"
Jul 09 22:15:25.873623 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:25.873562    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:25.874033 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:25.873649    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:25.878485 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:25.878460    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:26.424476 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:26.424445    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:15:28.481847 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:15:28.481799    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f7pqt" podUID="6fd3da1e-960c-4bee-99b1-a621408855fe"
Jul 09 22:15:28.949210 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:28.949172    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w7gts"]
Jul 09 22:15:28.952425 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:28.952402    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:28.956657 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:28.956632    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 22:15:28.956657 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:28.956643    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 22:15:28.957013 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:28.956991    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 22:15:28.957013 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:28.957003    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 22:15:28.957013 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:28.957008    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 22:15:28.957248 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:28.957011    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 22:15:28.957248 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:28.956996    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tq6cx\""
Jul 09 22:15:29.031575 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.031538    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab862021-3ae4-47ba-b3ac-418dbb820e15-node-exporter-wtmp\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.031575 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.031586    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab862021-3ae4-47ba-b3ac-418dbb820e15-node-exporter-accelerators-collector-config\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.031810 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.031613    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab862021-3ae4-47ba-b3ac-418dbb820e15-root\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.031810 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.031636    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab862021-3ae4-47ba-b3ac-418dbb820e15-node-exporter-textfile\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.031810 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.031687    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab862021-3ae4-47ba-b3ac-418dbb820e15-sys\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.031810 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.031703    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab862021-3ae4-47ba-b3ac-418dbb820e15-node-exporter-tls\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.031810 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.031762    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab862021-3ae4-47ba-b3ac-418dbb820e15-metrics-client-ca\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.031810 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.031792    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmrgb\" (UniqueName: \"kubernetes.io/projected/ab862021-3ae4-47ba-b3ac-418dbb820e15-kube-api-access-jmrgb\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.032017 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.031825    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab862021-3ae4-47ba-b3ac-418dbb820e15-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.133051 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.133013    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab862021-3ae4-47ba-b3ac-418dbb820e15-metrics-client-ca\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.133051 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.133049    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmrgb\" (UniqueName: \"kubernetes.io/projected/ab862021-3ae4-47ba-b3ac-418dbb820e15-kube-api-access-jmrgb\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.133334 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.133070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab862021-3ae4-47ba-b3ac-418dbb820e15-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.133334 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.133114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab862021-3ae4-47ba-b3ac-418dbb820e15-node-exporter-wtmp\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.133334 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.133146    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab862021-3ae4-47ba-b3ac-418dbb820e15-node-exporter-accelerators-collector-config\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.133334 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.133172    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab862021-3ae4-47ba-b3ac-418dbb820e15-root\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.133334 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.133194    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab862021-3ae4-47ba-b3ac-418dbb820e15-node-exporter-textfile\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.133334 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.133252    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab862021-3ae4-47ba-b3ac-418dbb820e15-sys\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.133334 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.133258    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ab862021-3ae4-47ba-b3ac-418dbb820e15-node-exporter-wtmp\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.133334 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.133274    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab862021-3ae4-47ba-b3ac-418dbb820e15-node-exporter-tls\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.133334 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.133260    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ab862021-3ae4-47ba-b3ac-418dbb820e15-root\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.133728 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.133391    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab862021-3ae4-47ba-b3ac-418dbb820e15-sys\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.133728 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.133571    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ab862021-3ae4-47ba-b3ac-418dbb820e15-node-exporter-textfile\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.133800 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.133752    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab862021-3ae4-47ba-b3ac-418dbb820e15-metrics-client-ca\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.133800 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.133774    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ab862021-3ae4-47ba-b3ac-418dbb820e15-node-exporter-accelerators-collector-config\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.135612 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.135585    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab862021-3ae4-47ba-b3ac-418dbb820e15-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.135705 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.135629    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ab862021-3ae4-47ba-b3ac-418dbb820e15-node-exporter-tls\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.142945 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.142917    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmrgb\" (UniqueName: \"kubernetes.io/projected/ab862021-3ae4-47ba-b3ac-418dbb820e15-kube-api-access-jmrgb\") pod \"node-exporter-w7gts\" (UID: \"ab862021-3ae4-47ba-b3ac-418dbb820e15\") " pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.262123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.262018    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w7gts"
Jul 09 22:15:29.273512 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:15:29.273483    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab862021_3ae4_47ba_b3ac_418dbb820e15.slice/crio-d1f3a38011be1beba8086ce74fd77851d8130eff76c06eac04acae335baa3773 WatchSource:0}: Error finding container d1f3a38011be1beba8086ce74fd77851d8130eff76c06eac04acae335baa3773: Status 404 returned error can't find the container with id d1f3a38011be1beba8086ce74fd77851d8130eff76c06eac04acae335baa3773
Jul 09 22:15:29.430743 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:29.430709    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7gts" event={"ID":"ab862021-3ae4-47ba-b3ac-418dbb820e15","Type":"ContainerStarted","Data":"d1f3a38011be1beba8086ce74fd77851d8130eff76c06eac04acae335baa3773"}
Jul 09 22:15:30.408577 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:30.408547    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-754cv"
Jul 09 22:15:30.435266 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:30.435228    2583 generic.go:356] "Generic (PLEG): container finished" podID="ab862021-3ae4-47ba-b3ac-418dbb820e15" containerID="a4730051c1d1c0f28ee853f9f683682cf3331d4e491e5d7bd62ce2a70b863c8e" exitCode=0
Jul 09 22:15:30.435449 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:30.435316    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7gts" event={"ID":"ab862021-3ae4-47ba-b3ac-418dbb820e15","Type":"ContainerDied","Data":"a4730051c1d1c0f28ee853f9f683682cf3331d4e491e5d7bd62ce2a70b863c8e"}
Jul 09 22:15:31.440532 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:31.440493    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7gts" event={"ID":"ab862021-3ae4-47ba-b3ac-418dbb820e15","Type":"ContainerStarted","Data":"8a69f34116380f73f01fa0d8bae48f668b22207d837f4f7b63ca4c98a1e5087a"}
Jul 09 22:15:31.440938 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:31.440554    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w7gts" event={"ID":"ab862021-3ae4-47ba-b3ac-418dbb820e15","Type":"ContainerStarted","Data":"d11271ff81cc673318d4545420801c5fcf577a841180c535ceaf17df8f17ec84"}
Jul 09 22:15:31.464272 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:31.464221    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w7gts" podStartSLOduration=2.412833997 podStartE2EDuration="3.464204788s" totalImagesPullingTime="986.666501ms" totalInitContainerRuntime="64.70429ms" isStatefulPod=true podCreationTimestamp="2026-07-09 22:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:15:31.46343085 +0000 UTC m=+299.542200533" watchObservedRunningTime="2026-07-09 22:15:31.464204788 +0000 UTC m=+299.542974467"
Jul 09 22:15:32.299274 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:32.299244    2583 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 22:15:34.190681 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.190646    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"]
Jul 09 22:15:34.195304 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.195288    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.198620 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.198578    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rwh76\""
Jul 09 22:15:34.198620 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.198588    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 09 22:15:34.198839 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.198657    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 09 22:15:34.198839 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.198803    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 09 22:15:34.198954 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.198870    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 09 22:15:34.198954 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.198894    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 09 22:15:34.205267 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.205247    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 09 22:15:34.213713 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.213690    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"]
Jul 09 22:15:34.278814 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.278776    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19347203-7153-4167-9b2c-f9e4cdea7ee1-serving-certs-ca-bundle\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.278814 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.278815    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19347203-7153-4167-9b2c-f9e4cdea7ee1-metrics-client-ca\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.279019 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.278835    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/19347203-7153-4167-9b2c-f9e4cdea7ee1-secret-telemeter-client\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.279019 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.278859    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9gdd\" (UniqueName: \"kubernetes.io/projected/19347203-7153-4167-9b2c-f9e4cdea7ee1-kube-api-access-p9gdd\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.279019 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.278942    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/19347203-7153-4167-9b2c-f9e4cdea7ee1-federate-client-tls\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.279019 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.278990    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/19347203-7153-4167-9b2c-f9e4cdea7ee1-telemeter-client-tls\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.279188 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.279019    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19347203-7153-4167-9b2c-f9e4cdea7ee1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.279188 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.279044    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19347203-7153-4167-9b2c-f9e4cdea7ee1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.379701 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.379656    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19347203-7153-4167-9b2c-f9e4cdea7ee1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.379878 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.379713    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19347203-7153-4167-9b2c-f9e4cdea7ee1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.379878 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.379746    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19347203-7153-4167-9b2c-f9e4cdea7ee1-serving-certs-ca-bundle\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.379878 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.379770    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19347203-7153-4167-9b2c-f9e4cdea7ee1-metrics-client-ca\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.379878 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.379799    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/19347203-7153-4167-9b2c-f9e4cdea7ee1-secret-telemeter-client\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.379878 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.379823    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9gdd\" (UniqueName: \"kubernetes.io/projected/19347203-7153-4167-9b2c-f9e4cdea7ee1-kube-api-access-p9gdd\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.379878 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.379872    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/19347203-7153-4167-9b2c-f9e4cdea7ee1-federate-client-tls\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.380216 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.379924    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/19347203-7153-4167-9b2c-f9e4cdea7ee1-telemeter-client-tls\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.380650 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.380624    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19347203-7153-4167-9b2c-f9e4cdea7ee1-serving-certs-ca-bundle\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.380748 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.380708    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19347203-7153-4167-9b2c-f9e4cdea7ee1-metrics-client-ca\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.380858 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.380816    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19347203-7153-4167-9b2c-f9e4cdea7ee1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.382478 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.382450    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/19347203-7153-4167-9b2c-f9e4cdea7ee1-telemeter-client-tls\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.382561 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.382519    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19347203-7153-4167-9b2c-f9e4cdea7ee1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.382601 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.382574    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/19347203-7153-4167-9b2c-f9e4cdea7ee1-federate-client-tls\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.382601 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.382590    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/19347203-7153-4167-9b2c-f9e4cdea7ee1-secret-telemeter-client\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.387839 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.387815    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9gdd\" (UniqueName: \"kubernetes.io/projected/19347203-7153-4167-9b2c-f9e4cdea7ee1-kube-api-access-p9gdd\") pod \"telemeter-client-6d7bccdb7c-5x66w\" (UID: \"19347203-7153-4167-9b2c-f9e4cdea7ee1\") " pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.504339 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.504261    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"
Jul 09 22:15:34.653899 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.653863    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w"]
Jul 09 22:15:34.658554 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:15:34.658525    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19347203_7153_4167_9b2c_f9e4cdea7ee1.slice/crio-b69066a185c1e61467a7aa13d29a779642bfbf3ef32fc484a9fff2dd60ed5b15 WatchSource:0}: Error finding container b69066a185c1e61467a7aa13d29a779642bfbf3ef32fc484a9fff2dd60ed5b15: Status 404 returned error can't find the container with id b69066a185c1e61467a7aa13d29a779642bfbf3ef32fc484a9fff2dd60ed5b15
Jul 09 22:15:34.660826 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:34.660810    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:15:35.453380 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:35.453344    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w" event={"ID":"19347203-7153-4167-9b2c-f9e4cdea7ee1","Type":"ContainerStarted","Data":"b69066a185c1e61467a7aa13d29a779642bfbf3ef32fc484a9fff2dd60ed5b15"}
Jul 09 22:15:37.461939 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:37.461905    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w" event={"ID":"19347203-7153-4167-9b2c-f9e4cdea7ee1","Type":"ContainerStarted","Data":"1486ee101872d1fdc5053ee880c2228b7b8a4f50642e8b33dd46bc3bc02fb800"}
Jul 09 22:15:38.467475 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:38.467437    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w" event={"ID":"19347203-7153-4167-9b2c-f9e4cdea7ee1","Type":"ContainerStarted","Data":"76a74d86f4bd80c2bf3117b152f5eae6bcc28640b7be79243fa96df910efd82d"}
Jul 09 22:15:38.467914 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:38.467489    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w" event={"ID":"19347203-7153-4167-9b2c-f9e4cdea7ee1","Type":"ContainerStarted","Data":"2ce4b04e89a7479222b2f171dd09b2812f8f88ecc474159b77c30bed18918595"}
Jul 09 22:15:38.490578 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:38.490528    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6d7bccdb7c-5x66w" podStartSLOduration=1.493353327 podStartE2EDuration="4.490511578s" totalImagesPullingTime="2.997158251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:15:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:15:38.489270382 +0000 UTC m=+306.568040060" watchObservedRunningTime="2026-07-09 22:15:38.490511578 +0000 UTC m=+306.569281256"
Jul 09 22:15:39.392795 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.392758    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-564cb88589-xw84b"]
Jul 09 22:15:39.528301 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.528268    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-564cb88589-xw84b"]
Jul 09 22:15:39.528687 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.528373    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.631053 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.631015    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-trusted-ca-bundle\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.631258 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.631149    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c38bed8b-b690-435d-ac36-408ed328b5a8-console-serving-cert\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.631258 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.631183    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-oauth-serving-cert\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.631363 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.631333    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c38bed8b-b690-435d-ac36-408ed328b5a8-console-oauth-config\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.631417 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.631399    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-console-config\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.631473 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.631443    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-service-ca\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.631528 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.631509    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjpcc\" (UniqueName: \"kubernetes.io/projected/c38bed8b-b690-435d-ac36-408ed328b5a8-kube-api-access-fjpcc\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.732863 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.732787    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c38bed8b-b690-435d-ac36-408ed328b5a8-console-oauth-config\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.732863 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.732827    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-console-config\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.732863 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.732844    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-service-ca\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.732863 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.732865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjpcc\" (UniqueName: \"kubernetes.io/projected/c38bed8b-b690-435d-ac36-408ed328b5a8-kube-api-access-fjpcc\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.733197 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.732883    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-trusted-ca-bundle\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.733197 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.733057    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c38bed8b-b690-435d-ac36-408ed328b5a8-console-serving-cert\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.733197 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.733125    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-oauth-serving-cert\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.733757 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.733725    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-service-ca\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.733899 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.733732    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-console-config\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.733899 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.733861    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-trusted-ca-bundle\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.734016 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.733938    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-oauth-serving-cert\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.735285 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.735256    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c38bed8b-b690-435d-ac36-408ed328b5a8-console-oauth-config\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.735361 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.735340    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c38bed8b-b690-435d-ac36-408ed328b5a8-console-serving-cert\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.740215 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.740196    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjpcc\" (UniqueName: \"kubernetes.io/projected/c38bed8b-b690-435d-ac36-408ed328b5a8-kube-api-access-fjpcc\") pod \"console-564cb88589-xw84b\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") " pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.837260 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.837218    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:39.990348 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:39.990232    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-564cb88589-xw84b"]
Jul 09 22:15:39.994914 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:15:39.994887    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc38bed8b_b690_435d_ac36_408ed328b5a8.slice/crio-1320d85c4b7ad5ec8df4f7b3673941c7d7dcaf2d3d2b83459e5a282553e6c152 WatchSource:0}: Error finding container 1320d85c4b7ad5ec8df4f7b3673941c7d7dcaf2d3d2b83459e5a282553e6c152: Status 404 returned error can't find the container with id 1320d85c4b7ad5ec8df4f7b3673941c7d7dcaf2d3d2b83459e5a282553e6c152
Jul 09 22:15:40.474989 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:40.474946    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564cb88589-xw84b" event={"ID":"c38bed8b-b690-435d-ac36-408ed328b5a8","Type":"ContainerStarted","Data":"93785c1a3c9b5a9fecf62c1a644ed61ba8c774bc549078005354bf72a16548de"}
Jul 09 22:15:40.474989 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:40.474993    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564cb88589-xw84b" event={"ID":"c38bed8b-b690-435d-ac36-408ed328b5a8","Type":"ContainerStarted","Data":"1320d85c4b7ad5ec8df4f7b3673941c7d7dcaf2d3d2b83459e5a282553e6c152"}
Jul 09 22:15:40.481005 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:40.480985    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:15:40.492384 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:40.492327    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-564cb88589-xw84b" podStartSLOduration=1.492256738 podStartE2EDuration="1.492256738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:15:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:15:40.491889852 +0000 UTC m=+308.570659532" watchObservedRunningTime="2026-07-09 22:15:40.492256738 +0000 UTC m=+308.571026440"
Jul 09 22:15:49.837768 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:49.837719    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:49.838241 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:49.837835    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:49.842630 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:49.842605    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:50.511807 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:50.511776    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:15:50.557041 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:50.557008    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f68cf7595-6gnrr"]
Jul 09 22:15:51.233551 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:15:51.233514    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls" podUID="0d52b353-b838-466b-b181-7fd976e8e357" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 09 22:16:01.232970 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:01.232930    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls" podUID="0d52b353-b838-466b-b181-7fd976e8e357" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 09 22:16:11.233327 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:11.233283    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls" podUID="0d52b353-b838-466b-b181-7fd976e8e357" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 09 22:16:11.233927 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:11.233378    2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls"
Jul 09 22:16:11.234060 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:11.234026    2583 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"e576e7f20aa451cc19556edf6ddaad4f219bf293f13f3f25cbe966997b4fc65f"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 09 22:16:11.234156 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:11.234111    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls" podUID="0d52b353-b838-466b-b181-7fd976e8e357" containerName="service-proxy" containerID="cri-o://e576e7f20aa451cc19556edf6ddaad4f219bf293f13f3f25cbe966997b4fc65f" gracePeriod=30
Jul 09 22:16:11.584833 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:11.584752    2583 generic.go:356] "Generic (PLEG): container finished" podID="0d52b353-b838-466b-b181-7fd976e8e357" containerID="e576e7f20aa451cc19556edf6ddaad4f219bf293f13f3f25cbe966997b4fc65f" exitCode=2
Jul 09 22:16:11.584833 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:11.584795    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls" event={"ID":"0d52b353-b838-466b-b181-7fd976e8e357","Type":"ContainerDied","Data":"e576e7f20aa451cc19556edf6ddaad4f219bf293f13f3f25cbe966997b4fc65f"}
Jul 09 22:16:11.584833 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:11.584829    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66bc997b64-tnhls" event={"ID":"0d52b353-b838-466b-b181-7fd976e8e357","Type":"ContainerStarted","Data":"9db8ff73c2bdf9cc596b7e1cf7843f0c39c104cb23d471be5b6605b27a3c2f0f"}
Jul 09 22:16:15.577851 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.577808    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f68cf7595-6gnrr" podUID="37f5fcff-508f-4e07-b2a6-c155755adf8f" containerName="console" containerID="cri-o://aa7523de647bdbcc22f156e08093c1bcafb993a2580dc6b653d37d2a39249802" gracePeriod=15
Jul 09 22:16:15.815835 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.815811    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:16:15.914205 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.914172    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-oauth-serving-cert\") pod \"37f5fcff-508f-4e07-b2a6-c155755adf8f\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") "
Jul 09 22:16:15.914205 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.914209    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-service-ca\") pod \"37f5fcff-508f-4e07-b2a6-c155755adf8f\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") "
Jul 09 22:16:15.914434 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.914242    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvptj\" (UniqueName: \"kubernetes.io/projected/37f5fcff-508f-4e07-b2a6-c155755adf8f-kube-api-access-kvptj\") pod \"37f5fcff-508f-4e07-b2a6-c155755adf8f\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") "
Jul 09 22:16:15.914434 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.914273    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-trusted-ca-bundle\") pod \"37f5fcff-508f-4e07-b2a6-c155755adf8f\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") "
Jul 09 22:16:15.914541 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.914468    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-config\") pod \"37f5fcff-508f-4e07-b2a6-c155755adf8f\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") "
Jul 09 22:16:15.914541 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.914514    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-serving-cert\") pod \"37f5fcff-508f-4e07-b2a6-c155755adf8f\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") "
Jul 09 22:16:15.914638 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.914541    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-oauth-config\") pod \"37f5fcff-508f-4e07-b2a6-c155755adf8f\" (UID: \"37f5fcff-508f-4e07-b2a6-c155755adf8f\") "
Jul 09 22:16:15.914638 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.914584    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-service-ca" (OuterVolumeSpecName: "service-ca") pod "37f5fcff-508f-4e07-b2a6-c155755adf8f" (UID: "37f5fcff-508f-4e07-b2a6-c155755adf8f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:16:15.914770 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.914734    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "37f5fcff-508f-4e07-b2a6-c155755adf8f" (UID: "37f5fcff-508f-4e07-b2a6-c155755adf8f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:16:15.914770 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.914751    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "37f5fcff-508f-4e07-b2a6-c155755adf8f" (UID: "37f5fcff-508f-4e07-b2a6-c155755adf8f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:16:15.914910 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.914778    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:16:15.914910 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.914815    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-config" (OuterVolumeSpecName: "console-config") pod "37f5fcff-508f-4e07-b2a6-c155755adf8f" (UID: "37f5fcff-508f-4e07-b2a6-c155755adf8f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:16:15.916669 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.916646    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "37f5fcff-508f-4e07-b2a6-c155755adf8f" (UID: "37f5fcff-508f-4e07-b2a6-c155755adf8f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:16:15.916773 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.916666    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37f5fcff-508f-4e07-b2a6-c155755adf8f-kube-api-access-kvptj" (OuterVolumeSpecName: "kube-api-access-kvptj") pod "37f5fcff-508f-4e07-b2a6-c155755adf8f" (UID: "37f5fcff-508f-4e07-b2a6-c155755adf8f"). InnerVolumeSpecName "kube-api-access-kvptj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:16:15.916773 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:15.916675    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "37f5fcff-508f-4e07-b2a6-c155755adf8f" (UID: "37f5fcff-508f-4e07-b2a6-c155755adf8f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:16:16.015916 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:16.015885    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvptj\" (UniqueName: \"kubernetes.io/projected/37f5fcff-508f-4e07-b2a6-c155755adf8f-kube-api-access-kvptj\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:16:16.015916 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:16.015912    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-trusted-ca-bundle\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:16:16.015916 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:16.015921    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-config\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:16:16.015916 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:16.015930    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-serving-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:16:16.016209 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:16.015938    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/37f5fcff-508f-4e07-b2a6-c155755adf8f-console-oauth-config\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:16:16.016209 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:16.015947    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/37f5fcff-508f-4e07-b2a6-c155755adf8f-oauth-serving-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:16:16.602220 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:16.602183    2583 generic.go:356] "Generic (PLEG): container finished" podID="37f5fcff-508f-4e07-b2a6-c155755adf8f" containerID="aa7523de647bdbcc22f156e08093c1bcafb993a2580dc6b653d37d2a39249802" exitCode=0
Jul 09 22:16:16.602644 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:16.602233    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f68cf7595-6gnrr" event={"ID":"37f5fcff-508f-4e07-b2a6-c155755adf8f","Type":"ContainerDied","Data":"aa7523de647bdbcc22f156e08093c1bcafb993a2580dc6b653d37d2a39249802"}
Jul 09 22:16:16.602644 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:16.602249    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f68cf7595-6gnrr"
Jul 09 22:16:16.602644 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:16.602273    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f68cf7595-6gnrr" event={"ID":"37f5fcff-508f-4e07-b2a6-c155755adf8f","Type":"ContainerDied","Data":"e20b20fe8a18531a66aaa075e0b58f47b515510c6fc88d7e4d38593f97108eed"}
Jul 09 22:16:16.602644 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:16.602291    2583 scope.go:117] "RemoveContainer" containerID="aa7523de647bdbcc22f156e08093c1bcafb993a2580dc6b653d37d2a39249802"
Jul 09 22:16:16.610456 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:16.610438    2583 scope.go:117] "RemoveContainer" containerID="aa7523de647bdbcc22f156e08093c1bcafb993a2580dc6b653d37d2a39249802"
Jul 09 22:16:16.610725 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:16:16.610704    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa7523de647bdbcc22f156e08093c1bcafb993a2580dc6b653d37d2a39249802\": container with ID starting with aa7523de647bdbcc22f156e08093c1bcafb993a2580dc6b653d37d2a39249802 not found: ID does not exist" containerID="aa7523de647bdbcc22f156e08093c1bcafb993a2580dc6b653d37d2a39249802"
Jul 09 22:16:16.610771 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:16.610733    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa7523de647bdbcc22f156e08093c1bcafb993a2580dc6b653d37d2a39249802"} err="failed to get container status \"aa7523de647bdbcc22f156e08093c1bcafb993a2580dc6b653d37d2a39249802\": rpc error: code = NotFound desc = could not find container \"aa7523de647bdbcc22f156e08093c1bcafb993a2580dc6b653d37d2a39249802\": container with ID starting with aa7523de647bdbcc22f156e08093c1bcafb993a2580dc6b653d37d2a39249802 not found: ID does not exist"
Jul 09 22:16:16.617945 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:16.617918    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f68cf7595-6gnrr"]
Jul 09 22:16:16.621648 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:16.621625    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f68cf7595-6gnrr"]
Jul 09 22:16:18.485269 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:18.485242    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37f5fcff-508f-4e07-b2a6-c155755adf8f" path="/var/lib/kubelet/pods/37f5fcff-508f-4e07-b2a6-c155755adf8f/volumes"
Jul 09 22:16:46.246433 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:46.246375    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs\") pod \"network-metrics-daemon-f7pqt\" (UID: \"6fd3da1e-960c-4bee-99b1-a621408855fe\") " pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:16:46.248653 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:46.248633    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6fd3da1e-960c-4bee-99b1-a621408855fe-metrics-certs\") pod \"network-metrics-daemon-f7pqt\" (UID: \"6fd3da1e-960c-4bee-99b1-a621408855fe\") " pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:16:46.484602 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:46.484571    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jtrvn\""
Jul 09 22:16:46.492667 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:46.492647    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f7pqt"
Jul 09 22:16:46.623747 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:46.623714    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f7pqt"]
Jul 09 22:16:46.626935 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:16:46.626899    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd3da1e_960c_4bee_99b1_a621408855fe.slice/crio-780a995bdbc24a87a458b07ca6eca24e56813688bc832590a5ddd8728793307c WatchSource:0}: Error finding container 780a995bdbc24a87a458b07ca6eca24e56813688bc832590a5ddd8728793307c: Status 404 returned error can't find the container with id 780a995bdbc24a87a458b07ca6eca24e56813688bc832590a5ddd8728793307c
Jul 09 22:16:46.706502 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:46.706466    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f7pqt" event={"ID":"6fd3da1e-960c-4bee-99b1-a621408855fe","Type":"ContainerStarted","Data":"780a995bdbc24a87a458b07ca6eca24e56813688bc832590a5ddd8728793307c"}
Jul 09 22:16:47.711282 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:47.711250    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f7pqt" event={"ID":"6fd3da1e-960c-4bee-99b1-a621408855fe","Type":"ContainerStarted","Data":"f14134422f737cacadbb9d6831ecbea3c348e51736b8c6f7f6e28aad2764a55d"}
Jul 09 22:16:47.711687 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:47.711306    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f7pqt" event={"ID":"6fd3da1e-960c-4bee-99b1-a621408855fe","Type":"ContainerStarted","Data":"31a1e73bbdc729c181b66337a2a8e3283c7c65e8ff31c4eff233222026a1e64a"}
Jul 09 22:16:47.729660 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:47.729608    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f7pqt" podStartSLOduration=374.838925225 podStartE2EDuration="6m15.729592711s" totalImagesPullingTime="890.667486ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:10:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:16:47.72830793 +0000 UTC m=+375.807077609" watchObservedRunningTime="2026-07-09 22:16:47.729592711 +0000 UTC m=+375.808362387"
Jul 09 22:16:56.683010 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:16:56.682971    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-564cb88589-xw84b"]
Jul 09 22:17:21.702546 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:21.702506    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-564cb88589-xw84b" podUID="c38bed8b-b690-435d-ac36-408ed328b5a8" containerName="console" containerID="cri-o://93785c1a3c9b5a9fecf62c1a644ed61ba8c774bc549078005354bf72a16548de" gracePeriod=15
Jul 09 22:17:21.829417 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:21.829386    2583 generic.go:356] "Generic (PLEG): container finished" podID="c38bed8b-b690-435d-ac36-408ed328b5a8" containerID="93785c1a3c9b5a9fecf62c1a644ed61ba8c774bc549078005354bf72a16548de" exitCode=0
Jul 09 22:17:21.829564 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:21.829437    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564cb88589-xw84b" event={"ID":"c38bed8b-b690-435d-ac36-408ed328b5a8","Type":"ContainerDied","Data":"93785c1a3c9b5a9fecf62c1a644ed61ba8c774bc549078005354bf72a16548de"}
Jul 09 22:17:21.943836 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:21.943807    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:17:22.025115 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.024996    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-trusted-ca-bundle\") pod \"c38bed8b-b690-435d-ac36-408ed328b5a8\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") "
Jul 09 22:17:22.025115 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.025040    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c38bed8b-b690-435d-ac36-408ed328b5a8-console-oauth-config\") pod \"c38bed8b-b690-435d-ac36-408ed328b5a8\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") "
Jul 09 22:17:22.025115 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.025058    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c38bed8b-b690-435d-ac36-408ed328b5a8-console-serving-cert\") pod \"c38bed8b-b690-435d-ac36-408ed328b5a8\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") "
Jul 09 22:17:22.025115 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.025101    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjpcc\" (UniqueName: \"kubernetes.io/projected/c38bed8b-b690-435d-ac36-408ed328b5a8-kube-api-access-fjpcc\") pod \"c38bed8b-b690-435d-ac36-408ed328b5a8\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") "
Jul 09 22:17:22.025441 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.025130    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-oauth-serving-cert\") pod \"c38bed8b-b690-435d-ac36-408ed328b5a8\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") "
Jul 09 22:17:22.025441 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.025167    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-console-config\") pod \"c38bed8b-b690-435d-ac36-408ed328b5a8\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") "
Jul 09 22:17:22.025441 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.025218    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-service-ca\") pod \"c38bed8b-b690-435d-ac36-408ed328b5a8\" (UID: \"c38bed8b-b690-435d-ac36-408ed328b5a8\") "
Jul 09 22:17:22.025640 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.025608    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c38bed8b-b690-435d-ac36-408ed328b5a8" (UID: "c38bed8b-b690-435d-ac36-408ed328b5a8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:17:22.025715 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.025641    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c38bed8b-b690-435d-ac36-408ed328b5a8" (UID: "c38bed8b-b690-435d-ac36-408ed328b5a8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:17:22.025715 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.025681    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-console-config" (OuterVolumeSpecName: "console-config") pod "c38bed8b-b690-435d-ac36-408ed328b5a8" (UID: "c38bed8b-b690-435d-ac36-408ed328b5a8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:17:22.025793 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.025716    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-service-ca" (OuterVolumeSpecName: "service-ca") pod "c38bed8b-b690-435d-ac36-408ed328b5a8" (UID: "c38bed8b-b690-435d-ac36-408ed328b5a8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:17:22.027366 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.027344    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c38bed8b-b690-435d-ac36-408ed328b5a8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c38bed8b-b690-435d-ac36-408ed328b5a8" (UID: "c38bed8b-b690-435d-ac36-408ed328b5a8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:17:22.027366 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.027349    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c38bed8b-b690-435d-ac36-408ed328b5a8-kube-api-access-fjpcc" (OuterVolumeSpecName: "kube-api-access-fjpcc") pod "c38bed8b-b690-435d-ac36-408ed328b5a8" (UID: "c38bed8b-b690-435d-ac36-408ed328b5a8"). InnerVolumeSpecName "kube-api-access-fjpcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:17:22.027509 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.027383    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c38bed8b-b690-435d-ac36-408ed328b5a8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c38bed8b-b690-435d-ac36-408ed328b5a8" (UID: "c38bed8b-b690-435d-ac36-408ed328b5a8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:17:22.125988 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.125955    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-console-config\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:17:22.125988 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.125982    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:17:22.125988 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.125991    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-trusted-ca-bundle\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:17:22.125988 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.126000    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c38bed8b-b690-435d-ac36-408ed328b5a8-console-oauth-config\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:17:22.126279 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.126010    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c38bed8b-b690-435d-ac36-408ed328b5a8-console-serving-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:17:22.126279 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.126019    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjpcc\" (UniqueName: \"kubernetes.io/projected/c38bed8b-b690-435d-ac36-408ed328b5a8-kube-api-access-fjpcc\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:17:22.126279 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.126027    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c38bed8b-b690-435d-ac36-408ed328b5a8-oauth-serving-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:17:22.834046 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.833954    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564cb88589-xw84b" event={"ID":"c38bed8b-b690-435d-ac36-408ed328b5a8","Type":"ContainerDied","Data":"1320d85c4b7ad5ec8df4f7b3673941c7d7dcaf2d3d2b83459e5a282553e6c152"}
Jul 09 22:17:22.834046 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.834014    2583 scope.go:117] "RemoveContainer" containerID="93785c1a3c9b5a9fecf62c1a644ed61ba8c774bc549078005354bf72a16548de"
Jul 09 22:17:22.834582 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.833969    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564cb88589-xw84b"
Jul 09 22:17:22.850565 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.850540    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-564cb88589-xw84b"]
Jul 09 22:17:22.854477 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:22.854452    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-564cb88589-xw84b"]
Jul 09 22:17:24.484366 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:17:24.484332    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c38bed8b-b690-435d-ac36-408ed328b5a8" path="/var/lib/kubelet/pods/c38bed8b-b690-435d-ac36-408ed328b5a8/volumes"
Jul 09 22:18:46.116180 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.116148    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd"]
Jul 09 22:18:46.116651 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.116377    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c38bed8b-b690-435d-ac36-408ed328b5a8" containerName="console"
Jul 09 22:18:46.116651 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.116387    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c38bed8b-b690-435d-ac36-408ed328b5a8" containerName="console"
Jul 09 22:18:46.116651 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.116396    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37f5fcff-508f-4e07-b2a6-c155755adf8f" containerName="console"
Jul 09 22:18:46.116651 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.116401    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="37f5fcff-508f-4e07-b2a6-c155755adf8f" containerName="console"
Jul 09 22:18:46.116651 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.116436    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="37f5fcff-508f-4e07-b2a6-c155755adf8f" containerName="console"
Jul 09 22:18:46.116651 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.116445    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c38bed8b-b690-435d-ac36-408ed328b5a8" containerName="console"
Jul 09 22:18:46.119363 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.119348    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd"
Jul 09 22:18:46.121785 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.121764    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 22:18:46.121902 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.121768    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 22:18:46.122294 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.122279    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ccxq4\""
Jul 09 22:18:46.130745 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.130725    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd"]
Jul 09 22:18:46.238407 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.238372    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd\" (UID: \"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd"
Jul 09 22:18:46.238608 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.238439    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd\" (UID: \"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd"
Jul 09 22:18:46.238608 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.238467    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5fhr\" (UniqueName: \"kubernetes.io/projected/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-kube-api-access-s5fhr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd\" (UID: \"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd"
Jul 09 22:18:46.339163 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.339123    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd\" (UID: \"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd"
Jul 09 22:18:46.339163 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.339163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5fhr\" (UniqueName: \"kubernetes.io/projected/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-kube-api-access-s5fhr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd\" (UID: \"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd"
Jul 09 22:18:46.339425 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.339217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd\" (UID: \"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd"
Jul 09 22:18:46.339546 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.339524    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd\" (UID: \"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd"
Jul 09 22:18:46.339610 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.339542    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd\" (UID: \"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd"
Jul 09 22:18:46.349374 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.349345    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5fhr\" (UniqueName: \"kubernetes.io/projected/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-kube-api-access-s5fhr\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd\" (UID: \"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd"
Jul 09 22:18:46.428099 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.428060    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd"
Jul 09 22:18:46.557257 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:46.557221    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd"]
Jul 09 22:18:46.560640 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:18:46.560617    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod924ec7d5_5eb5_4b7f_9ce5_88c14e3f32b5.slice/crio-37e5c6b47366058751753a6f59be930260166df742a0c921a70a24440936bcda WatchSource:0}: Error finding container 37e5c6b47366058751753a6f59be930260166df742a0c921a70a24440936bcda: Status 404 returned error can't find the container with id 37e5c6b47366058751753a6f59be930260166df742a0c921a70a24440936bcda
Jul 09 22:18:47.109101 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:47.109063    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd" event={"ID":"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5","Type":"ContainerStarted","Data":"37e5c6b47366058751753a6f59be930260166df742a0c921a70a24440936bcda"}
Jul 09 22:18:54.139135 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:54.139017    2583 generic.go:356] "Generic (PLEG): container finished" podID="924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5" containerID="70807c9da13cc659fc47869d600afb4d3fe0eaf0ecaddf766130a89464c261dc" exitCode=0
Jul 09 22:18:54.139135 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:54.139113    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd" event={"ID":"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5","Type":"ContainerDied","Data":"70807c9da13cc659fc47869d600afb4d3fe0eaf0ecaddf766130a89464c261dc"}
Jul 09 22:18:57.151843 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:57.151811    2583 generic.go:356] "Generic (PLEG): container finished" podID="924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5" containerID="94100c8ec33d536c9d80520a4105dbd8de514cab52971338b367f41d8c330a3b" exitCode=0
Jul 09 22:18:57.152249 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:18:57.151878    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd" event={"ID":"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5","Type":"ContainerDied","Data":"94100c8ec33d536c9d80520a4105dbd8de514cab52971338b367f41d8c330a3b"}
Jul 09 22:19:05.186899 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:05.186867    2583 generic.go:356] "Generic (PLEG): container finished" podID="924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5" containerID="49145d3c93af15599f9b96d45dfed82fa8628d0d6377e8c899b373acbf91178a" exitCode=0
Jul 09 22:19:05.187300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:05.186925    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd" event={"ID":"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5","Type":"ContainerDied","Data":"49145d3c93af15599f9b96d45dfed82fa8628d0d6377e8c899b373acbf91178a"}
Jul 09 22:19:06.313442 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:06.313412    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd"
Jul 09 22:19:06.391172 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:06.391140    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5fhr\" (UniqueName: \"kubernetes.io/projected/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-kube-api-access-s5fhr\") pod \"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5\" (UID: \"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5\") "
Jul 09 22:19:06.391375 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:06.391202    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-util\") pod \"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5\" (UID: \"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5\") "
Jul 09 22:19:06.391375 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:06.391223    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-bundle\") pod \"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5\" (UID: \"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5\") "
Jul 09 22:19:06.391851 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:06.391830    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-bundle" (OuterVolumeSpecName: "bundle") pod "924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5" (UID: "924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:19:06.393401 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:06.393376    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-kube-api-access-s5fhr" (OuterVolumeSpecName: "kube-api-access-s5fhr") pod "924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5" (UID: "924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5"). InnerVolumeSpecName "kube-api-access-s5fhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:19:06.395278 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:06.395256    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-util" (OuterVolumeSpecName: "util") pod "924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5" (UID: "924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:19:06.491847 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:06.491824    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5fhr\" (UniqueName: \"kubernetes.io/projected/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-kube-api-access-s5fhr\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:19:06.491847 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:06.491846    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-util\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:19:06.491979 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:06.491855    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5-bundle\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:19:07.195781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:07.195741    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd" event={"ID":"924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5","Type":"ContainerDied","Data":"37e5c6b47366058751753a6f59be930260166df742a0c921a70a24440936bcda"}
Jul 09 22:19:07.195957 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:07.195793    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37e5c6b47366058751753a6f59be930260166df742a0c921a70a24440936bcda"
Jul 09 22:19:07.195957 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:07.195761    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xqbnd"
Jul 09 22:19:14.119618 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.119579    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z9v56"]
Jul 09 22:19:14.120143 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.119907    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5" containerName="util"
Jul 09 22:19:14.120143 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.119926    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5" containerName="util"
Jul 09 22:19:14.120143 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.119940    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5" containerName="pull"
Jul 09 22:19:14.120143 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.119948    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5" containerName="pull"
Jul 09 22:19:14.120143 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.119969    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5" containerName="extract"
Jul 09 22:19:14.120143 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.119978    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5" containerName="extract"
Jul 09 22:19:14.120143 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.120032    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="924ec7d5-5eb5-4b7f-9ce5-88c14e3f32b5" containerName="extract"
Jul 09 22:19:14.123780 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.123757    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z9v56"
Jul 09 22:19:14.128521 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.128497    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:19:14.128659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.128534    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-gl9js\""
Jul 09 22:19:14.128733 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.128658    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 09 22:19:14.142519 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.142488    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z9v56"]
Jul 09 22:19:14.153606 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.153571    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbwj5\" (UniqueName: \"kubernetes.io/projected/c2ed5951-7df8-468c-98bf-ffc6f59d7338-kube-api-access-nbwj5\") pod \"cert-manager-operator-controller-manager-55c444bf86-z9v56\" (UID: \"c2ed5951-7df8-468c-98bf-ffc6f59d7338\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z9v56"
Jul 09 22:19:14.153772 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.153614    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2ed5951-7df8-468c-98bf-ffc6f59d7338-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z9v56\" (UID: \"c2ed5951-7df8-468c-98bf-ffc6f59d7338\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z9v56"
Jul 09 22:19:14.254078 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.254040    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbwj5\" (UniqueName: \"kubernetes.io/projected/c2ed5951-7df8-468c-98bf-ffc6f59d7338-kube-api-access-nbwj5\") pod \"cert-manager-operator-controller-manager-55c444bf86-z9v56\" (UID: \"c2ed5951-7df8-468c-98bf-ffc6f59d7338\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z9v56"
Jul 09 22:19:14.254078 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.254104    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2ed5951-7df8-468c-98bf-ffc6f59d7338-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z9v56\" (UID: \"c2ed5951-7df8-468c-98bf-ffc6f59d7338\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z9v56"
Jul 09 22:19:14.254454 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.254438    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c2ed5951-7df8-468c-98bf-ffc6f59d7338-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-z9v56\" (UID: \"c2ed5951-7df8-468c-98bf-ffc6f59d7338\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z9v56"
Jul 09 22:19:14.269680 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.269658    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbwj5\" (UniqueName: \"kubernetes.io/projected/c2ed5951-7df8-468c-98bf-ffc6f59d7338-kube-api-access-nbwj5\") pod \"cert-manager-operator-controller-manager-55c444bf86-z9v56\" (UID: \"c2ed5951-7df8-468c-98bf-ffc6f59d7338\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z9v56"
Jul 09 22:19:14.432883 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.432831    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z9v56"
Jul 09 22:19:14.574804 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:14.574762    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z9v56"]
Jul 09 22:19:14.581554 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:19:14.581510    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ed5951_7df8_468c_98bf_ffc6f59d7338.slice/crio-9c261a13f4931b9db619d88e11925e6fff3160de5d29e5fe62737d07e6d1b84e WatchSource:0}: Error finding container 9c261a13f4931b9db619d88e11925e6fff3160de5d29e5fe62737d07e6d1b84e: Status 404 returned error can't find the container with id 9c261a13f4931b9db619d88e11925e6fff3160de5d29e5fe62737d07e6d1b84e
Jul 09 22:19:15.224631 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:15.224592    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z9v56" event={"ID":"c2ed5951-7df8-468c-98bf-ffc6f59d7338","Type":"ContainerStarted","Data":"9c261a13f4931b9db619d88e11925e6fff3160de5d29e5fe62737d07e6d1b84e"}
Jul 09 22:19:17.234008 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:17.233966    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z9v56" event={"ID":"c2ed5951-7df8-468c-98bf-ffc6f59d7338","Type":"ContainerStarted","Data":"5c27e0bd9873f158050d4e48db052496420e929db2d51d2b1cc18ca8868f1640"}
Jul 09 22:19:17.257630 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:17.257566    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-z9v56" podStartSLOduration=1.539024784 podStartE2EDuration="3.257545164s" totalImagesPullingTime="1.71852038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:19:17.255910729 +0000 UTC m=+525.334680408" watchObservedRunningTime="2026-07-09 22:19:17.257545164 +0000 UTC m=+525.336314844"
Jul 09 22:19:17.509291 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:17.509205    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6wnjr"]
Jul 09 22:19:17.511499 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:17.511472    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6wnjr"
Jul 09 22:19:17.513526 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:17.513496    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 22:19:17.513658 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:17.513586    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-8hctg\""
Jul 09 22:19:17.513658 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:17.513599    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 22:19:17.521134 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:17.521108    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6wnjr"]
Jul 09 22:19:17.584082 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:17.584038    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff1314b4-8391-4bee-924b-22b601a7b873-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6wnjr\" (UID: \"ff1314b4-8391-4bee-924b-22b601a7b873\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6wnjr"
Jul 09 22:19:17.584297 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:17.584121    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh7fv\" (UniqueName: \"kubernetes.io/projected/ff1314b4-8391-4bee-924b-22b601a7b873-kube-api-access-gh7fv\") pod \"cert-manager-webhook-6486ffd997-6wnjr\" (UID: \"ff1314b4-8391-4bee-924b-22b601a7b873\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6wnjr"
Jul 09 22:19:17.685533 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:17.685496    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff1314b4-8391-4bee-924b-22b601a7b873-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6wnjr\" (UID: \"ff1314b4-8391-4bee-924b-22b601a7b873\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6wnjr"
Jul 09 22:19:17.685533 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:17.685535    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh7fv\" (UniqueName: \"kubernetes.io/projected/ff1314b4-8391-4bee-924b-22b601a7b873-kube-api-access-gh7fv\") pod \"cert-manager-webhook-6486ffd997-6wnjr\" (UID: \"ff1314b4-8391-4bee-924b-22b601a7b873\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6wnjr"
Jul 09 22:19:17.709018 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:17.708979    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff1314b4-8391-4bee-924b-22b601a7b873-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6wnjr\" (UID: \"ff1314b4-8391-4bee-924b-22b601a7b873\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6wnjr"
Jul 09 22:19:17.709184 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:17.709041    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh7fv\" (UniqueName: \"kubernetes.io/projected/ff1314b4-8391-4bee-924b-22b601a7b873-kube-api-access-gh7fv\") pod \"cert-manager-webhook-6486ffd997-6wnjr\" (UID: \"ff1314b4-8391-4bee-924b-22b601a7b873\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6wnjr"
Jul 09 22:19:17.820568 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:17.820475    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6wnjr"
Jul 09 22:19:17.958010 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:17.957971    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6wnjr"]
Jul 09 22:19:17.962072 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:19:17.962045    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff1314b4_8391_4bee_924b_22b601a7b873.slice/crio-ae3d209029ffa3e27420dcc60f0279f5223ca7045b7f2b485413f6c832396659 WatchSource:0}: Error finding container ae3d209029ffa3e27420dcc60f0279f5223ca7045b7f2b485413f6c832396659: Status 404 returned error can't find the container with id ae3d209029ffa3e27420dcc60f0279f5223ca7045b7f2b485413f6c832396659
Jul 09 22:19:18.238578 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.238537    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6wnjr" event={"ID":"ff1314b4-8391-4bee-924b-22b601a7b873","Type":"ContainerStarted","Data":"ae3d209029ffa3e27420dcc60f0279f5223ca7045b7f2b485413f6c832396659"}
Jul 09 22:19:18.240579 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.240554    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg"]
Jul 09 22:19:18.243175 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.243155    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg"
Jul 09 22:19:18.245353 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.245332    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 22:19:18.245927 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.245910    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 22:19:18.246046 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.246029    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ccxq4\""
Jul 09 22:19:18.258102 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.258062    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg"]
Jul 09 22:19:18.290285 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.290244    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2hw5\" (UniqueName: \"kubernetes.io/projected/614a5f84-d6ca-45b4-8f39-15a18fb3d979-kube-api-access-h2hw5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg\" (UID: \"614a5f84-d6ca-45b4-8f39-15a18fb3d979\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg"
Jul 09 22:19:18.290468 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.290308    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/614a5f84-d6ca-45b4-8f39-15a18fb3d979-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg\" (UID: \"614a5f84-d6ca-45b4-8f39-15a18fb3d979\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg"
Jul 09 22:19:18.290468 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.290360    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/614a5f84-d6ca-45b4-8f39-15a18fb3d979-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg\" (UID: \"614a5f84-d6ca-45b4-8f39-15a18fb3d979\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg"
Jul 09 22:19:18.391225 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.391188    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/614a5f84-d6ca-45b4-8f39-15a18fb3d979-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg\" (UID: \"614a5f84-d6ca-45b4-8f39-15a18fb3d979\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg"
Jul 09 22:19:18.391225 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.391232    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/614a5f84-d6ca-45b4-8f39-15a18fb3d979-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg\" (UID: \"614a5f84-d6ca-45b4-8f39-15a18fb3d979\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg"
Jul 09 22:19:18.391510 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.391294    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2hw5\" (UniqueName: \"kubernetes.io/projected/614a5f84-d6ca-45b4-8f39-15a18fb3d979-kube-api-access-h2hw5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg\" (UID: \"614a5f84-d6ca-45b4-8f39-15a18fb3d979\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg"
Jul 09 22:19:18.391659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.391638    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/614a5f84-d6ca-45b4-8f39-15a18fb3d979-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg\" (UID: \"614a5f84-d6ca-45b4-8f39-15a18fb3d979\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg"
Jul 09 22:19:18.391717 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.391656    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/614a5f84-d6ca-45b4-8f39-15a18fb3d979-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg\" (UID: \"614a5f84-d6ca-45b4-8f39-15a18fb3d979\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg"
Jul 09 22:19:18.400480 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.400441    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2hw5\" (UniqueName: \"kubernetes.io/projected/614a5f84-d6ca-45b4-8f39-15a18fb3d979-kube-api-access-h2hw5\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg\" (UID: \"614a5f84-d6ca-45b4-8f39-15a18fb3d979\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg"
Jul 09 22:19:18.552657 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.552556    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg"
Jul 09 22:19:18.701579 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:18.701544    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg"]
Jul 09 22:19:18.708738 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:19:18.708709    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod614a5f84_d6ca_45b4_8f39_15a18fb3d979.slice/crio-1018457a3b6cea235e2a4668a06bbe9a2f15aa4c1f4df0c30503dc0c6d40f1a7 WatchSource:0}: Error finding container 1018457a3b6cea235e2a4668a06bbe9a2f15aa4c1f4df0c30503dc0c6d40f1a7: Status 404 returned error can't find the container with id 1018457a3b6cea235e2a4668a06bbe9a2f15aa4c1f4df0c30503dc0c6d40f1a7
Jul 09 22:19:19.245801 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:19.245764    2583 generic.go:356] "Generic (PLEG): container finished" podID="614a5f84-d6ca-45b4-8f39-15a18fb3d979" containerID="1fce2c295cd3bc943d86d28665b2057010fbb992d620b72b2555ca0d92dcb425" exitCode=0
Jul 09 22:19:19.246273 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:19.245853    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg" event={"ID":"614a5f84-d6ca-45b4-8f39-15a18fb3d979","Type":"ContainerDied","Data":"1fce2c295cd3bc943d86d28665b2057010fbb992d620b72b2555ca0d92dcb425"}
Jul 09 22:19:19.246273 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:19.245908    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg" event={"ID":"614a5f84-d6ca-45b4-8f39-15a18fb3d979","Type":"ContainerStarted","Data":"1018457a3b6cea235e2a4668a06bbe9a2f15aa4c1f4df0c30503dc0c6d40f1a7"}
Jul 09 22:19:21.260563 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:21.260523    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6wnjr" event={"ID":"ff1314b4-8391-4bee-924b-22b601a7b873","Type":"ContainerStarted","Data":"4b1a02fd471faef784fe857422279f3e8e4c6d8b83630b88794c396bd9658888"}
Jul 09 22:19:21.261035 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:21.260660    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6wnjr"
Jul 09 22:19:21.277597 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:21.277551    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-6wnjr" podStartSLOduration=1.709796856 podStartE2EDuration="4.277535549s" totalImagesPullingTime="2.567738693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:19:21.276663562 +0000 UTC m=+529.355433266" watchObservedRunningTime="2026-07-09 22:19:21.277535549 +0000 UTC m=+529.356305228"
Jul 09 22:19:22.266484 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:22.266403    2583 generic.go:356] "Generic (PLEG): container finished" podID="614a5f84-d6ca-45b4-8f39-15a18fb3d979" containerID="708c23ed0d3076879399c8b5cb88f85663520c346c6647b0296f55c924048360" exitCode=0
Jul 09 22:19:22.266832 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:22.266491    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg" event={"ID":"614a5f84-d6ca-45b4-8f39-15a18fb3d979","Type":"ContainerDied","Data":"708c23ed0d3076879399c8b5cb88f85663520c346c6647b0296f55c924048360"}
Jul 09 22:19:23.272425 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:23.272389    2583 generic.go:356] "Generic (PLEG): container finished" podID="614a5f84-d6ca-45b4-8f39-15a18fb3d979" containerID="a8a2e04daf39841f59d46b9c0afa3ac805773bd5650b46afc2845c12b0c069fc" exitCode=0
Jul 09 22:19:23.272802 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:23.272444    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg" event={"ID":"614a5f84-d6ca-45b4-8f39-15a18fb3d979","Type":"ContainerDied","Data":"a8a2e04daf39841f59d46b9c0afa3ac805773bd5650b46afc2845c12b0c069fc"}
Jul 09 22:19:24.393770 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:24.393742    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg"
Jul 09 22:19:24.543315 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:24.543217    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/614a5f84-d6ca-45b4-8f39-15a18fb3d979-util\") pod \"614a5f84-d6ca-45b4-8f39-15a18fb3d979\" (UID: \"614a5f84-d6ca-45b4-8f39-15a18fb3d979\") "
Jul 09 22:19:24.543315 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:24.543260    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/614a5f84-d6ca-45b4-8f39-15a18fb3d979-bundle\") pod \"614a5f84-d6ca-45b4-8f39-15a18fb3d979\" (UID: \"614a5f84-d6ca-45b4-8f39-15a18fb3d979\") "
Jul 09 22:19:24.543315 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:24.543296    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2hw5\" (UniqueName: \"kubernetes.io/projected/614a5f84-d6ca-45b4-8f39-15a18fb3d979-kube-api-access-h2hw5\") pod \"614a5f84-d6ca-45b4-8f39-15a18fb3d979\" (UID: \"614a5f84-d6ca-45b4-8f39-15a18fb3d979\") "
Jul 09 22:19:24.543658 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:24.543633    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/614a5f84-d6ca-45b4-8f39-15a18fb3d979-bundle" (OuterVolumeSpecName: "bundle") pod "614a5f84-d6ca-45b4-8f39-15a18fb3d979" (UID: "614a5f84-d6ca-45b4-8f39-15a18fb3d979"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:19:24.545379 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:24.545347    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/614a5f84-d6ca-45b4-8f39-15a18fb3d979-kube-api-access-h2hw5" (OuterVolumeSpecName: "kube-api-access-h2hw5") pod "614a5f84-d6ca-45b4-8f39-15a18fb3d979" (UID: "614a5f84-d6ca-45b4-8f39-15a18fb3d979"). InnerVolumeSpecName "kube-api-access-h2hw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:19:24.549449 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:24.549406    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/614a5f84-d6ca-45b4-8f39-15a18fb3d979-util" (OuterVolumeSpecName: "util") pod "614a5f84-d6ca-45b4-8f39-15a18fb3d979" (UID: "614a5f84-d6ca-45b4-8f39-15a18fb3d979"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:19:24.643875 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:24.643836    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/614a5f84-d6ca-45b4-8f39-15a18fb3d979-util\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:19:24.643875 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:24.643866    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/614a5f84-d6ca-45b4-8f39-15a18fb3d979-bundle\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:19:24.643875 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:24.643876    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2hw5\" (UniqueName: \"kubernetes.io/projected/614a5f84-d6ca-45b4-8f39-15a18fb3d979-kube-api-access-h2hw5\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:19:25.282254 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:25.282218    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg" event={"ID":"614a5f84-d6ca-45b4-8f39-15a18fb3d979","Type":"ContainerDied","Data":"1018457a3b6cea235e2a4668a06bbe9a2f15aa4c1f4df0c30503dc0c6d40f1a7"}
Jul 09 22:19:25.282254 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:25.282264    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1018457a3b6cea235e2a4668a06bbe9a2f15aa4c1f4df0c30503dc0c6d40f1a7"
Jul 09 22:19:25.282796 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:25.282266    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fsqlcg"
Jul 09 22:19:27.269514 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:27.269484    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6wnjr"
Jul 09 22:19:37.314704 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.314665    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4"]
Jul 09 22:19:37.315110 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.314930    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="614a5f84-d6ca-45b4-8f39-15a18fb3d979" containerName="extract"
Jul 09 22:19:37.315110 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.314942    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="614a5f84-d6ca-45b4-8f39-15a18fb3d979" containerName="extract"
Jul 09 22:19:37.315110 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.314954    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="614a5f84-d6ca-45b4-8f39-15a18fb3d979" containerName="pull"
Jul 09 22:19:37.315110 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.314959    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="614a5f84-d6ca-45b4-8f39-15a18fb3d979" containerName="pull"
Jul 09 22:19:37.315110 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.314969    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="614a5f84-d6ca-45b4-8f39-15a18fb3d979" containerName="util"
Jul 09 22:19:37.315110 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.314975    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="614a5f84-d6ca-45b4-8f39-15a18fb3d979" containerName="util"
Jul 09 22:19:37.315110 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.315024    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="614a5f84-d6ca-45b4-8f39-15a18fb3d979" containerName="extract"
Jul 09 22:19:37.361001 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.360955    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4"]
Jul 09 22:19:37.361203 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.361007    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4"
Jul 09 22:19:37.363808 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.363786    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 22:19:37.363950 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.363813    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ccxq4\""
Jul 09 22:19:37.374993 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.374965    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 22:19:37.443888 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.443845    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qg92\" (UniqueName: \"kubernetes.io/projected/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-kube-api-access-4qg92\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4\" (UID: \"d9dc673b-ad13-48ca-afb0-a7da9c4acab7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4"
Jul 09 22:19:37.443888 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.443893    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4\" (UID: \"d9dc673b-ad13-48ca-afb0-a7da9c4acab7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4"
Jul 09 22:19:37.444146 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.443954    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4\" (UID: \"d9dc673b-ad13-48ca-afb0-a7da9c4acab7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4"
Jul 09 22:19:37.544650 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.544610    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4\" (UID: \"d9dc673b-ad13-48ca-afb0-a7da9c4acab7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4"
Jul 09 22:19:37.544823 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.544671    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4\" (UID: \"d9dc673b-ad13-48ca-afb0-a7da9c4acab7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4"
Jul 09 22:19:37.544823 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.544719    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qg92\" (UniqueName: \"kubernetes.io/projected/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-kube-api-access-4qg92\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4\" (UID: \"d9dc673b-ad13-48ca-afb0-a7da9c4acab7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4"
Jul 09 22:19:37.544997 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.544977    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4\" (UID: \"d9dc673b-ad13-48ca-afb0-a7da9c4acab7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4"
Jul 09 22:19:37.545038 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.545010    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4\" (UID: \"d9dc673b-ad13-48ca-afb0-a7da9c4acab7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4"
Jul 09 22:19:37.553394 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.553373    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qg92\" (UniqueName: \"kubernetes.io/projected/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-kube-api-access-4qg92\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4\" (UID: \"d9dc673b-ad13-48ca-afb0-a7da9c4acab7\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4"
Jul 09 22:19:37.669865 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.669832    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4"
Jul 09 22:19:37.815335 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:37.815299    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4"]
Jul 09 22:19:37.818876 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:19:37.818848    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9dc673b_ad13_48ca_afb0_a7da9c4acab7.slice/crio-09364d5ef15a21e26bec6561bc2ec1927ec0bf6be033c81f8d9a13f8f72a2299 WatchSource:0}: Error finding container 09364d5ef15a21e26bec6561bc2ec1927ec0bf6be033c81f8d9a13f8f72a2299: Status 404 returned error can't find the container with id 09364d5ef15a21e26bec6561bc2ec1927ec0bf6be033c81f8d9a13f8f72a2299
Jul 09 22:19:38.336600 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:38.336509    2583 generic.go:356] "Generic (PLEG): container finished" podID="d9dc673b-ad13-48ca-afb0-a7da9c4acab7" containerID="9e5edb7a02e984e2175887206947f4bfd53bc8ca9a1c162f61fee39f72a7a536" exitCode=0
Jul 09 22:19:38.336967 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:38.336596    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4" event={"ID":"d9dc673b-ad13-48ca-afb0-a7da9c4acab7","Type":"ContainerDied","Data":"9e5edb7a02e984e2175887206947f4bfd53bc8ca9a1c162f61fee39f72a7a536"}
Jul 09 22:19:38.336967 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:38.336647    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4" event={"ID":"d9dc673b-ad13-48ca-afb0-a7da9c4acab7","Type":"ContainerStarted","Data":"09364d5ef15a21e26bec6561bc2ec1927ec0bf6be033c81f8d9a13f8f72a2299"}
Jul 09 22:19:39.342678 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:39.342646    2583 generic.go:356] "Generic (PLEG): container finished" podID="d9dc673b-ad13-48ca-afb0-a7da9c4acab7" containerID="b529e214173c931dbb4d516c96656deee330dfb2da4a5ab8a70a9361ad2957b2" exitCode=0
Jul 09 22:19:39.343179 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:39.342690    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4" event={"ID":"d9dc673b-ad13-48ca-afb0-a7da9c4acab7","Type":"ContainerDied","Data":"b529e214173c931dbb4d516c96656deee330dfb2da4a5ab8a70a9361ad2957b2"}
Jul 09 22:19:40.348639 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:40.348602    2583 generic.go:356] "Generic (PLEG): container finished" podID="d9dc673b-ad13-48ca-afb0-a7da9c4acab7" containerID="e788caa3785daa54579d8f523a438a925e98cb17cf9c897226e1df1a7e43589e" exitCode=0
Jul 09 22:19:40.349011 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:40.348638    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4" event={"ID":"d9dc673b-ad13-48ca-afb0-a7da9c4acab7","Type":"ContainerDied","Data":"e788caa3785daa54579d8f523a438a925e98cb17cf9c897226e1df1a7e43589e"}
Jul 09 22:19:41.472539 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:41.472511    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4"
Jul 09 22:19:41.576426 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:41.576387    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qg92\" (UniqueName: \"kubernetes.io/projected/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-kube-api-access-4qg92\") pod \"d9dc673b-ad13-48ca-afb0-a7da9c4acab7\" (UID: \"d9dc673b-ad13-48ca-afb0-a7da9c4acab7\") "
Jul 09 22:19:41.576610 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:41.576489    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-bundle\") pod \"d9dc673b-ad13-48ca-afb0-a7da9c4acab7\" (UID: \"d9dc673b-ad13-48ca-afb0-a7da9c4acab7\") "
Jul 09 22:19:41.576610 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:41.576513    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-util\") pod \"d9dc673b-ad13-48ca-afb0-a7da9c4acab7\" (UID: \"d9dc673b-ad13-48ca-afb0-a7da9c4acab7\") "
Jul 09 22:19:41.577244 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:41.577213    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-bundle" (OuterVolumeSpecName: "bundle") pod "d9dc673b-ad13-48ca-afb0-a7da9c4acab7" (UID: "d9dc673b-ad13-48ca-afb0-a7da9c4acab7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:19:41.578632 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:41.578609    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-kube-api-access-4qg92" (OuterVolumeSpecName: "kube-api-access-4qg92") pod "d9dc673b-ad13-48ca-afb0-a7da9c4acab7" (UID: "d9dc673b-ad13-48ca-afb0-a7da9c4acab7"). InnerVolumeSpecName "kube-api-access-4qg92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:19:41.582073 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:41.582049    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-util" (OuterVolumeSpecName: "util") pod "d9dc673b-ad13-48ca-afb0-a7da9c4acab7" (UID: "d9dc673b-ad13-48ca-afb0-a7da9c4acab7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:19:41.677324 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:41.677288    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-util\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:19:41.677324 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:41.677319    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qg92\" (UniqueName: \"kubernetes.io/projected/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-kube-api-access-4qg92\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:19:41.677324 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:41.677332    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9dc673b-ad13-48ca-afb0-a7da9c4acab7-bundle\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:19:42.358211 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:42.358171    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4" event={"ID":"d9dc673b-ad13-48ca-afb0-a7da9c4acab7","Type":"ContainerDied","Data":"09364d5ef15a21e26bec6561bc2ec1927ec0bf6be033c81f8d9a13f8f72a2299"}
Jul 09 22:19:42.358211 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:42.358209    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr84j4"
Jul 09 22:19:42.358423 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:42.358228    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09364d5ef15a21e26bec6561bc2ec1927ec0bf6be033c81f8d9a13f8f72a2299"
Jul 09 22:19:54.083480 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.083445    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"]
Jul 09 22:19:54.083964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.083710    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9dc673b-ad13-48ca-afb0-a7da9c4acab7" containerName="pull"
Jul 09 22:19:54.083964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.083721    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9dc673b-ad13-48ca-afb0-a7da9c4acab7" containerName="pull"
Jul 09 22:19:54.083964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.083740    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9dc673b-ad13-48ca-afb0-a7da9c4acab7" containerName="util"
Jul 09 22:19:54.083964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.083745    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9dc673b-ad13-48ca-afb0-a7da9c4acab7" containerName="util"
Jul 09 22:19:54.083964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.083751    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9dc673b-ad13-48ca-afb0-a7da9c4acab7" containerName="extract"
Jul 09 22:19:54.083964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.083756    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9dc673b-ad13-48ca-afb0-a7da9c4acab7" containerName="extract"
Jul 09 22:19:54.083964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.083798    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9dc673b-ad13-48ca-afb0-a7da9c4acab7" containerName="extract"
Jul 09 22:19:54.085889 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.085871    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.088689 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.088657    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 22:19:54.088689 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.088678    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 22:19:54.088892 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.088708    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 22:19:54.088892 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.088732    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 22:19:54.089040 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.089025    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8n8ll\""
Jul 09 22:19:54.105109 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.105066    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"]
Jul 09 22:19:54.271270 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.271234    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ae0e10f-33e2-44d8-b3b5-a58d2a635e49-manifests\") pod \"opendatahub-operator-controller-manager-5cf875db85-5sp7j\" (UID: \"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.271270 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.271280    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ae0e10f-33e2-44d8-b3b5-a58d2a635e49-tmp\") pod \"opendatahub-operator-controller-manager-5cf875db85-5sp7j\" (UID: \"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.271534 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.271317    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ae0e10f-33e2-44d8-b3b5-a58d2a635e49-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf875db85-5sp7j\" (UID: \"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.271534 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.271355    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ae0e10f-33e2-44d8-b3b5-a58d2a635e49-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf875db85-5sp7j\" (UID: \"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.271534 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.271462    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmcxc\" (UniqueName: \"kubernetes.io/projected/3ae0e10f-33e2-44d8-b3b5-a58d2a635e49-kube-api-access-tmcxc\") pod \"opendatahub-operator-controller-manager-5cf875db85-5sp7j\" (UID: \"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.372785 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.372757    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ae0e10f-33e2-44d8-b3b5-a58d2a635e49-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf875db85-5sp7j\" (UID: \"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.372958 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.372814    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmcxc\" (UniqueName: \"kubernetes.io/projected/3ae0e10f-33e2-44d8-b3b5-a58d2a635e49-kube-api-access-tmcxc\") pod \"opendatahub-operator-controller-manager-5cf875db85-5sp7j\" (UID: \"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.372958 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.372858    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ae0e10f-33e2-44d8-b3b5-a58d2a635e49-manifests\") pod \"opendatahub-operator-controller-manager-5cf875db85-5sp7j\" (UID: \"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.372958 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.372886    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ae0e10f-33e2-44d8-b3b5-a58d2a635e49-tmp\") pod \"opendatahub-operator-controller-manager-5cf875db85-5sp7j\" (UID: \"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.372958 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.372920    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ae0e10f-33e2-44d8-b3b5-a58d2a635e49-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf875db85-5sp7j\" (UID: \"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.373368 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.373336    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3ae0e10f-33e2-44d8-b3b5-a58d2a635e49-manifests\") pod \"opendatahub-operator-controller-manager-5cf875db85-5sp7j\" (UID: \"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.375660 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.375632    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3ae0e10f-33e2-44d8-b3b5-a58d2a635e49-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cf875db85-5sp7j\" (UID: \"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.375876 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.375857    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3ae0e10f-33e2-44d8-b3b5-a58d2a635e49-tmp\") pod \"opendatahub-operator-controller-manager-5cf875db85-5sp7j\" (UID: \"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.376320 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.376301    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3ae0e10f-33e2-44d8-b3b5-a58d2a635e49-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cf875db85-5sp7j\" (UID: \"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.381317 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.381293    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmcxc\" (UniqueName: \"kubernetes.io/projected/3ae0e10f-33e2-44d8-b3b5-a58d2a635e49-kube-api-access-tmcxc\") pod \"opendatahub-operator-controller-manager-5cf875db85-5sp7j\" (UID: \"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49\") " pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.396162 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.396139    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:19:54.542676 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:54.542643    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"]
Jul 09 22:19:54.546270 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:19:54.546237    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae0e10f_33e2_44d8_b3b5_a58d2a635e49.slice/crio-51a834e06dc9c7b424ea87e1b095d203cdd698f09a1be85c5fa27e1fa677e0fc WatchSource:0}: Error finding container 51a834e06dc9c7b424ea87e1b095d203cdd698f09a1be85c5fa27e1fa677e0fc: Status 404 returned error can't find the container with id 51a834e06dc9c7b424ea87e1b095d203cdd698f09a1be85c5fa27e1fa677e0fc
Jul 09 22:19:55.414316 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:55.414269    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j" event={"ID":"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49","Type":"ContainerStarted","Data":"51a834e06dc9c7b424ea87e1b095d203cdd698f09a1be85c5fa27e1fa677e0fc"}
Jul 09 22:19:58.429080 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:58.429038    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j" event={"ID":"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49","Type":"ContainerStarted","Data":"20ef1af2f648f27adaa7c41d73ddde3bfd007e852891f31edfb5fc5f74a9d288"}
Jul 09 22:19:59.434907 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:59.434873    2583 generic.go:356] "Generic (PLEG): container finished" podID="3ae0e10f-33e2-44d8-b3b5-a58d2a635e49" containerID="20ef1af2f648f27adaa7c41d73ddde3bfd007e852891f31edfb5fc5f74a9d288" exitCode=0
Jul 09 22:19:59.435332 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:19:59.434926    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j" event={"ID":"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49","Type":"ContainerDied","Data":"20ef1af2f648f27adaa7c41d73ddde3bfd007e852891f31edfb5fc5f74a9d288"}
Jul 09 22:20:00.441335 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:00.441293    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j" event={"ID":"3ae0e10f-33e2-44d8-b3b5-a58d2a635e49","Type":"ContainerStarted","Data":"887b98ea74b55da0e44390a4ba382d72ebdc5586434df682fc4e5f96fd7deefe"}
Jul 09 22:20:00.441767 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:00.441529    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:20:00.464222 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:00.464170    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j" podStartSLOduration=2.305862634 podStartE2EDuration="6.464152835s" totalImagesPullingTime="3.142528984s" totalInitContainerRuntime="1.015761217s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:19:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:20:00.463598584 +0000 UTC m=+568.542368264" watchObservedRunningTime="2026-07-09 22:20:00.464152835 +0000 UTC m=+568.542922514"
Jul 09 22:20:11.447721 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:11.447683    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cf875db85-5sp7j"
Jul 09 22:20:13.754645 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.754608    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn"]
Jul 09 22:20:13.765191 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.765164    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn"
Jul 09 22:20:13.768429 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.768404    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 09 22:20:13.769148 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.769127    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 09 22:20:13.769148 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.769141    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 22:20:13.769300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.769127    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mgmgt\""
Jul 09 22:20:13.772516 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.772152    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 22:20:13.773102 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.773071    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn"]
Jul 09 22:20:13.802362 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.802328    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b38e85be-fe05-4037-aa18-446349d115dd-tmp\") pod \"kube-auth-proxy-5ff74c44b9-q29kn\" (UID: \"b38e85be-fe05-4037-aa18-446349d115dd\") " pod="openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn"
Jul 09 22:20:13.802561 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.802382    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b38e85be-fe05-4037-aa18-446349d115dd-tls-certs\") pod \"kube-auth-proxy-5ff74c44b9-q29kn\" (UID: \"b38e85be-fe05-4037-aa18-446349d115dd\") " pod="openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn"
Jul 09 22:20:13.802561 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.802530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqv2g\" (UniqueName: \"kubernetes.io/projected/b38e85be-fe05-4037-aa18-446349d115dd-kube-api-access-wqv2g\") pod \"kube-auth-proxy-5ff74c44b9-q29kn\" (UID: \"b38e85be-fe05-4037-aa18-446349d115dd\") " pod="openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn"
Jul 09 22:20:13.860794 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.860758    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gsfpc"]
Jul 09 22:20:13.862980 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.862964    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gsfpc"
Jul 09 22:20:13.865278 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.865258    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 09 22:20:13.865471 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.865458    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ck96x\""
Jul 09 22:20:13.873964 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.873939    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gsfpc"]
Jul 09 22:20:13.903777 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.903735    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b38e85be-fe05-4037-aa18-446349d115dd-tls-certs\") pod \"kube-auth-proxy-5ff74c44b9-q29kn\" (UID: \"b38e85be-fe05-4037-aa18-446349d115dd\") " pod="openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn"
Jul 09 22:20:13.903970 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.903833    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f1bd6d4-f016-4246-bfec-dd952d8b60f4-cert\") pod \"odh-model-controller-7998c67dc4-gsfpc\" (UID: \"6f1bd6d4-f016-4246-bfec-dd952d8b60f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-gsfpc"
Jul 09 22:20:13.903970 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.903890    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8bqh\" (UniqueName: \"kubernetes.io/projected/6f1bd6d4-f016-4246-bfec-dd952d8b60f4-kube-api-access-p8bqh\") pod \"odh-model-controller-7998c67dc4-gsfpc\" (UID: \"6f1bd6d4-f016-4246-bfec-dd952d8b60f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-gsfpc"
Jul 09 22:20:13.903970 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.903921    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqv2g\" (UniqueName: \"kubernetes.io/projected/b38e85be-fe05-4037-aa18-446349d115dd-kube-api-access-wqv2g\") pod \"kube-auth-proxy-5ff74c44b9-q29kn\" (UID: \"b38e85be-fe05-4037-aa18-446349d115dd\") " pod="openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn"
Jul 09 22:20:13.903970 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.903957    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b38e85be-fe05-4037-aa18-446349d115dd-tmp\") pod \"kube-auth-proxy-5ff74c44b9-q29kn\" (UID: \"b38e85be-fe05-4037-aa18-446349d115dd\") " pod="openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn"
Jul 09 22:20:13.906364 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.906336    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b38e85be-fe05-4037-aa18-446349d115dd-tmp\") pod \"kube-auth-proxy-5ff74c44b9-q29kn\" (UID: \"b38e85be-fe05-4037-aa18-446349d115dd\") " pod="openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn"
Jul 09 22:20:13.906619 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.906597    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b38e85be-fe05-4037-aa18-446349d115dd-tls-certs\") pod \"kube-auth-proxy-5ff74c44b9-q29kn\" (UID: \"b38e85be-fe05-4037-aa18-446349d115dd\") " pod="openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn"
Jul 09 22:20:13.914363 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:13.914333    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqv2g\" (UniqueName: \"kubernetes.io/projected/b38e85be-fe05-4037-aa18-446349d115dd-kube-api-access-wqv2g\") pod \"kube-auth-proxy-5ff74c44b9-q29kn\" (UID: \"b38e85be-fe05-4037-aa18-446349d115dd\") " pod="openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn"
Jul 09 22:20:14.004821 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:14.004719    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8bqh\" (UniqueName: \"kubernetes.io/projected/6f1bd6d4-f016-4246-bfec-dd952d8b60f4-kube-api-access-p8bqh\") pod \"odh-model-controller-7998c67dc4-gsfpc\" (UID: \"6f1bd6d4-f016-4246-bfec-dd952d8b60f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-gsfpc"
Jul 09 22:20:14.004821 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:14.004813    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f1bd6d4-f016-4246-bfec-dd952d8b60f4-cert\") pod \"odh-model-controller-7998c67dc4-gsfpc\" (UID: \"6f1bd6d4-f016-4246-bfec-dd952d8b60f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-gsfpc"
Jul 09 22:20:14.005046 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:20:14.004932    2583 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 09 22:20:14.005046 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:20:14.004994    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f1bd6d4-f016-4246-bfec-dd952d8b60f4-cert podName:6f1bd6d4-f016-4246-bfec-dd952d8b60f4 nodeName:}" failed. No retries permitted until 2026-07-09 22:20:14.504970511 +0000 UTC m=+582.583740173 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6f1bd6d4-f016-4246-bfec-dd952d8b60f4-cert") pod "odh-model-controller-7998c67dc4-gsfpc" (UID: "6f1bd6d4-f016-4246-bfec-dd952d8b60f4") : secret "odh-model-controller-webhook-cert" not found
Jul 09 22:20:14.014116 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:14.014078    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8bqh\" (UniqueName: \"kubernetes.io/projected/6f1bd6d4-f016-4246-bfec-dd952d8b60f4-kube-api-access-p8bqh\") pod \"odh-model-controller-7998c67dc4-gsfpc\" (UID: \"6f1bd6d4-f016-4246-bfec-dd952d8b60f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-gsfpc"
Jul 09 22:20:14.076291 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:14.076256    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn"
Jul 09 22:20:14.209852 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:14.209828    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn"]
Jul 09 22:20:14.212004 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:20:14.211979    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb38e85be_fe05_4037_aa18_446349d115dd.slice/crio-e4cb1a37414856c8453f35dea49dc0b1f6f9aee8d74a002c26712e2c12062a54 WatchSource:0}: Error finding container e4cb1a37414856c8453f35dea49dc0b1f6f9aee8d74a002c26712e2c12062a54: Status 404 returned error can't find the container with id e4cb1a37414856c8453f35dea49dc0b1f6f9aee8d74a002c26712e2c12062a54
Jul 09 22:20:14.499263 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:14.499226    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn" event={"ID":"b38e85be-fe05-4037-aa18-446349d115dd","Type":"ContainerStarted","Data":"e4cb1a37414856c8453f35dea49dc0b1f6f9aee8d74a002c26712e2c12062a54"}
Jul 09 22:20:14.509730 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:14.509701    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f1bd6d4-f016-4246-bfec-dd952d8b60f4-cert\") pod \"odh-model-controller-7998c67dc4-gsfpc\" (UID: \"6f1bd6d4-f016-4246-bfec-dd952d8b60f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-gsfpc"
Jul 09 22:20:14.509919 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:20:14.509858    2583 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 09 22:20:14.509986 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:20:14.509940    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f1bd6d4-f016-4246-bfec-dd952d8b60f4-cert podName:6f1bd6d4-f016-4246-bfec-dd952d8b60f4 nodeName:}" failed. No retries permitted until 2026-07-09 22:20:15.509919437 +0000 UTC m=+583.588689097 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6f1bd6d4-f016-4246-bfec-dd952d8b60f4-cert") pod "odh-model-controller-7998c67dc4-gsfpc" (UID: "6f1bd6d4-f016-4246-bfec-dd952d8b60f4") : secret "odh-model-controller-webhook-cert" not found
Jul 09 22:20:14.798032 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:14.797942    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7k526"]
Jul 09 22:20:14.800553 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:14.800533    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7k526"
Jul 09 22:20:14.803118 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:14.803084    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 09 22:20:14.812268 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:14.812238    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6-tls-certs\") pod \"model-serving-api-54d89bd5fc-7k526\" (UID: \"82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-7k526"
Jul 09 22:20:14.812401 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:14.812281    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bztth\" (UniqueName: \"kubernetes.io/projected/82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6-kube-api-access-bztth\") pod \"model-serving-api-54d89bd5fc-7k526\" (UID: \"82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-7k526"
Jul 09 22:20:14.822921 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:14.822891    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7k526"]
Jul 09 22:20:14.913047 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:14.913013    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6-tls-certs\") pod \"model-serving-api-54d89bd5fc-7k526\" (UID: \"82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-7k526"
Jul 09 22:20:14.913231 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:14.913062    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bztth\" (UniqueName: \"kubernetes.io/projected/82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6-kube-api-access-bztth\") pod \"model-serving-api-54d89bd5fc-7k526\" (UID: \"82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-7k526"
Jul 09 22:20:14.913231 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:20:14.913192    2583 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 09 22:20:14.913340 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:20:14.913269    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6-tls-certs podName:82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6 nodeName:}" failed. No retries permitted until 2026-07-09 22:20:15.413247374 +0000 UTC m=+583.492017048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6-tls-certs") pod "model-serving-api-54d89bd5fc-7k526" (UID: "82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6") : secret "model-serving-api-tls" not found
Jul 09 22:20:14.924940 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:14.924913    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bztth\" (UniqueName: \"kubernetes.io/projected/82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6-kube-api-access-bztth\") pod \"model-serving-api-54d89bd5fc-7k526\" (UID: \"82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-7k526"
Jul 09 22:20:15.158166 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.156206    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"]
Jul 09 22:20:15.159368 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.159338    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.161910 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.161887    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 22:20:15.162023 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.161918    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 22:20:15.162023 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.161919    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 22:20:15.162023 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.161893    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 22:20:15.162287 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.162038    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-hz88g\""
Jul 09 22:20:15.171744 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.171721    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"]
Jul 09 22:20:15.217236 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.217203    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-token\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.217236 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.217245    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.217487 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.217279    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-cacerts\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.217487 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.217359    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.217487 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.217442    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.217653 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.217496    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wxws\" (UniqueName: \"kubernetes.io/projected/876601c5-6cd3-4e74-bf9b-b9146cc11276-kube-api-access-5wxws\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.217653 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.217524    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/876601c5-6cd3-4e74-bf9b-b9146cc11276-local-certs\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.318392 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.318354    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.318561 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.318413    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.318561 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.318450    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wxws\" (UniqueName: \"kubernetes.io/projected/876601c5-6cd3-4e74-bf9b-b9146cc11276-kube-api-access-5wxws\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.318561 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.318469    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/876601c5-6cd3-4e74-bf9b-b9146cc11276-local-certs\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.318561 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.318496    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-token\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.318561 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.318521    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.318561 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.318552    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-cacerts\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.319143 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.319117    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.321006 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.320980    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-cacerts\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.321120 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.320981    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/876601c5-6cd3-4e74-bf9b-b9146cc11276-local-certs\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.321120 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.320988    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.321194 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.321139    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.326264 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.326226    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-token\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.326422 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.326403    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wxws\" (UniqueName: \"kubernetes.io/projected/876601c5-6cd3-4e74-bf9b-b9146cc11276-kube-api-access-5wxws\") pod \"istiod-openshift-gateway-7574459656-ggjkt\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.419210 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.419135    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6-tls-certs\") pod \"model-serving-api-54d89bd5fc-7k526\" (UID: \"82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-7k526"
Jul 09 22:20:15.421629 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.421605    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6-tls-certs\") pod \"model-serving-api-54d89bd5fc-7k526\" (UID: \"82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6\") " pod="opendatahub/model-serving-api-54d89bd5fc-7k526"
Jul 09 22:20:15.471711 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.471667    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:15.520272 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.520234    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f1bd6d4-f016-4246-bfec-dd952d8b60f4-cert\") pod \"odh-model-controller-7998c67dc4-gsfpc\" (UID: \"6f1bd6d4-f016-4246-bfec-dd952d8b60f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-gsfpc"
Jul 09 22:20:15.524625 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.523853    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f1bd6d4-f016-4246-bfec-dd952d8b60f4-cert\") pod \"odh-model-controller-7998c67dc4-gsfpc\" (UID: \"6f1bd6d4-f016-4246-bfec-dd952d8b60f4\") " pod="opendatahub/odh-model-controller-7998c67dc4-gsfpc"
Jul 09 22:20:15.621791 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.621756    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"]
Jul 09 22:20:15.624946 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:20:15.624917    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876601c5_6cd3_4e74_bf9b_b9146cc11276.slice/crio-aa3b4055954fd99c814705df4495319185b5b333b1e9a6a34befc7bd2d3d5b96 WatchSource:0}: Error finding container aa3b4055954fd99c814705df4495319185b5b333b1e9a6a34befc7bd2d3d5b96: Status 404 returned error can't find the container with id aa3b4055954fd99c814705df4495319185b5b333b1e9a6a34befc7bd2d3d5b96
Jul 09 22:20:15.672817 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.672732    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gsfpc"
Jul 09 22:20:15.710925 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.710891    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7k526"
Jul 09 22:20:15.837068 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.836822    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gsfpc"]
Jul 09 22:20:15.840078 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:20:15.840042    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1bd6d4_f016_4246_bfec_dd952d8b60f4.slice/crio-2cc5f476698f33724ed06f311d639759c29ddafa1996c2b1d434aff6544f079e WatchSource:0}: Error finding container 2cc5f476698f33724ed06f311d639759c29ddafa1996c2b1d434aff6544f079e: Status 404 returned error can't find the container with id 2cc5f476698f33724ed06f311d639759c29ddafa1996c2b1d434aff6544f079e
Jul 09 22:20:15.872614 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:15.872579    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7k526"]
Jul 09 22:20:15.875112 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:20:15.875068    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82fbd4d9_5bf1_4d10_90d8_1e9b764c89b6.slice/crio-60f6336093de3437014b1926fecbae616ae97bff71185f55e2a662e242cbf78e WatchSource:0}: Error finding container 60f6336093de3437014b1926fecbae616ae97bff71185f55e2a662e242cbf78e: Status 404 returned error can't find the container with id 60f6336093de3437014b1926fecbae616ae97bff71185f55e2a662e242cbf78e
Jul 09 22:20:16.510838 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:16.510800    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gsfpc" event={"ID":"6f1bd6d4-f016-4246-bfec-dd952d8b60f4","Type":"ContainerStarted","Data":"2cc5f476698f33724ed06f311d639759c29ddafa1996c2b1d434aff6544f079e"}
Jul 09 22:20:16.512779 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:16.512712    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt" event={"ID":"876601c5-6cd3-4e74-bf9b-b9146cc11276","Type":"ContainerStarted","Data":"aa3b4055954fd99c814705df4495319185b5b333b1e9a6a34befc7bd2d3d5b96"}
Jul 09 22:20:16.514737 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:16.514695    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7k526" event={"ID":"82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6","Type":"ContainerStarted","Data":"60f6336093de3437014b1926fecbae616ae97bff71185f55e2a662e242cbf78e"}
Jul 09 22:20:20.080356 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:20.080307    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 22:20:20.080739 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:20.080394    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 09 22:20:20.541018 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:20.540983    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7k526" event={"ID":"82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6","Type":"ContainerStarted","Data":"b9a68a2f8a617fae1714cba372762d9f27cae73a51984fc9a39ecbeac52f9e57"}
Jul 09 22:20:20.541269 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:20.541099    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-7k526"
Jul 09 22:20:20.542664 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:20.542638    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn" event={"ID":"b38e85be-fe05-4037-aa18-446349d115dd","Type":"ContainerStarted","Data":"a0090a75d094c1b31a440dfd533b857804143eddb63d15751163399a3251ff1b"}
Jul 09 22:20:20.544258 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:20.544223    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gsfpc" event={"ID":"6f1bd6d4-f016-4246-bfec-dd952d8b60f4","Type":"ContainerStarted","Data":"8e9cedbaad1b51c808ce3c9e00b06bb53d5af5e8071f74c82a0aee602e55f228"}
Jul 09 22:20:20.544373 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:20.544336    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-gsfpc"
Jul 09 22:20:20.546127 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:20.546103    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt" event={"ID":"876601c5-6cd3-4e74-bf9b-b9146cc11276","Type":"ContainerStarted","Data":"ee6acd66a347f5a88cc298fd04cac666a330c66f912d277884fb310db57d6aff"}
Jul 09 22:20:20.546234 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:20.546161    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:20.581021 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:20.580959    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-7k526" podStartSLOduration=2.377956844 podStartE2EDuration="6.5809421s" totalImagesPullingTime="4.202985256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:20:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:20:20.576751353 +0000 UTC m=+588.655521029" watchObservedRunningTime="2026-07-09 22:20:20.5809421 +0000 UTC m=+588.659711778"
Jul 09 22:20:20.617356 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:20.617295    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-gsfpc" podStartSLOduration=3.368813699 podStartE2EDuration="7.617274095s" totalImagesPullingTime="4.248460396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:20:20.615573661 +0000 UTC m=+588.694343341" watchObservedRunningTime="2026-07-09 22:20:20.617274095 +0000 UTC m=+588.696043775"
Jul 09 22:20:20.645132 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:20.645053    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5ff74c44b9-q29kn" podStartSLOduration=1.836652311 podStartE2EDuration="7.645029301s" totalImagesPullingTime="5.80837699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:20:20.644199901 +0000 UTC m=+588.722969581" watchObservedRunningTime="2026-07-09 22:20:20.645029301 +0000 UTC m=+588.723798981"
Jul 09 22:20:20.673984 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:20.673935    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt" podStartSLOduration=1.221160577 podStartE2EDuration="5.673917452s" totalImagesPullingTime="4.452756875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:20:20.6708882 +0000 UTC m=+588.749657873" watchObservedRunningTime="2026-07-09 22:20:20.673917452 +0000 UTC m=+588.752687132"
Jul 09 22:20:21.552543 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:21.552499    2583 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-ggjkt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 22:20:21.552921 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:21.552565    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt" podUID="876601c5-6cd3-4e74-bf9b-b9146cc11276" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 22:20:24.552201 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:24.552171    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:25.040173 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.040136    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"]
Jul 09 22:20:25.043607 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.043585    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"
Jul 09 22:20:25.051414 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.051392    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 22:20:25.051658 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.051643    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 22:20:25.056959 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.056939    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 22:20:25.057396 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.057380    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bnfgw\""
Jul 09 22:20:25.057396 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.057390    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 22:20:25.057640 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.057625    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 22:20:25.086071 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.086031    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"]
Jul 09 22:20:25.101450 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.101412    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9d1566bb-aee2-4bc5-b433-2d43df002852-manager-config\") pod \"lws-controller-manager-76dfc7bb46-vv9db\" (UID: \"9d1566bb-aee2-4bc5-b433-2d43df002852\") " pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"
Jul 09 22:20:25.101608 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.101510    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d1566bb-aee2-4bc5-b433-2d43df002852-cert\") pod \"lws-controller-manager-76dfc7bb46-vv9db\" (UID: \"9d1566bb-aee2-4bc5-b433-2d43df002852\") " pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"
Jul 09 22:20:25.101608 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.101542    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfz7q\" (UniqueName: \"kubernetes.io/projected/9d1566bb-aee2-4bc5-b433-2d43df002852-kube-api-access-nfz7q\") pod \"lws-controller-manager-76dfc7bb46-vv9db\" (UID: \"9d1566bb-aee2-4bc5-b433-2d43df002852\") " pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"
Jul 09 22:20:25.101715 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.101608    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d1566bb-aee2-4bc5-b433-2d43df002852-metrics-cert\") pod \"lws-controller-manager-76dfc7bb46-vv9db\" (UID: \"9d1566bb-aee2-4bc5-b433-2d43df002852\") " pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"
Jul 09 22:20:25.202450 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.202412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9d1566bb-aee2-4bc5-b433-2d43df002852-manager-config\") pod \"lws-controller-manager-76dfc7bb46-vv9db\" (UID: \"9d1566bb-aee2-4bc5-b433-2d43df002852\") " pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"
Jul 09 22:20:25.202627 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.202458    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d1566bb-aee2-4bc5-b433-2d43df002852-cert\") pod \"lws-controller-manager-76dfc7bb46-vv9db\" (UID: \"9d1566bb-aee2-4bc5-b433-2d43df002852\") " pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"
Jul 09 22:20:25.202627 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.202477    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfz7q\" (UniqueName: \"kubernetes.io/projected/9d1566bb-aee2-4bc5-b433-2d43df002852-kube-api-access-nfz7q\") pod \"lws-controller-manager-76dfc7bb46-vv9db\" (UID: \"9d1566bb-aee2-4bc5-b433-2d43df002852\") " pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"
Jul 09 22:20:25.202627 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.202518    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d1566bb-aee2-4bc5-b433-2d43df002852-metrics-cert\") pod \"lws-controller-manager-76dfc7bb46-vv9db\" (UID: \"9d1566bb-aee2-4bc5-b433-2d43df002852\") " pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"
Jul 09 22:20:25.203142 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.203118    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9d1566bb-aee2-4bc5-b433-2d43df002852-manager-config\") pod \"lws-controller-manager-76dfc7bb46-vv9db\" (UID: \"9d1566bb-aee2-4bc5-b433-2d43df002852\") " pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"
Jul 09 22:20:25.204969 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.204942    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d1566bb-aee2-4bc5-b433-2d43df002852-cert\") pod \"lws-controller-manager-76dfc7bb46-vv9db\" (UID: \"9d1566bb-aee2-4bc5-b433-2d43df002852\") " pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"
Jul 09 22:20:25.205135 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.205115    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d1566bb-aee2-4bc5-b433-2d43df002852-metrics-cert\") pod \"lws-controller-manager-76dfc7bb46-vv9db\" (UID: \"9d1566bb-aee2-4bc5-b433-2d43df002852\") " pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"
Jul 09 22:20:25.219059 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.219032    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfz7q\" (UniqueName: \"kubernetes.io/projected/9d1566bb-aee2-4bc5-b433-2d43df002852-kube-api-access-nfz7q\") pod \"lws-controller-manager-76dfc7bb46-vv9db\" (UID: \"9d1566bb-aee2-4bc5-b433-2d43df002852\") " pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"
Jul 09 22:20:25.353377 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.353277    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"
Jul 09 22:20:25.526694 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.526659    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"]
Jul 09 22:20:25.530675 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:20:25.530648    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d1566bb_aee2_4bc5_b433_2d43df002852.slice/crio-6c91a32bc82bc1857be63a944369feea5ac8d97e9daa613ea3cbdd6d1a7317ff WatchSource:0}: Error finding container 6c91a32bc82bc1857be63a944369feea5ac8d97e9daa613ea3cbdd6d1a7317ff: Status 404 returned error can't find the container with id 6c91a32bc82bc1857be63a944369feea5ac8d97e9daa613ea3cbdd6d1a7317ff
Jul 09 22:20:25.568874 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.568840    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db" event={"ID":"9d1566bb-aee2-4bc5-b433-2d43df002852","Type":"ContainerStarted","Data":"6c91a32bc82bc1857be63a944369feea5ac8d97e9daa613ea3cbdd6d1a7317ff"}
Jul 09 22:20:25.651400 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.651366    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"]
Jul 09 22:20:25.651572 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.651534    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt" podUID="876601c5-6cd3-4e74-bf9b-b9146cc11276" containerName="discovery" containerID="cri-o://ee6acd66a347f5a88cc298fd04cac666a330c66f912d277884fb310db57d6aff" gracePeriod=30
Jul 09 22:20:25.895565 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:25.895541    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:26.009357 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.009265    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-csr-ca-configmap\") pod \"876601c5-6cd3-4e74-bf9b-b9146cc11276\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") "
Jul 09 22:20:26.009357 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.009310    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/876601c5-6cd3-4e74-bf9b-b9146cc11276-local-certs\") pod \"876601c5-6cd3-4e74-bf9b-b9146cc11276\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") "
Jul 09 22:20:26.009357 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.009349    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wxws\" (UniqueName: \"kubernetes.io/projected/876601c5-6cd3-4e74-bf9b-b9146cc11276-kube-api-access-5wxws\") pod \"876601c5-6cd3-4e74-bf9b-b9146cc11276\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") "
Jul 09 22:20:26.009627 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.009367    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-token\") pod \"876601c5-6cd3-4e74-bf9b-b9146cc11276\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") "
Jul 09 22:20:26.009627 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.009400    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-cacerts\") pod \"876601c5-6cd3-4e74-bf9b-b9146cc11276\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") "
Jul 09 22:20:26.009627 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.009436    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-csr-dns-cert\") pod \"876601c5-6cd3-4e74-bf9b-b9146cc11276\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") "
Jul 09 22:20:26.009627 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.009459    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-kubeconfig\") pod \"876601c5-6cd3-4e74-bf9b-b9146cc11276\" (UID: \"876601c5-6cd3-4e74-bf9b-b9146cc11276\") "
Jul 09 22:20:26.009850 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.009766    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "876601c5-6cd3-4e74-bf9b-b9146cc11276" (UID: "876601c5-6cd3-4e74-bf9b-b9146cc11276"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:20:26.011878 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.011851    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "876601c5-6cd3-4e74-bf9b-b9146cc11276" (UID: "876601c5-6cd3-4e74-bf9b-b9146cc11276"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:20:26.012018 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.011876    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "876601c5-6cd3-4e74-bf9b-b9146cc11276" (UID: "876601c5-6cd3-4e74-bf9b-b9146cc11276"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:20:26.012071 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.012024    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-cacerts" (OuterVolumeSpecName: "cacerts") pod "876601c5-6cd3-4e74-bf9b-b9146cc11276" (UID: "876601c5-6cd3-4e74-bf9b-b9146cc11276"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:20:26.012071 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.012042    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/876601c5-6cd3-4e74-bf9b-b9146cc11276-local-certs" (OuterVolumeSpecName: "local-certs") pod "876601c5-6cd3-4e74-bf9b-b9146cc11276" (UID: "876601c5-6cd3-4e74-bf9b-b9146cc11276"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:20:26.012230 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.012175    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/876601c5-6cd3-4e74-bf9b-b9146cc11276-kube-api-access-5wxws" (OuterVolumeSpecName: "kube-api-access-5wxws") pod "876601c5-6cd3-4e74-bf9b-b9146cc11276" (UID: "876601c5-6cd3-4e74-bf9b-b9146cc11276"). InnerVolumeSpecName "kube-api-access-5wxws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:20:26.012230 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.012200    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-token" (OuterVolumeSpecName: "istio-token") pod "876601c5-6cd3-4e74-bf9b-b9146cc11276" (UID: "876601c5-6cd3-4e74-bf9b-b9146cc11276"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:20:26.110300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.110268    2583 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-cacerts\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:20:26.110300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.110296    2583 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-csr-dns-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:20:26.110300 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.110305    2583 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-kubeconfig\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:20:26.110522 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.110315    2583 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-csr-ca-configmap\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:20:26.110522 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.110324    2583 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/876601c5-6cd3-4e74-bf9b-b9146cc11276-local-certs\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:20:26.110522 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.110332    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wxws\" (UniqueName: \"kubernetes.io/projected/876601c5-6cd3-4e74-bf9b-b9146cc11276-kube-api-access-5wxws\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:20:26.110522 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.110340    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/876601c5-6cd3-4e74-bf9b-b9146cc11276-istio-token\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:20:26.576732 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.576685    2583 generic.go:356] "Generic (PLEG): container finished" podID="876601c5-6cd3-4e74-bf9b-b9146cc11276" containerID="ee6acd66a347f5a88cc298fd04cac666a330c66f912d277884fb310db57d6aff" exitCode=0
Jul 09 22:20:26.576732 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.576726    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"
Jul 09 22:20:26.577285 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.576777    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt" event={"ID":"876601c5-6cd3-4e74-bf9b-b9146cc11276","Type":"ContainerDied","Data":"ee6acd66a347f5a88cc298fd04cac666a330c66f912d277884fb310db57d6aff"}
Jul 09 22:20:26.577285 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.576823    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt" event={"ID":"876601c5-6cd3-4e74-bf9b-b9146cc11276","Type":"ContainerDied","Data":"aa3b4055954fd99c814705df4495319185b5b333b1e9a6a34befc7bd2d3d5b96"}
Jul 09 22:20:26.577285 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.576849    2583 scope.go:117] "RemoveContainer" containerID="ee6acd66a347f5a88cc298fd04cac666a330c66f912d277884fb310db57d6aff"
Jul 09 22:20:26.587309 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.587286    2583 scope.go:117] "RemoveContainer" containerID="ee6acd66a347f5a88cc298fd04cac666a330c66f912d277884fb310db57d6aff"
Jul 09 22:20:26.587687 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:20:26.587665    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee6acd66a347f5a88cc298fd04cac666a330c66f912d277884fb310db57d6aff\": container with ID starting with ee6acd66a347f5a88cc298fd04cac666a330c66f912d277884fb310db57d6aff not found: ID does not exist" containerID="ee6acd66a347f5a88cc298fd04cac666a330c66f912d277884fb310db57d6aff"
Jul 09 22:20:26.587764 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.587702    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6acd66a347f5a88cc298fd04cac666a330c66f912d277884fb310db57d6aff"} err="failed to get container status \"ee6acd66a347f5a88cc298fd04cac666a330c66f912d277884fb310db57d6aff\": rpc error: code = NotFound desc = could not find container \"ee6acd66a347f5a88cc298fd04cac666a330c66f912d277884fb310db57d6aff\": container with ID starting with ee6acd66a347f5a88cc298fd04cac666a330c66f912d277884fb310db57d6aff not found: ID does not exist"
Jul 09 22:20:26.596827 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.596795    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"]
Jul 09 22:20:26.610308 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:26.610258    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ggjkt"]
Jul 09 22:20:27.586170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:27.586075    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db" event={"ID":"9d1566bb-aee2-4bc5-b433-2d43df002852","Type":"ContainerStarted","Data":"70789fbbbd90f3a249161b7c9d9fb1cf398af8f3f94f87a573a39f40d7c22f8d"}
Jul 09 22:20:27.586170 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:27.586150    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"
Jul 09 22:20:27.604413 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:27.604361    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db" podStartSLOduration=1.938819828 podStartE2EDuration="3.604344975s" totalImagesPullingTime="1.665525147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:20:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:20:27.603153407 +0000 UTC m=+595.681923083" watchObservedRunningTime="2026-07-09 22:20:27.604344975 +0000 UTC m=+595.683114654"
Jul 09 22:20:28.486249 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:28.486217    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="876601c5-6cd3-4e74-bf9b-b9146cc11276" path="/var/lib/kubelet/pods/876601c5-6cd3-4e74-bf9b-b9146cc11276/volumes"
Jul 09 22:20:31.555508 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:31.555477    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-7k526"
Jul 09 22:20:31.586684 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:31.586649    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-gsfpc"
Jul 09 22:20:38.593939 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:20:38.593906    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76dfc7bb46-vv9db"
Jul 09 22:21:31.189273 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.189243    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv"]
Jul 09 22:21:31.189737 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.189508    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="876601c5-6cd3-4e74-bf9b-b9146cc11276" containerName="discovery"
Jul 09 22:21:31.189737 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.189519    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="876601c5-6cd3-4e74-bf9b-b9146cc11276" containerName="discovery"
Jul 09 22:21:31.189737 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.189577    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="876601c5-6cd3-4e74-bf9b-b9146cc11276" containerName="discovery"
Jul 09 22:21:31.191729 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.191714    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv"
Jul 09 22:21:31.194114 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.194078    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 22:21:31.194259 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.194115    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 22:21:31.194670 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.194654    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fkpk4\""
Jul 09 22:21:31.201255 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.201226    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv"]
Jul 09 22:21:31.229740 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.229686    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a822043d-5651-4b43-b1a9-2c25312b98f6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv\" (UID: \"a822043d-5651-4b43-b1a9-2c25312b98f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv"
Jul 09 22:21:31.229740 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.229741    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmlf2\" (UniqueName: \"kubernetes.io/projected/a822043d-5651-4b43-b1a9-2c25312b98f6-kube-api-access-dmlf2\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv\" (UID: \"a822043d-5651-4b43-b1a9-2c25312b98f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv"
Jul 09 22:21:31.229950 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.229823    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a822043d-5651-4b43-b1a9-2c25312b98f6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv\" (UID: \"a822043d-5651-4b43-b1a9-2c25312b98f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv"
Jul 09 22:21:31.303842 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.303803    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7"]
Jul 09 22:21:31.306221 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.306200    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7"
Jul 09 22:21:31.316451 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.316424    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7"]
Jul 09 22:21:31.331107 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.331059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a822043d-5651-4b43-b1a9-2c25312b98f6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv\" (UID: \"a822043d-5651-4b43-b1a9-2c25312b98f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv"
Jul 09 22:21:31.331282 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.331129    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmlf2\" (UniqueName: \"kubernetes.io/projected/a822043d-5651-4b43-b1a9-2c25312b98f6-kube-api-access-dmlf2\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv\" (UID: \"a822043d-5651-4b43-b1a9-2c25312b98f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv"
Jul 09 22:21:31.331282 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.331174    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a822043d-5651-4b43-b1a9-2c25312b98f6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv\" (UID: \"a822043d-5651-4b43-b1a9-2c25312b98f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv"
Jul 09 22:21:31.331444 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.331423    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a822043d-5651-4b43-b1a9-2c25312b98f6-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv\" (UID: \"a822043d-5651-4b43-b1a9-2c25312b98f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv"
Jul 09 22:21:31.331506 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.331454    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a822043d-5651-4b43-b1a9-2c25312b98f6-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv\" (UID: \"a822043d-5651-4b43-b1a9-2c25312b98f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv"
Jul 09 22:21:31.341406 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.341367    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmlf2\" (UniqueName: \"kubernetes.io/projected/a822043d-5651-4b43-b1a9-2c25312b98f6-kube-api-access-dmlf2\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv\" (UID: \"a822043d-5651-4b43-b1a9-2c25312b98f6\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv"
Jul 09 22:21:31.406665 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.406628    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c"]
Jul 09 22:21:31.409060 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.409039    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c"
Jul 09 22:21:31.424270 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.424243    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c"]
Jul 09 22:21:31.432421 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.432394    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r79zg\" (UniqueName: \"kubernetes.io/projected/0e08fa27-c33d-49bc-8993-d80a398c3776-kube-api-access-r79zg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7\" (UID: \"0e08fa27-c33d-49bc-8993-d80a398c3776\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7"
Jul 09 22:21:31.432567 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.432430    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e08fa27-c33d-49bc-8993-d80a398c3776-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7\" (UID: \"0e08fa27-c33d-49bc-8993-d80a398c3776\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7"
Jul 09 22:21:31.432567 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.432527    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e08fa27-c33d-49bc-8993-d80a398c3776-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7\" (UID: \"0e08fa27-c33d-49bc-8993-d80a398c3776\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7"
Jul 09 22:21:31.502454 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.502364    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq"]
Jul 09 22:21:31.502454 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.502445    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv"
Jul 09 22:21:31.504877 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.504841    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq"
Jul 09 22:21:31.518463 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.518422    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq"]
Jul 09 22:21:31.533504 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.533472    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5452aadf-5325-4e2e-922e-084ae83a7354-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c\" (UID: \"5452aadf-5325-4e2e-922e-084ae83a7354\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c"
Jul 09 22:21:31.533676 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.533542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e08fa27-c33d-49bc-8993-d80a398c3776-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7\" (UID: \"0e08fa27-c33d-49bc-8993-d80a398c3776\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7"
Jul 09 22:21:31.533676 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.533570    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7qxf\" (UniqueName: \"kubernetes.io/projected/5452aadf-5325-4e2e-922e-084ae83a7354-kube-api-access-z7qxf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c\" (UID: \"5452aadf-5325-4e2e-922e-084ae83a7354\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c"
Jul 09 22:21:31.533676 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.533604    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r79zg\" (UniqueName: \"kubernetes.io/projected/0e08fa27-c33d-49bc-8993-d80a398c3776-kube-api-access-r79zg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7\" (UID: \"0e08fa27-c33d-49bc-8993-d80a398c3776\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7"
Jul 09 22:21:31.533676 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.533636    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e08fa27-c33d-49bc-8993-d80a398c3776-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7\" (UID: \"0e08fa27-c33d-49bc-8993-d80a398c3776\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7"
Jul 09 22:21:31.533899 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.533715    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5452aadf-5325-4e2e-922e-084ae83a7354-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c\" (UID: \"5452aadf-5325-4e2e-922e-084ae83a7354\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c"
Jul 09 22:21:31.533899 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.533822    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e08fa27-c33d-49bc-8993-d80a398c3776-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7\" (UID: \"0e08fa27-c33d-49bc-8993-d80a398c3776\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7"
Jul 09 22:21:31.534049 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.534014    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e08fa27-c33d-49bc-8993-d80a398c3776-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7\" (UID: \"0e08fa27-c33d-49bc-8993-d80a398c3776\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7"
Jul 09 22:21:31.542548 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.542519    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r79zg\" (UniqueName: \"kubernetes.io/projected/0e08fa27-c33d-49bc-8993-d80a398c3776-kube-api-access-r79zg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7\" (UID: \"0e08fa27-c33d-49bc-8993-d80a398c3776\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7"
Jul 09 22:21:31.615690 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.615657    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7"
Jul 09 22:21:31.634776 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.634738    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5452aadf-5325-4e2e-922e-084ae83a7354-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c\" (UID: \"5452aadf-5325-4e2e-922e-084ae83a7354\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c"
Jul 09 22:21:31.634932 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.634807    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq\" (UID: \"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq"
Jul 09 22:21:31.634932 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.634863    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq\" (UID: \"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq"
Jul 09 22:21:31.635017 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.634978    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7qxf\" (UniqueName: \"kubernetes.io/projected/5452aadf-5325-4e2e-922e-084ae83a7354-kube-api-access-z7qxf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c\" (UID: \"5452aadf-5325-4e2e-922e-084ae83a7354\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c"
Jul 09 22:21:31.635079 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.635060    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5452aadf-5325-4e2e-922e-084ae83a7354-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c\" (UID: \"5452aadf-5325-4e2e-922e-084ae83a7354\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c"
Jul 09 22:21:31.635157 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.635080    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5452aadf-5325-4e2e-922e-084ae83a7354-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c\" (UID: \"5452aadf-5325-4e2e-922e-084ae83a7354\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c"
Jul 09 22:21:31.635205 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.635165    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wf8n\" (UniqueName: \"kubernetes.io/projected/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-kube-api-access-9wf8n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq\" (UID: \"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq"
Jul 09 22:21:31.635403 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.635386    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5452aadf-5325-4e2e-922e-084ae83a7354-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c\" (UID: \"5452aadf-5325-4e2e-922e-084ae83a7354\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c"
Jul 09 22:21:31.646017 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.645898    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv"]
Jul 09 22:21:31.648454 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:21:31.648421    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda822043d_5651_4b43_b1a9_2c25312b98f6.slice/crio-286eacab78dc102b06c98f2f3b85a0dd631b51aa0a40f004738770f84af836ef WatchSource:0}: Error finding container 286eacab78dc102b06c98f2f3b85a0dd631b51aa0a40f004738770f84af836ef: Status 404 returned error can't find the container with id 286eacab78dc102b06c98f2f3b85a0dd631b51aa0a40f004738770f84af836ef
Jul 09 22:21:31.649065 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.649042    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7qxf\" (UniqueName: \"kubernetes.io/projected/5452aadf-5325-4e2e-922e-084ae83a7354-kube-api-access-z7qxf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c\" (UID: \"5452aadf-5325-4e2e-922e-084ae83a7354\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c"
Jul 09 22:21:31.718293 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.718259    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c"
Jul 09 22:21:31.735902 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.735862    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wf8n\" (UniqueName: \"kubernetes.io/projected/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-kube-api-access-9wf8n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq\" (UID: \"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq"
Jul 09 22:21:31.736080 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.735924    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq\" (UID: \"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq"
Jul 09 22:21:31.736080 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.735948    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq\" (UID: \"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq"
Jul 09 22:21:31.736509 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.736484    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq\" (UID: \"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq"
Jul 09 22:21:31.736584 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.736512    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq\" (UID: \"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq"
Jul 09 22:21:31.745778 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.745746    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wf8n\" (UniqueName: \"kubernetes.io/projected/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-kube-api-access-9wf8n\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq\" (UID: \"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq"
Jul 09 22:21:31.766009 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.765930    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7"]
Jul 09 22:21:31.769634 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:21:31.769596    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e08fa27_c33d_49bc_8993_d80a398c3776.slice/crio-36011d296f21ec81a0e3c0568b3544c7117a875df12797a439f254173f855839 WatchSource:0}: Error finding container 36011d296f21ec81a0e3c0568b3544c7117a875df12797a439f254173f855839: Status 404 returned error can't find the container with id 36011d296f21ec81a0e3c0568b3544c7117a875df12797a439f254173f855839
Jul 09 22:21:31.829617 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.829577    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq"
Jul 09 22:21:31.861808 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.861780    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c"]
Jul 09 22:21:31.862379 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.862333    2583 generic.go:356] "Generic (PLEG): container finished" podID="a822043d-5651-4b43-b1a9-2c25312b98f6" containerID="26937ca21c1878a3b08de59053e34209aada021816a5f035b4ba0adf8e1b0986" exitCode=0
Jul 09 22:21:31.862502 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.862412    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv" event={"ID":"a822043d-5651-4b43-b1a9-2c25312b98f6","Type":"ContainerDied","Data":"26937ca21c1878a3b08de59053e34209aada021816a5f035b4ba0adf8e1b0986"}
Jul 09 22:21:31.862502 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.862461    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv" event={"ID":"a822043d-5651-4b43-b1a9-2c25312b98f6","Type":"ContainerStarted","Data":"286eacab78dc102b06c98f2f3b85a0dd631b51aa0a40f004738770f84af836ef"}
Jul 09 22:21:31.863038 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.863016    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:21:31.863733 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:21:31.863715    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5452aadf_5325_4e2e_922e_084ae83a7354.slice/crio-40dc98a8a899228556bb7c0b0f32bd845f3b2e28c16cb52ee9ca85e9f6ff13f0 WatchSource:0}: Error finding container 40dc98a8a899228556bb7c0b0f32bd845f3b2e28c16cb52ee9ca85e9f6ff13f0: Status 404 returned error can't find the container with id 40dc98a8a899228556bb7c0b0f32bd845f3b2e28c16cb52ee9ca85e9f6ff13f0
Jul 09 22:21:31.864806 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.864749    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7" event={"ID":"0e08fa27-c33d-49bc-8993-d80a398c3776","Type":"ContainerStarted","Data":"22cd2b07b6b0624d826b1bbdf81eca9caf39a42dcb2bdc1da7ab8844239f1240"}
Jul 09 22:21:31.864806 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.864785    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7" event={"ID":"0e08fa27-c33d-49bc-8993-d80a398c3776","Type":"ContainerStarted","Data":"36011d296f21ec81a0e3c0568b3544c7117a875df12797a439f254173f855839"}
Jul 09 22:21:31.975602 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:31.975581    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq"]
Jul 09 22:21:31.978025 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:21:31.978001    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea68cd1_ed8c_40ec_ac0c_a991bb9f3fa5.slice/crio-d295fe583d5d859955f4eff76fcae09705e1d4d4d48183d09762136d9c8067c6 WatchSource:0}: Error finding container d295fe583d5d859955f4eff76fcae09705e1d4d4d48183d09762136d9c8067c6: Status 404 returned error can't find the container with id d295fe583d5d859955f4eff76fcae09705e1d4d4d48183d09762136d9c8067c6
Jul 09 22:21:32.870976 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:32.870883    2583 generic.go:356] "Generic (PLEG): container finished" podID="5452aadf-5325-4e2e-922e-084ae83a7354" containerID="1b7078131a7af1edee7b6743917acd94304d7a3ab52ff50ab8eed7ec06f4f23d" exitCode=0
Jul 09 22:21:32.871425 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:32.870968    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c" event={"ID":"5452aadf-5325-4e2e-922e-084ae83a7354","Type":"ContainerDied","Data":"1b7078131a7af1edee7b6743917acd94304d7a3ab52ff50ab8eed7ec06f4f23d"}
Jul 09 22:21:32.871425 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:32.871019    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c" event={"ID":"5452aadf-5325-4e2e-922e-084ae83a7354","Type":"ContainerStarted","Data":"40dc98a8a899228556bb7c0b0f32bd845f3b2e28c16cb52ee9ca85e9f6ff13f0"}
Jul 09 22:21:32.872860 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:32.872828    2583 generic.go:356] "Generic (PLEG): container finished" podID="a822043d-5651-4b43-b1a9-2c25312b98f6" containerID="7c0d23a07d0328bcf0320a809c24f049d0e043cd648b53e26e460ebdb3c533cc" exitCode=0
Jul 09 22:21:32.872968 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:32.872906    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv" event={"ID":"a822043d-5651-4b43-b1a9-2c25312b98f6","Type":"ContainerDied","Data":"7c0d23a07d0328bcf0320a809c24f049d0e043cd648b53e26e460ebdb3c533cc"}
Jul 09 22:21:32.874422 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:32.874410    2583 generic.go:356] "Generic (PLEG): container finished" podID="eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5" containerID="5009d1f979e02f4a493ff2977a9104b0b32233f02326480ad1610c3a07a799b6" exitCode=0
Jul 09 22:21:32.874530 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:32.874484    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq" event={"ID":"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5","Type":"ContainerDied","Data":"5009d1f979e02f4a493ff2977a9104b0b32233f02326480ad1610c3a07a799b6"}
Jul 09 22:21:32.874530 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:32.874519    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq" event={"ID":"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5","Type":"ContainerStarted","Data":"d295fe583d5d859955f4eff76fcae09705e1d4d4d48183d09762136d9c8067c6"}
Jul 09 22:21:32.876046 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:32.876027    2583 generic.go:356] "Generic (PLEG): container finished" podID="0e08fa27-c33d-49bc-8993-d80a398c3776" containerID="22cd2b07b6b0624d826b1bbdf81eca9caf39a42dcb2bdc1da7ab8844239f1240" exitCode=0
Jul 09 22:21:32.876158 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:32.876073    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7" event={"ID":"0e08fa27-c33d-49bc-8993-d80a398c3776","Type":"ContainerDied","Data":"22cd2b07b6b0624d826b1bbdf81eca9caf39a42dcb2bdc1da7ab8844239f1240"}
Jul 09 22:21:33.883387 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:33.883348    2583 generic.go:356] "Generic (PLEG): container finished" podID="5452aadf-5325-4e2e-922e-084ae83a7354" containerID="729b0f724d763f6e9232138cf63c35a06350de41f411b83c4205dfd87bb10507" exitCode=0
Jul 09 22:21:33.883811 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:33.883449    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c" event={"ID":"5452aadf-5325-4e2e-922e-084ae83a7354","Type":"ContainerDied","Data":"729b0f724d763f6e9232138cf63c35a06350de41f411b83c4205dfd87bb10507"}
Jul 09 22:21:33.885985 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:33.885958    2583 generic.go:356] "Generic (PLEG): container finished" podID="a822043d-5651-4b43-b1a9-2c25312b98f6" containerID="95028917ddf990c5313db90f9f0ab55b4ab280e41a26b479a204319159f2e40f" exitCode=0
Jul 09 22:21:33.886060 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:33.886031    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv" event={"ID":"a822043d-5651-4b43-b1a9-2c25312b98f6","Type":"ContainerDied","Data":"95028917ddf990c5313db90f9f0ab55b4ab280e41a26b479a204319159f2e40f"}
Jul 09 22:21:34.892929 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:34.892892    2583 generic.go:356] "Generic (PLEG): container finished" podID="5452aadf-5325-4e2e-922e-084ae83a7354" containerID="ec727b9ff9e49913f1816bb5867852794ab8dfb192447187ecafa8960cdcb991" exitCode=0
Jul 09 22:21:34.893370 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:34.892936    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c" event={"ID":"5452aadf-5325-4e2e-922e-084ae83a7354","Type":"ContainerDied","Data":"ec727b9ff9e49913f1816bb5867852794ab8dfb192447187ecafa8960cdcb991"}
Jul 09 22:21:34.895001 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:34.894977    2583 generic.go:356] "Generic (PLEG): container finished" podID="eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5" containerID="c03d00a738fe852b7c4f544e5556f0145a83f8719609fc1397e55d87af28b38a" exitCode=0
Jul 09 22:21:34.895130 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:34.895061    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq" event={"ID":"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5","Type":"ContainerDied","Data":"c03d00a738fe852b7c4f544e5556f0145a83f8719609fc1397e55d87af28b38a"}
Jul 09 22:21:34.896932 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:34.896910    2583 generic.go:356] "Generic (PLEG): container finished" podID="0e08fa27-c33d-49bc-8993-d80a398c3776" containerID="75204493137e1b7462d57d95cca30d2cbaee60011082acb35875d6757dd5de9e" exitCode=0
Jul 09 22:21:34.897030 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:34.896991    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7" event={"ID":"0e08fa27-c33d-49bc-8993-d80a398c3776","Type":"ContainerDied","Data":"75204493137e1b7462d57d95cca30d2cbaee60011082acb35875d6757dd5de9e"}
Jul 09 22:21:35.046529 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.046492    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv"
Jul 09 22:21:35.164223 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.164138    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a822043d-5651-4b43-b1a9-2c25312b98f6-bundle\") pod \"a822043d-5651-4b43-b1a9-2c25312b98f6\" (UID: \"a822043d-5651-4b43-b1a9-2c25312b98f6\") "
Jul 09 22:21:35.164223 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.164173    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a822043d-5651-4b43-b1a9-2c25312b98f6-util\") pod \"a822043d-5651-4b43-b1a9-2c25312b98f6\" (UID: \"a822043d-5651-4b43-b1a9-2c25312b98f6\") "
Jul 09 22:21:35.164389 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.164230    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmlf2\" (UniqueName: \"kubernetes.io/projected/a822043d-5651-4b43-b1a9-2c25312b98f6-kube-api-access-dmlf2\") pod \"a822043d-5651-4b43-b1a9-2c25312b98f6\" (UID: \"a822043d-5651-4b43-b1a9-2c25312b98f6\") "
Jul 09 22:21:35.164876 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.164848    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a822043d-5651-4b43-b1a9-2c25312b98f6-bundle" (OuterVolumeSpecName: "bundle") pod "a822043d-5651-4b43-b1a9-2c25312b98f6" (UID: "a822043d-5651-4b43-b1a9-2c25312b98f6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:35.166522 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.166501    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a822043d-5651-4b43-b1a9-2c25312b98f6-kube-api-access-dmlf2" (OuterVolumeSpecName: "kube-api-access-dmlf2") pod "a822043d-5651-4b43-b1a9-2c25312b98f6" (UID: "a822043d-5651-4b43-b1a9-2c25312b98f6"). InnerVolumeSpecName "kube-api-access-dmlf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:21:35.170036 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.170011    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a822043d-5651-4b43-b1a9-2c25312b98f6-util" (OuterVolumeSpecName: "util") pod "a822043d-5651-4b43-b1a9-2c25312b98f6" (UID: "a822043d-5651-4b43-b1a9-2c25312b98f6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:35.265439 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.265406    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmlf2\" (UniqueName: \"kubernetes.io/projected/a822043d-5651-4b43-b1a9-2c25312b98f6-kube-api-access-dmlf2\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:21:35.265439 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.265433    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a822043d-5651-4b43-b1a9-2c25312b98f6-bundle\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:21:35.265439 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.265444    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a822043d-5651-4b43-b1a9-2c25312b98f6-util\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:21:35.903479 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.903441    2583 generic.go:356] "Generic (PLEG): container finished" podID="eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5" containerID="f740b0b4e97ece56b1f39596cd0c491236801bca826465b89825102c1a54da06" exitCode=0
Jul 09 22:21:35.903894 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.903480    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq" event={"ID":"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5","Type":"ContainerDied","Data":"f740b0b4e97ece56b1f39596cd0c491236801bca826465b89825102c1a54da06"}
Jul 09 22:21:35.905437 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.905415    2583 generic.go:356] "Generic (PLEG): container finished" podID="0e08fa27-c33d-49bc-8993-d80a398c3776" containerID="22f359ca41ba6da19b55d9b87fe98d1f7507d38b01b5166a9369048c44f2142d" exitCode=0
Jul 09 22:21:35.905558 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.905502    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7" event={"ID":"0e08fa27-c33d-49bc-8993-d80a398c3776","Type":"ContainerDied","Data":"22f359ca41ba6da19b55d9b87fe98d1f7507d38b01b5166a9369048c44f2142d"}
Jul 09 22:21:35.907328 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.907308    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv" event={"ID":"a822043d-5651-4b43-b1a9-2c25312b98f6","Type":"ContainerDied","Data":"286eacab78dc102b06c98f2f3b85a0dd631b51aa0a40f004738770f84af836ef"}
Jul 09 22:21:35.907328 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.907333    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv"
Jul 09 22:21:35.907466 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:35.907347    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="286eacab78dc102b06c98f2f3b85a0dd631b51aa0a40f004738770f84af836ef"
Jul 09 22:21:36.039954 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:36.039927    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c"
Jul 09 22:21:36.173782 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:36.173676    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5452aadf-5325-4e2e-922e-084ae83a7354-bundle\") pod \"5452aadf-5325-4e2e-922e-084ae83a7354\" (UID: \"5452aadf-5325-4e2e-922e-084ae83a7354\") "
Jul 09 22:21:36.173782 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:36.173728    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5452aadf-5325-4e2e-922e-084ae83a7354-util\") pod \"5452aadf-5325-4e2e-922e-084ae83a7354\" (UID: \"5452aadf-5325-4e2e-922e-084ae83a7354\") "
Jul 09 22:21:36.174023 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:36.173802    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7qxf\" (UniqueName: \"kubernetes.io/projected/5452aadf-5325-4e2e-922e-084ae83a7354-kube-api-access-z7qxf\") pod \"5452aadf-5325-4e2e-922e-084ae83a7354\" (UID: \"5452aadf-5325-4e2e-922e-084ae83a7354\") "
Jul 09 22:21:36.174278 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:36.174255    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5452aadf-5325-4e2e-922e-084ae83a7354-bundle" (OuterVolumeSpecName: "bundle") pod "5452aadf-5325-4e2e-922e-084ae83a7354" (UID: "5452aadf-5325-4e2e-922e-084ae83a7354"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:36.175977 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:36.175953    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5452aadf-5325-4e2e-922e-084ae83a7354-kube-api-access-z7qxf" (OuterVolumeSpecName: "kube-api-access-z7qxf") pod "5452aadf-5325-4e2e-922e-084ae83a7354" (UID: "5452aadf-5325-4e2e-922e-084ae83a7354"). InnerVolumeSpecName "kube-api-access-z7qxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:21:36.179340 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:36.179315    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5452aadf-5325-4e2e-922e-084ae83a7354-util" (OuterVolumeSpecName: "util") pod "5452aadf-5325-4e2e-922e-084ae83a7354" (UID: "5452aadf-5325-4e2e-922e-084ae83a7354"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:36.275078 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:36.275027    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7qxf\" (UniqueName: \"kubernetes.io/projected/5452aadf-5325-4e2e-922e-084ae83a7354-kube-api-access-z7qxf\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:21:36.275078 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:36.275069    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5452aadf-5325-4e2e-922e-084ae83a7354-bundle\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:21:36.275078 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:36.275080    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5452aadf-5325-4e2e-922e-084ae83a7354-util\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:21:36.919876 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:36.919841    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c"
Jul 09 22:21:36.919876 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:36.919852    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c" event={"ID":"5452aadf-5325-4e2e-922e-084ae83a7354","Type":"ContainerDied","Data":"40dc98a8a899228556bb7c0b0f32bd845f3b2e28c16cb52ee9ca85e9f6ff13f0"}
Jul 09 22:21:36.920400 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:36.919923    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40dc98a8a899228556bb7c0b0f32bd845f3b2e28c16cb52ee9ca85e9f6ff13f0"
Jul 09 22:21:37.067360 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.067329    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq"
Jul 09 22:21:37.098550 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.098523    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7"
Jul 09 22:21:37.183057 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.182968    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e08fa27-c33d-49bc-8993-d80a398c3776-util\") pod \"0e08fa27-c33d-49bc-8993-d80a398c3776\" (UID: \"0e08fa27-c33d-49bc-8993-d80a398c3776\") "
Jul 09 22:21:37.183057 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.183013    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r79zg\" (UniqueName: \"kubernetes.io/projected/0e08fa27-c33d-49bc-8993-d80a398c3776-kube-api-access-r79zg\") pod \"0e08fa27-c33d-49bc-8993-d80a398c3776\" (UID: \"0e08fa27-c33d-49bc-8993-d80a398c3776\") "
Jul 09 22:21:37.183291 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.183071    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-util\") pod \"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5\" (UID: \"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5\") "
Jul 09 22:21:37.183291 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.183143    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-bundle\") pod \"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5\" (UID: \"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5\") "
Jul 09 22:21:37.183291 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.183159    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wf8n\" (UniqueName: \"kubernetes.io/projected/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-kube-api-access-9wf8n\") pod \"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5\" (UID: \"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5\") "
Jul 09 22:21:37.183291 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.183178    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e08fa27-c33d-49bc-8993-d80a398c3776-bundle\") pod \"0e08fa27-c33d-49bc-8993-d80a398c3776\" (UID: \"0e08fa27-c33d-49bc-8993-d80a398c3776\") "
Jul 09 22:21:37.183761 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.183724    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e08fa27-c33d-49bc-8993-d80a398c3776-bundle" (OuterVolumeSpecName: "bundle") pod "0e08fa27-c33d-49bc-8993-d80a398c3776" (UID: "0e08fa27-c33d-49bc-8993-d80a398c3776"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:37.183882 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.183780    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-bundle" (OuterVolumeSpecName: "bundle") pod "eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5" (UID: "eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:37.185345 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.185314    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-kube-api-access-9wf8n" (OuterVolumeSpecName: "kube-api-access-9wf8n") pod "eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5" (UID: "eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5"). InnerVolumeSpecName "kube-api-access-9wf8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:21:37.185435 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.185422    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e08fa27-c33d-49bc-8993-d80a398c3776-kube-api-access-r79zg" (OuterVolumeSpecName: "kube-api-access-r79zg") pod "0e08fa27-c33d-49bc-8993-d80a398c3776" (UID: "0e08fa27-c33d-49bc-8993-d80a398c3776"). InnerVolumeSpecName "kube-api-access-r79zg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:21:37.189428 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.189358    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e08fa27-c33d-49bc-8993-d80a398c3776-util" (OuterVolumeSpecName: "util") pod "0e08fa27-c33d-49bc-8993-d80a398c3776" (UID: "0e08fa27-c33d-49bc-8993-d80a398c3776"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:37.189623 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.189602    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-util" (OuterVolumeSpecName: "util") pod "eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5" (UID: "eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:21:37.284325 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.284287    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e08fa27-c33d-49bc-8993-d80a398c3776-util\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:21:37.284325 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.284318    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r79zg\" (UniqueName: \"kubernetes.io/projected/0e08fa27-c33d-49bc-8993-d80a398c3776-kube-api-access-r79zg\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:21:37.284325 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.284328    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-util\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:21:37.284554 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.284337    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-bundle\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:21:37.284554 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.284346    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wf8n\" (UniqueName: \"kubernetes.io/projected/eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5-kube-api-access-9wf8n\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:21:37.284554 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.284355    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e08fa27-c33d-49bc-8993-d80a398c3776-bundle\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:21:37.926183 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.926149    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq"
Jul 09 22:21:37.926630 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.926143    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq" event={"ID":"eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5","Type":"ContainerDied","Data":"d295fe583d5d859955f4eff76fcae09705e1d4d4d48183d09762136d9c8067c6"}
Jul 09 22:21:37.926630 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.926289    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d295fe583d5d859955f4eff76fcae09705e1d4d4d48183d09762136d9c8067c6"
Jul 09 22:21:37.928068 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.928042    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7" event={"ID":"0e08fa27-c33d-49bc-8993-d80a398c3776","Type":"ContainerDied","Data":"36011d296f21ec81a0e3c0568b3544c7117a875df12797a439f254173f855839"}
Jul 09 22:21:37.928215 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.928081    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7"
Jul 09 22:21:37.928215 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:37.928108    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36011d296f21ec81a0e3c0568b3544c7117a875df12797a439f254173f855839"
Jul 09 22:21:57.673227 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673182    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5"]
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673592    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5" containerName="util"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673610    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5" containerName="util"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673622    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e08fa27-c33d-49bc-8993-d80a398c3776" containerName="pull"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673630    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e08fa27-c33d-49bc-8993-d80a398c3776" containerName="pull"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673639    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e08fa27-c33d-49bc-8993-d80a398c3776" containerName="extract"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673647    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e08fa27-c33d-49bc-8993-d80a398c3776" containerName="extract"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673666    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5" containerName="pull"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673673    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5" containerName="pull"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673692    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e08fa27-c33d-49bc-8993-d80a398c3776" containerName="util"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673699    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e08fa27-c33d-49bc-8993-d80a398c3776" containerName="util"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673707    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a822043d-5651-4b43-b1a9-2c25312b98f6" containerName="pull"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673714    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a822043d-5651-4b43-b1a9-2c25312b98f6" containerName="pull"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673724    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5452aadf-5325-4e2e-922e-084ae83a7354" containerName="util"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673731    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5452aadf-5325-4e2e-922e-084ae83a7354" containerName="util"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673740    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a822043d-5651-4b43-b1a9-2c25312b98f6" containerName="extract"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673747    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a822043d-5651-4b43-b1a9-2c25312b98f6" containerName="extract"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673758    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5452aadf-5325-4e2e-922e-084ae83a7354" containerName="pull"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673765    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5452aadf-5325-4e2e-922e-084ae83a7354" containerName="pull"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673774    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5452aadf-5325-4e2e-922e-084ae83a7354" containerName="extract"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673782    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5452aadf-5325-4e2e-922e-084ae83a7354" containerName="extract"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673800    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a822043d-5651-4b43-b1a9-2c25312b98f6" containerName="util"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673807    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a822043d-5651-4b43-b1a9-2c25312b98f6" containerName="util"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673815    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5" containerName="extract"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673823    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5" containerName="extract"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673928    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5" containerName="extract"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673939    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e08fa27-c33d-49bc-8993-d80a398c3776" containerName="extract"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673947    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a822043d-5651-4b43-b1a9-2c25312b98f6" containerName="extract"
Jul 09 22:21:57.674123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.673956    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5452aadf-5325-4e2e-922e-084ae83a7354" containerName="extract"
Jul 09 22:21:57.677030 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.677011    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5"
Jul 09 22:21:57.679463 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.679441    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 09 22:21:57.679571 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.679488    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 09 22:21:57.679571 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.679447    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 22:21:57.679571 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.679453    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fkpk4\""
Jul 09 22:21:57.679973 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.679958    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 22:21:57.685509 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.685487    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5"]
Jul 09 22:21:57.764516 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.764481    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42eab3e4-e848-4085-a974-a91e444330da-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lnkr5\" (UID: \"42eab3e4-e848-4085-a974-a91e444330da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5"
Jul 09 22:21:57.764516 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.764519    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6p4k\" (UniqueName: \"kubernetes.io/projected/42eab3e4-e848-4085-a974-a91e444330da-kube-api-access-m6p4k\") pod \"kuadrant-console-plugin-66b5774985-lnkr5\" (UID: \"42eab3e4-e848-4085-a974-a91e444330da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5"
Jul 09 22:21:57.764749 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.764556    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42eab3e4-e848-4085-a974-a91e444330da-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lnkr5\" (UID: \"42eab3e4-e848-4085-a974-a91e444330da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5"
Jul 09 22:21:57.865020 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.864983    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42eab3e4-e848-4085-a974-a91e444330da-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lnkr5\" (UID: \"42eab3e4-e848-4085-a974-a91e444330da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5"
Jul 09 22:21:57.865217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.865047    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42eab3e4-e848-4085-a974-a91e444330da-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lnkr5\" (UID: \"42eab3e4-e848-4085-a974-a91e444330da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5"
Jul 09 22:21:57.865217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.865070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6p4k\" (UniqueName: \"kubernetes.io/projected/42eab3e4-e848-4085-a974-a91e444330da-kube-api-access-m6p4k\") pod \"kuadrant-console-plugin-66b5774985-lnkr5\" (UID: \"42eab3e4-e848-4085-a974-a91e444330da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5"
Jul 09 22:21:57.865217 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:21:57.865194    2583 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 09 22:21:57.865325 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:21:57.865281    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42eab3e4-e848-4085-a974-a91e444330da-plugin-serving-cert podName:42eab3e4-e848-4085-a974-a91e444330da nodeName:}" failed. No retries permitted until 2026-07-09 22:21:58.365261051 +0000 UTC m=+686.444030715 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/42eab3e4-e848-4085-a974-a91e444330da-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-lnkr5" (UID: "42eab3e4-e848-4085-a974-a91e444330da") : secret "plugin-serving-cert" not found
Jul 09 22:21:57.865639 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.865622    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/42eab3e4-e848-4085-a974-a91e444330da-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lnkr5\" (UID: \"42eab3e4-e848-4085-a974-a91e444330da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5"
Jul 09 22:21:57.874249 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:57.874218    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6p4k\" (UniqueName: \"kubernetes.io/projected/42eab3e4-e848-4085-a974-a91e444330da-kube-api-access-m6p4k\") pod \"kuadrant-console-plugin-66b5774985-lnkr5\" (UID: \"42eab3e4-e848-4085-a974-a91e444330da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5"
Jul 09 22:21:58.369544 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:58.369504    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42eab3e4-e848-4085-a974-a91e444330da-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lnkr5\" (UID: \"42eab3e4-e848-4085-a974-a91e444330da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5"
Jul 09 22:21:58.371877 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:58.371854    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/42eab3e4-e848-4085-a974-a91e444330da-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lnkr5\" (UID: \"42eab3e4-e848-4085-a974-a91e444330da\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5"
Jul 09 22:21:58.587370 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:58.587336    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5"
Jul 09 22:21:58.739296 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:58.739273    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5"]
Jul 09 22:21:58.741253 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:21:58.741220    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42eab3e4_e848_4085_a974_a91e444330da.slice/crio-63fec2efe8168c210c69722fdac3a799c1f367792a22d6dbc31a7b972e9b0ba9 WatchSource:0}: Error finding container 63fec2efe8168c210c69722fdac3a799c1f367792a22d6dbc31a7b972e9b0ba9: Status 404 returned error can't find the container with id 63fec2efe8168c210c69722fdac3a799c1f367792a22d6dbc31a7b972e9b0ba9
Jul 09 22:21:59.025045 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:21:59.024960    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5" event={"ID":"42eab3e4-e848-4085-a974-a91e444330da","Type":"ContainerStarted","Data":"63fec2efe8168c210c69722fdac3a799c1f367792a22d6dbc31a7b972e9b0ba9"}
Jul 09 22:22:21.146183 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:21.146143    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5" event={"ID":"42eab3e4-e848-4085-a974-a91e444330da","Type":"ContainerStarted","Data":"739b3f791f25d0361081573588ec50618df049744cd752257c8b5ff15a3c5d52"}
Jul 09 22:22:21.163993 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:21.163940    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lnkr5" podStartSLOduration=1.8708651710000002 podStartE2EDuration="24.163922792s" totalImagesPullingTime="22.293057621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:21:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:22:21.162219404 +0000 UTC m=+709.240989082" watchObservedRunningTime="2026-07-09 22:22:21.163922792 +0000 UTC m=+709.242692471"
Jul 09 22:22:42.310972 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:42.310895    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-9cpgc"]
Jul 09 22:22:42.464367 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:42.464326    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9cpgc"]
Jul 09 22:22:42.464520 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:42.464423    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9cpgc"
Jul 09 22:22:42.468332 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:42.468308    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-st2f9\""
Jul 09 22:22:42.521855 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:42.521828    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hrh5t"]
Jul 09 22:22:42.526125 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:42.526102    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcrfx\" (UniqueName: \"kubernetes.io/projected/5fe4d90e-7a2a-48bc-a7da-e142050b8cdc-kube-api-access-rcrfx\") pod \"authorino-58cd955675-9cpgc\" (UID: \"5fe4d90e-7a2a-48bc-a7da-e142050b8cdc\") " pod="kuadrant-system/authorino-58cd955675-9cpgc"
Jul 09 22:22:42.541319 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:42.541295    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hrh5t"]
Jul 09 22:22:42.541445 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:42.541384    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hrh5t"
Jul 09 22:22:42.627586 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:42.627548    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rv9j\" (UniqueName: \"kubernetes.io/projected/56577ce0-80a6-4b09-888b-04eda716fe23-kube-api-access-6rv9j\") pod \"authorino-75d556bd77-hrh5t\" (UID: \"56577ce0-80a6-4b09-888b-04eda716fe23\") " pod="kuadrant-system/authorino-75d556bd77-hrh5t"
Jul 09 22:22:42.627767 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:42.627638    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcrfx\" (UniqueName: \"kubernetes.io/projected/5fe4d90e-7a2a-48bc-a7da-e142050b8cdc-kube-api-access-rcrfx\") pod \"authorino-58cd955675-9cpgc\" (UID: \"5fe4d90e-7a2a-48bc-a7da-e142050b8cdc\") " pod="kuadrant-system/authorino-58cd955675-9cpgc"
Jul 09 22:22:42.636911 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:42.636871    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcrfx\" (UniqueName: \"kubernetes.io/projected/5fe4d90e-7a2a-48bc-a7da-e142050b8cdc-kube-api-access-rcrfx\") pod \"authorino-58cd955675-9cpgc\" (UID: \"5fe4d90e-7a2a-48bc-a7da-e142050b8cdc\") " pod="kuadrant-system/authorino-58cd955675-9cpgc"
Jul 09 22:22:42.728193 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:42.728158    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rv9j\" (UniqueName: \"kubernetes.io/projected/56577ce0-80a6-4b09-888b-04eda716fe23-kube-api-access-6rv9j\") pod \"authorino-75d556bd77-hrh5t\" (UID: \"56577ce0-80a6-4b09-888b-04eda716fe23\") " pod="kuadrant-system/authorino-75d556bd77-hrh5t"
Jul 09 22:22:42.736064 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:42.736031    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rv9j\" (UniqueName: \"kubernetes.io/projected/56577ce0-80a6-4b09-888b-04eda716fe23-kube-api-access-6rv9j\") pod \"authorino-75d556bd77-hrh5t\" (UID: \"56577ce0-80a6-4b09-888b-04eda716fe23\") " pod="kuadrant-system/authorino-75d556bd77-hrh5t"
Jul 09 22:22:42.774037 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:42.773999    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9cpgc"
Jul 09 22:22:42.850845 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:42.850800    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hrh5t"
Jul 09 22:22:42.932818 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:42.932568    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9cpgc"]
Jul 09 22:22:42.938365 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:22:42.938192    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5fe4d90e_7a2a_48bc_a7da_e142050b8cdc.slice/crio-db9152d0f9697acd27d60bc30a1956478d4a2b73eefe79fdd852035f117dfb81 WatchSource:0}: Error finding container db9152d0f9697acd27d60bc30a1956478d4a2b73eefe79fdd852035f117dfb81: Status 404 returned error can't find the container with id db9152d0f9697acd27d60bc30a1956478d4a2b73eefe79fdd852035f117dfb81
Jul 09 22:22:43.011369 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:43.011346    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hrh5t"]
Jul 09 22:22:43.013804 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:22:43.013775    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56577ce0_80a6_4b09_888b_04eda716fe23.slice/crio-986b10f57bf9477d1ffa61885b813202f62841e086709d9f7d26002567b8f8b2 WatchSource:0}: Error finding container 986b10f57bf9477d1ffa61885b813202f62841e086709d9f7d26002567b8f8b2: Status 404 returned error can't find the container with id 986b10f57bf9477d1ffa61885b813202f62841e086709d9f7d26002567b8f8b2
Jul 09 22:22:43.251399 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:43.251312    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9cpgc" event={"ID":"5fe4d90e-7a2a-48bc-a7da-e142050b8cdc","Type":"ContainerStarted","Data":"db9152d0f9697acd27d60bc30a1956478d4a2b73eefe79fdd852035f117dfb81"}
Jul 09 22:22:43.252375 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:43.252351    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hrh5t" event={"ID":"56577ce0-80a6-4b09-888b-04eda716fe23","Type":"ContainerStarted","Data":"986b10f57bf9477d1ffa61885b813202f62841e086709d9f7d26002567b8f8b2"}
Jul 09 22:22:48.292707 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:48.292660    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9cpgc" event={"ID":"5fe4d90e-7a2a-48bc-a7da-e142050b8cdc","Type":"ContainerStarted","Data":"1c7e70ce5468faf39109892e7828dc45d0996d69c11d40193d1910de3d4deb92"}
Jul 09 22:22:48.294379 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:48.294351    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hrh5t" event={"ID":"56577ce0-80a6-4b09-888b-04eda716fe23","Type":"ContainerStarted","Data":"8bd522a44c365177907891ab10f0cdce15cd9e5f4aa679366778d3f4bc622e14"}
Jul 09 22:22:48.306920 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:48.306863    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-9cpgc" podStartSLOduration=1.042973793 podStartE2EDuration="6.306844444s" totalImagesPullingTime="5.263870651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:22:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:22:48.305786982 +0000 UTC m=+736.384556660" watchObservedRunningTime="2026-07-09 22:22:48.306844444 +0000 UTC m=+736.385614122"
Jul 09 22:22:48.322145 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:48.322062    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hrh5t" podStartSLOduration=1.146634939 podStartE2EDuration="6.322043729s" totalImagesPullingTime="5.17540879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:22:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:22:48.321174831 +0000 UTC m=+736.399944512" watchObservedRunningTime="2026-07-09 22:22:48.322043729 +0000 UTC m=+736.400813409"
Jul 09 22:22:48.352057 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:48.352020    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9cpgc"]
Jul 09 22:22:50.304041 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:50.303993    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-9cpgc" podUID="5fe4d90e-7a2a-48bc-a7da-e142050b8cdc" containerName="authorino" containerID="cri-o://1c7e70ce5468faf39109892e7828dc45d0996d69c11d40193d1910de3d4deb92" gracePeriod=30
Jul 09 22:22:50.553467 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:50.553439    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9cpgc"
Jul 09 22:22:50.700344 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:50.700315    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcrfx\" (UniqueName: \"kubernetes.io/projected/5fe4d90e-7a2a-48bc-a7da-e142050b8cdc-kube-api-access-rcrfx\") pod \"5fe4d90e-7a2a-48bc-a7da-e142050b8cdc\" (UID: \"5fe4d90e-7a2a-48bc-a7da-e142050b8cdc\") "
Jul 09 22:22:50.702443 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:50.702412    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fe4d90e-7a2a-48bc-a7da-e142050b8cdc-kube-api-access-rcrfx" (OuterVolumeSpecName: "kube-api-access-rcrfx") pod "5fe4d90e-7a2a-48bc-a7da-e142050b8cdc" (UID: "5fe4d90e-7a2a-48bc-a7da-e142050b8cdc"). InnerVolumeSpecName "kube-api-access-rcrfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:22:50.801424 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:50.801391    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcrfx\" (UniqueName: \"kubernetes.io/projected/5fe4d90e-7a2a-48bc-a7da-e142050b8cdc-kube-api-access-rcrfx\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:22:51.315551 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:51.315513    2583 generic.go:356] "Generic (PLEG): container finished" podID="5fe4d90e-7a2a-48bc-a7da-e142050b8cdc" containerID="1c7e70ce5468faf39109892e7828dc45d0996d69c11d40193d1910de3d4deb92" exitCode=0
Jul 09 22:22:51.315998 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:51.315566    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9cpgc"
Jul 09 22:22:51.315998 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:51.315596    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9cpgc" event={"ID":"5fe4d90e-7a2a-48bc-a7da-e142050b8cdc","Type":"ContainerDied","Data":"1c7e70ce5468faf39109892e7828dc45d0996d69c11d40193d1910de3d4deb92"}
Jul 09 22:22:51.315998 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:51.315640    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9cpgc" event={"ID":"5fe4d90e-7a2a-48bc-a7da-e142050b8cdc","Type":"ContainerDied","Data":"db9152d0f9697acd27d60bc30a1956478d4a2b73eefe79fdd852035f117dfb81"}
Jul 09 22:22:51.315998 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:51.315661    2583 scope.go:117] "RemoveContainer" containerID="1c7e70ce5468faf39109892e7828dc45d0996d69c11d40193d1910de3d4deb92"
Jul 09 22:22:51.324058 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:51.324039    2583 scope.go:117] "RemoveContainer" containerID="1c7e70ce5468faf39109892e7828dc45d0996d69c11d40193d1910de3d4deb92"
Jul 09 22:22:51.324363 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:22:51.324344    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c7e70ce5468faf39109892e7828dc45d0996d69c11d40193d1910de3d4deb92\": container with ID starting with 1c7e70ce5468faf39109892e7828dc45d0996d69c11d40193d1910de3d4deb92 not found: ID does not exist" containerID="1c7e70ce5468faf39109892e7828dc45d0996d69c11d40193d1910de3d4deb92"
Jul 09 22:22:51.324420 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:51.324371    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c7e70ce5468faf39109892e7828dc45d0996d69c11d40193d1910de3d4deb92"} err="failed to get container status \"1c7e70ce5468faf39109892e7828dc45d0996d69c11d40193d1910de3d4deb92\": rpc error: code = NotFound desc = could not find container \"1c7e70ce5468faf39109892e7828dc45d0996d69c11d40193d1910de3d4deb92\": container with ID starting with 1c7e70ce5468faf39109892e7828dc45d0996d69c11d40193d1910de3d4deb92 not found: ID does not exist"
Jul 09 22:22:51.335905 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:51.335879    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9cpgc"]
Jul 09 22:22:51.341474 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:51.341449    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-9cpgc"]
Jul 09 22:22:52.485972 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:22:52.485939    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fe4d90e-7a2a-48bc-a7da-e142050b8cdc" path="/var/lib/kubelet/pods/5fe4d90e-7a2a-48bc-a7da-e142050b8cdc/volumes"
Jul 09 22:23:10.851767 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:10.851726    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5f8s9"]
Jul 09 22:23:10.852266 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:10.852153    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fe4d90e-7a2a-48bc-a7da-e142050b8cdc" containerName="authorino"
Jul 09 22:23:10.852266 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:10.852170    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fe4d90e-7a2a-48bc-a7da-e142050b8cdc" containerName="authorino"
Jul 09 22:23:10.852266 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:10.852262    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fe4d90e-7a2a-48bc-a7da-e142050b8cdc" containerName="authorino"
Jul 09 22:23:10.854824 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:10.854805    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5f8s9"
Jul 09 22:23:10.862150 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:10.862132    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5f8s9"]
Jul 09 22:23:10.868130 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:10.868103    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7hjv\" (UniqueName: \"kubernetes.io/projected/de04573a-9874-4f53-a60b-eb15852b06ef-kube-api-access-r7hjv\") pod \"authorino-5d4b67c446-5f8s9\" (UID: \"de04573a-9874-4f53-a60b-eb15852b06ef\") " pod="kuadrant-system/authorino-5d4b67c446-5f8s9"
Jul 09 22:23:10.969221 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:10.969187    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7hjv\" (UniqueName: \"kubernetes.io/projected/de04573a-9874-4f53-a60b-eb15852b06ef-kube-api-access-r7hjv\") pod \"authorino-5d4b67c446-5f8s9\" (UID: \"de04573a-9874-4f53-a60b-eb15852b06ef\") " pod="kuadrant-system/authorino-5d4b67c446-5f8s9"
Jul 09 22:23:10.976848 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:10.976814    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7hjv\" (UniqueName: \"kubernetes.io/projected/de04573a-9874-4f53-a60b-eb15852b06ef-kube-api-access-r7hjv\") pod \"authorino-5d4b67c446-5f8s9\" (UID: \"de04573a-9874-4f53-a60b-eb15852b06ef\") " pod="kuadrant-system/authorino-5d4b67c446-5f8s9"
Jul 09 22:23:11.029062 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.029027    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5f8s9"]
Jul 09 22:23:11.029289 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.029276    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5f8s9"
Jul 09 22:23:11.062120 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.062066    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-gd6gb"]
Jul 09 22:23:11.065706 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.065685    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-gd6gb"
Jul 09 22:23:11.067802 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.067768    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 09 22:23:11.070980 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.069999    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d7ec95d-a774-4b35-a130-dfec2d66a39c-tls-cert\") pod \"authorino-76877994-gd6gb\" (UID: \"4d7ec95d-a774-4b35-a130-dfec2d66a39c\") " pod="kuadrant-system/authorino-76877994-gd6gb"
Jul 09 22:23:11.071123 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.070977    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q9mm\" (UniqueName: \"kubernetes.io/projected/4d7ec95d-a774-4b35-a130-dfec2d66a39c-kube-api-access-4q9mm\") pod \"authorino-76877994-gd6gb\" (UID: \"4d7ec95d-a774-4b35-a130-dfec2d66a39c\") " pod="kuadrant-system/authorino-76877994-gd6gb"
Jul 09 22:23:11.071642 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.071618    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-gd6gb"]
Jul 09 22:23:11.118672 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.118641    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-gd6gb"]
Jul 09 22:23:11.118923 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:23:11.118901    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4q9mm tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-gd6gb" podUID="4d7ec95d-a774-4b35-a130-dfec2d66a39c"
Jul 09 22:23:11.144809 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.144775    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66955956c4-h667b"]
Jul 09 22:23:11.147942 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.147915    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66955956c4-h667b"
Jul 09 22:23:11.157820 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.157793    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66955956c4-h667b"]
Jul 09 22:23:11.170950 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.170928    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5f8s9"]
Jul 09 22:23:11.171624 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.171598    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q9mm\" (UniqueName: \"kubernetes.io/projected/4d7ec95d-a774-4b35-a130-dfec2d66a39c-kube-api-access-4q9mm\") pod \"authorino-76877994-gd6gb\" (UID: \"4d7ec95d-a774-4b35-a130-dfec2d66a39c\") " pod="kuadrant-system/authorino-76877994-gd6gb"
Jul 09 22:23:11.171705 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.171687    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptrck\" (UniqueName: \"kubernetes.io/projected/fc7fb92d-9195-44ca-a977-14cdc4e9d14b-kube-api-access-ptrck\") pod \"authorino-66955956c4-h667b\" (UID: \"fc7fb92d-9195-44ca-a977-14cdc4e9d14b\") " pod="kuadrant-system/authorino-66955956c4-h667b"
Jul 09 22:23:11.171760 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.171745    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d7ec95d-a774-4b35-a130-dfec2d66a39c-tls-cert\") pod \"authorino-76877994-gd6gb\" (UID: \"4d7ec95d-a774-4b35-a130-dfec2d66a39c\") " pod="kuadrant-system/authorino-76877994-gd6gb"
Jul 09 22:23:11.171812 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.171793    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc7fb92d-9195-44ca-a977-14cdc4e9d14b-tls-cert\") pod \"authorino-66955956c4-h667b\" (UID: \"fc7fb92d-9195-44ca-a977-14cdc4e9d14b\") " pod="kuadrant-system/authorino-66955956c4-h667b"
Jul 09 22:23:11.173271 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:23:11.173248    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde04573a_9874_4f53_a60b_eb15852b06ef.slice/crio-42f25acfeb294b92bc20041c87185ddccf586c3f77c2ea2fba498159562df9a7 WatchSource:0}: Error finding container 42f25acfeb294b92bc20041c87185ddccf586c3f77c2ea2fba498159562df9a7: Status 404 returned error can't find the container with id 42f25acfeb294b92bc20041c87185ddccf586c3f77c2ea2fba498159562df9a7
Jul 09 22:23:11.174246 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.174225    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d7ec95d-a774-4b35-a130-dfec2d66a39c-tls-cert\") pod \"authorino-76877994-gd6gb\" (UID: \"4d7ec95d-a774-4b35-a130-dfec2d66a39c\") " pod="kuadrant-system/authorino-76877994-gd6gb"
Jul 09 22:23:11.180285 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.180253    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q9mm\" (UniqueName: \"kubernetes.io/projected/4d7ec95d-a774-4b35-a130-dfec2d66a39c-kube-api-access-4q9mm\") pod \"authorino-76877994-gd6gb\" (UID: \"4d7ec95d-a774-4b35-a130-dfec2d66a39c\") " pod="kuadrant-system/authorino-76877994-gd6gb"
Jul 09 22:23:11.272428 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.272383    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptrck\" (UniqueName: \"kubernetes.io/projected/fc7fb92d-9195-44ca-a977-14cdc4e9d14b-kube-api-access-ptrck\") pod \"authorino-66955956c4-h667b\" (UID: \"fc7fb92d-9195-44ca-a977-14cdc4e9d14b\") " pod="kuadrant-system/authorino-66955956c4-h667b"
Jul 09 22:23:11.272635 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.272455    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc7fb92d-9195-44ca-a977-14cdc4e9d14b-tls-cert\") pod \"authorino-66955956c4-h667b\" (UID: \"fc7fb92d-9195-44ca-a977-14cdc4e9d14b\") " pod="kuadrant-system/authorino-66955956c4-h667b"
Jul 09 22:23:11.274967 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.274941    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc7fb92d-9195-44ca-a977-14cdc4e9d14b-tls-cert\") pod \"authorino-66955956c4-h667b\" (UID: \"fc7fb92d-9195-44ca-a977-14cdc4e9d14b\") " pod="kuadrant-system/authorino-66955956c4-h667b"
Jul 09 22:23:11.280899 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.280871    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptrck\" (UniqueName: \"kubernetes.io/projected/fc7fb92d-9195-44ca-a977-14cdc4e9d14b-kube-api-access-ptrck\") pod \"authorino-66955956c4-h667b\" (UID: \"fc7fb92d-9195-44ca-a977-14cdc4e9d14b\") " pod="kuadrant-system/authorino-66955956c4-h667b"
Jul 09 22:23:11.414276 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.414246    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5f8s9" event={"ID":"de04573a-9874-4f53-a60b-eb15852b06ef","Type":"ContainerStarted","Data":"42f25acfeb294b92bc20041c87185ddccf586c3f77c2ea2fba498159562df9a7"}
Jul 09 22:23:11.414276 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.414267    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-gd6gb"
Jul 09 22:23:11.421932 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.421904    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-gd6gb"
Jul 09 22:23:11.458017 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.457982    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66955956c4-h667b"
Jul 09 22:23:11.473823 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.473797    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d7ec95d-a774-4b35-a130-dfec2d66a39c-tls-cert\") pod \"4d7ec95d-a774-4b35-a130-dfec2d66a39c\" (UID: \"4d7ec95d-a774-4b35-a130-dfec2d66a39c\") "
Jul 09 22:23:11.473937 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.473837    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4q9mm\" (UniqueName: \"kubernetes.io/projected/4d7ec95d-a774-4b35-a130-dfec2d66a39c-kube-api-access-4q9mm\") pod \"4d7ec95d-a774-4b35-a130-dfec2d66a39c\" (UID: \"4d7ec95d-a774-4b35-a130-dfec2d66a39c\") "
Jul 09 22:23:11.475961 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.475935    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d7ec95d-a774-4b35-a130-dfec2d66a39c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4d7ec95d-a774-4b35-a130-dfec2d66a39c" (UID: "4d7ec95d-a774-4b35-a130-dfec2d66a39c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:23:11.476061 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.475991    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d7ec95d-a774-4b35-a130-dfec2d66a39c-kube-api-access-4q9mm" (OuterVolumeSpecName: "kube-api-access-4q9mm") pod "4d7ec95d-a774-4b35-a130-dfec2d66a39c" (UID: "4d7ec95d-a774-4b35-a130-dfec2d66a39c"). InnerVolumeSpecName "kube-api-access-4q9mm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:23:11.574423 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.574390    2583 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4d7ec95d-a774-4b35-a130-dfec2d66a39c-tls-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:23:11.574423 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.574419    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4q9mm\" (UniqueName: \"kubernetes.io/projected/4d7ec95d-a774-4b35-a130-dfec2d66a39c-kube-api-access-4q9mm\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:23:11.596655 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:11.596629    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66955956c4-h667b"]
Jul 09 22:23:11.599752 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:23:11.599717    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc7fb92d_9195_44ca_a977_14cdc4e9d14b.slice/crio-10d4510588e83cd73caad0971adbc2855d0b93528a951bff8c25bbfc40b1f8d5 WatchSource:0}: Error finding container 10d4510588e83cd73caad0971adbc2855d0b93528a951bff8c25bbfc40b1f8d5: Status 404 returned error can't find the container with id 10d4510588e83cd73caad0971adbc2855d0b93528a951bff8c25bbfc40b1f8d5
Jul 09 22:23:12.420419 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.420387    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5f8s9" event={"ID":"de04573a-9874-4f53-a60b-eb15852b06ef","Type":"ContainerStarted","Data":"088456269f2cc21b7943bfcf5ef5cf6c34148abb0ced3a74ef54bfac1e143474"}
Jul 09 22:23:12.420419 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.420382    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-5f8s9" podUID="de04573a-9874-4f53-a60b-eb15852b06ef" containerName="authorino" containerID="cri-o://088456269f2cc21b7943bfcf5ef5cf6c34148abb0ced3a74ef54bfac1e143474" gracePeriod=30
Jul 09 22:23:12.422113 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.422070    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66955956c4-h667b" event={"ID":"fc7fb92d-9195-44ca-a977-14cdc4e9d14b","Type":"ContainerStarted","Data":"740f0dbcfa5ca7d29dcdd5af5b7cf10c3a9705015ab86a5819a15f84ddfb024d"}
Jul 09 22:23:12.422264 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.422118    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-gd6gb"
Jul 09 22:23:12.422264 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.422121    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66955956c4-h667b" event={"ID":"fc7fb92d-9195-44ca-a977-14cdc4e9d14b","Type":"ContainerStarted","Data":"10d4510588e83cd73caad0971adbc2855d0b93528a951bff8c25bbfc40b1f8d5"}
Jul 09 22:23:12.435890 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.435847    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-5f8s9" podStartSLOduration=2.079415106 podStartE2EDuration="2.435830658s" totalImagesPullingTime="356.415552ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:23:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:23:12.434571862 +0000 UTC m=+760.513341540" watchObservedRunningTime="2026-07-09 22:23:12.435830658 +0000 UTC m=+760.514600388"
Jul 09 22:23:12.456577 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.456548    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-gd6gb"]
Jul 09 22:23:12.460490 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.460462    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-gd6gb"]
Jul 09 22:23:12.474679 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.474622    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66955956c4-h667b" podStartSLOduration=1.031773608 podStartE2EDuration="1.474606887s" totalImagesPullingTime="442.833279ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:23:12.472646934 +0000 UTC m=+760.551416614" watchObservedRunningTime="2026-07-09 22:23:12.474606887 +0000 UTC m=+760.553376565"
Jul 09 22:23:12.487616 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.487589    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d7ec95d-a774-4b35-a130-dfec2d66a39c" path="/var/lib/kubelet/pods/4d7ec95d-a774-4b35-a130-dfec2d66a39c/volumes"
Jul 09 22:23:12.500869 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.500840    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hrh5t"]
Jul 09 22:23:12.501047 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.501025    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hrh5t" podUID="56577ce0-80a6-4b09-888b-04eda716fe23" containerName="authorino" containerID="cri-o://8bd522a44c365177907891ab10f0cdce15cd9e5f4aa679366778d3f4bc622e14" gracePeriod=30
Jul 09 22:23:12.749765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.749741    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5f8s9"
Jul 09 22:23:12.756770 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.756748    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hrh5t"
Jul 09 22:23:12.784118 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.784026    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rv9j\" (UniqueName: \"kubernetes.io/projected/56577ce0-80a6-4b09-888b-04eda716fe23-kube-api-access-6rv9j\") pod \"56577ce0-80a6-4b09-888b-04eda716fe23\" (UID: \"56577ce0-80a6-4b09-888b-04eda716fe23\") "
Jul 09 22:23:12.784118 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.784122    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7hjv\" (UniqueName: \"kubernetes.io/projected/de04573a-9874-4f53-a60b-eb15852b06ef-kube-api-access-r7hjv\") pod \"de04573a-9874-4f53-a60b-eb15852b06ef\" (UID: \"de04573a-9874-4f53-a60b-eb15852b06ef\") "
Jul 09 22:23:12.786519 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.786490    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de04573a-9874-4f53-a60b-eb15852b06ef-kube-api-access-r7hjv" (OuterVolumeSpecName: "kube-api-access-r7hjv") pod "de04573a-9874-4f53-a60b-eb15852b06ef" (UID: "de04573a-9874-4f53-a60b-eb15852b06ef"). InnerVolumeSpecName "kube-api-access-r7hjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:23:12.786627 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.786549    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56577ce0-80a6-4b09-888b-04eda716fe23-kube-api-access-6rv9j" (OuterVolumeSpecName: "kube-api-access-6rv9j") pod "56577ce0-80a6-4b09-888b-04eda716fe23" (UID: "56577ce0-80a6-4b09-888b-04eda716fe23"). InnerVolumeSpecName "kube-api-access-6rv9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:23:12.885342 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.885308    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rv9j\" (UniqueName: \"kubernetes.io/projected/56577ce0-80a6-4b09-888b-04eda716fe23-kube-api-access-6rv9j\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:23:12.885342 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:12.885337    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7hjv\" (UniqueName: \"kubernetes.io/projected/de04573a-9874-4f53-a60b-eb15852b06ef-kube-api-access-r7hjv\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:23:13.427984 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.427953    2583 generic.go:356] "Generic (PLEG): container finished" podID="56577ce0-80a6-4b09-888b-04eda716fe23" containerID="8bd522a44c365177907891ab10f0cdce15cd9e5f4aa679366778d3f4bc622e14" exitCode=0
Jul 09 22:23:13.428421 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.427999    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hrh5t"
Jul 09 22:23:13.428421 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.428042    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hrh5t" event={"ID":"56577ce0-80a6-4b09-888b-04eda716fe23","Type":"ContainerDied","Data":"8bd522a44c365177907891ab10f0cdce15cd9e5f4aa679366778d3f4bc622e14"}
Jul 09 22:23:13.428421 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.428081    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hrh5t" event={"ID":"56577ce0-80a6-4b09-888b-04eda716fe23","Type":"ContainerDied","Data":"986b10f57bf9477d1ffa61885b813202f62841e086709d9f7d26002567b8f8b2"}
Jul 09 22:23:13.428421 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.428125    2583 scope.go:117] "RemoveContainer" containerID="8bd522a44c365177907891ab10f0cdce15cd9e5f4aa679366778d3f4bc622e14"
Jul 09 22:23:13.432606 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.432458    2583 generic.go:356] "Generic (PLEG): container finished" podID="de04573a-9874-4f53-a60b-eb15852b06ef" containerID="088456269f2cc21b7943bfcf5ef5cf6c34148abb0ced3a74ef54bfac1e143474" exitCode=0
Jul 09 22:23:13.432606 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.432508    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5f8s9"
Jul 09 22:23:13.432606 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.432548    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5f8s9" event={"ID":"de04573a-9874-4f53-a60b-eb15852b06ef","Type":"ContainerDied","Data":"088456269f2cc21b7943bfcf5ef5cf6c34148abb0ced3a74ef54bfac1e143474"}
Jul 09 22:23:13.432765 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.432612    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5f8s9" event={"ID":"de04573a-9874-4f53-a60b-eb15852b06ef","Type":"ContainerDied","Data":"42f25acfeb294b92bc20041c87185ddccf586c3f77c2ea2fba498159562df9a7"}
Jul 09 22:23:13.441005 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.440980    2583 scope.go:117] "RemoveContainer" containerID="8bd522a44c365177907891ab10f0cdce15cd9e5f4aa679366778d3f4bc622e14"
Jul 09 22:23:13.441432 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:23:13.441385    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bd522a44c365177907891ab10f0cdce15cd9e5f4aa679366778d3f4bc622e14\": container with ID starting with 8bd522a44c365177907891ab10f0cdce15cd9e5f4aa679366778d3f4bc622e14 not found: ID does not exist" containerID="8bd522a44c365177907891ab10f0cdce15cd9e5f4aa679366778d3f4bc622e14"
Jul 09 22:23:13.441536 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.441444    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bd522a44c365177907891ab10f0cdce15cd9e5f4aa679366778d3f4bc622e14"} err="failed to get container status \"8bd522a44c365177907891ab10f0cdce15cd9e5f4aa679366778d3f4bc622e14\": rpc error: code = NotFound desc = could not find container \"8bd522a44c365177907891ab10f0cdce15cd9e5f4aa679366778d3f4bc622e14\": container with ID starting with 8bd522a44c365177907891ab10f0cdce15cd9e5f4aa679366778d3f4bc622e14 not found: ID does not exist"
Jul 09 22:23:13.441536 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.441466    2583 scope.go:117] "RemoveContainer" containerID="088456269f2cc21b7943bfcf5ef5cf6c34148abb0ced3a74ef54bfac1e143474"
Jul 09 22:23:13.450281 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.450262    2583 scope.go:117] "RemoveContainer" containerID="088456269f2cc21b7943bfcf5ef5cf6c34148abb0ced3a74ef54bfac1e143474"
Jul 09 22:23:13.450580 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:23:13.450555    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"088456269f2cc21b7943bfcf5ef5cf6c34148abb0ced3a74ef54bfac1e143474\": container with ID starting with 088456269f2cc21b7943bfcf5ef5cf6c34148abb0ced3a74ef54bfac1e143474 not found: ID does not exist" containerID="088456269f2cc21b7943bfcf5ef5cf6c34148abb0ced3a74ef54bfac1e143474"
Jul 09 22:23:13.450644 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.450594    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"088456269f2cc21b7943bfcf5ef5cf6c34148abb0ced3a74ef54bfac1e143474"} err="failed to get container status \"088456269f2cc21b7943bfcf5ef5cf6c34148abb0ced3a74ef54bfac1e143474\": rpc error: code = NotFound desc = could not find container \"088456269f2cc21b7943bfcf5ef5cf6c34148abb0ced3a74ef54bfac1e143474\": container with ID starting with 088456269f2cc21b7943bfcf5ef5cf6c34148abb0ced3a74ef54bfac1e143474 not found: ID does not exist"
Jul 09 22:23:13.451199 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.451069    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hrh5t"]
Jul 09 22:23:13.453014 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.452994    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hrh5t"]
Jul 09 22:23:13.466041 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.466010    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5f8s9"]
Jul 09 22:23:13.470990 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:13.470964    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5f8s9"]
Jul 09 22:23:14.485573 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:14.485544    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56577ce0-80a6-4b09-888b-04eda716fe23" path="/var/lib/kubelet/pods/56577ce0-80a6-4b09-888b-04eda716fe23/volumes"
Jul 09 22:23:14.485954 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:14.485853    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de04573a-9874-4f53-a60b-eb15852b06ef" path="/var/lib/kubelet/pods/de04573a-9874-4f53-a60b-eb15852b06ef/volumes"
Jul 09 22:23:56.837433 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:56.837350    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zf9j9"]
Jul 09 22:23:56.837844 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:56.837647    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56577ce0-80a6-4b09-888b-04eda716fe23" containerName="authorino"
Jul 09 22:23:56.837844 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:56.837658    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="56577ce0-80a6-4b09-888b-04eda716fe23" containerName="authorino"
Jul 09 22:23:56.837844 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:56.837670    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de04573a-9874-4f53-a60b-eb15852b06ef" containerName="authorino"
Jul 09 22:23:56.837844 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:56.837676    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="de04573a-9874-4f53-a60b-eb15852b06ef" containerName="authorino"
Jul 09 22:23:56.837844 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:56.837732    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="56577ce0-80a6-4b09-888b-04eda716fe23" containerName="authorino"
Jul 09 22:23:56.837844 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:56.837743    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="de04573a-9874-4f53-a60b-eb15852b06ef" containerName="authorino"
Jul 09 22:23:56.840249 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:56.840232    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zf9j9"
Jul 09 22:23:56.843144 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:56.843118    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 22:23:56.843274 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:56.843147    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-sqs6v\""
Jul 09 22:23:56.849455 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:56.849430    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zf9j9"]
Jul 09 22:23:56.936197 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:56.936161    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0245a63a-3c62-4d8e-ba25-c5bbe80c16d3-plugins-config-volume\") pod \"payload-processing-58f86c7798-zf9j9\" (UID: \"0245a63a-3c62-4d8e-ba25-c5bbe80c16d3\") " pod="openshift-ingress/payload-processing-58f86c7798-zf9j9"
Jul 09 22:23:56.936367 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:56.936272    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmk7j\" (UniqueName: \"kubernetes.io/projected/0245a63a-3c62-4d8e-ba25-c5bbe80c16d3-kube-api-access-dmk7j\") pod \"payload-processing-58f86c7798-zf9j9\" (UID: \"0245a63a-3c62-4d8e-ba25-c5bbe80c16d3\") " pod="openshift-ingress/payload-processing-58f86c7798-zf9j9"
Jul 09 22:23:57.037583 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:57.037539    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmk7j\" (UniqueName: \"kubernetes.io/projected/0245a63a-3c62-4d8e-ba25-c5bbe80c16d3-kube-api-access-dmk7j\") pod \"payload-processing-58f86c7798-zf9j9\" (UID: \"0245a63a-3c62-4d8e-ba25-c5bbe80c16d3\") " pod="openshift-ingress/payload-processing-58f86c7798-zf9j9"
Jul 09 22:23:57.037780 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:57.037599    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0245a63a-3c62-4d8e-ba25-c5bbe80c16d3-plugins-config-volume\") pod \"payload-processing-58f86c7798-zf9j9\" (UID: \"0245a63a-3c62-4d8e-ba25-c5bbe80c16d3\") " pod="openshift-ingress/payload-processing-58f86c7798-zf9j9"
Jul 09 22:23:57.038270 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:57.038250    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0245a63a-3c62-4d8e-ba25-c5bbe80c16d3-plugins-config-volume\") pod \"payload-processing-58f86c7798-zf9j9\" (UID: \"0245a63a-3c62-4d8e-ba25-c5bbe80c16d3\") " pod="openshift-ingress/payload-processing-58f86c7798-zf9j9"
Jul 09 22:23:57.046079 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:57.046049    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmk7j\" (UniqueName: \"kubernetes.io/projected/0245a63a-3c62-4d8e-ba25-c5bbe80c16d3-kube-api-access-dmk7j\") pod \"payload-processing-58f86c7798-zf9j9\" (UID: \"0245a63a-3c62-4d8e-ba25-c5bbe80c16d3\") " pod="openshift-ingress/payload-processing-58f86c7798-zf9j9"
Jul 09 22:23:57.151417 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:57.151379    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zf9j9"
Jul 09 22:23:57.283949 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:57.283918    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zf9j9"]
Jul 09 22:23:57.286557 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:23:57.286523    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0245a63a_3c62_4d8e_ba25_c5bbe80c16d3.slice/crio-2345586ebf0be3966a1f770770d1133cc43cc69eaf04bb11cae041db9c323e46 WatchSource:0}: Error finding container 2345586ebf0be3966a1f770770d1133cc43cc69eaf04bb11cae041db9c323e46: Status 404 returned error can't find the container with id 2345586ebf0be3966a1f770770d1133cc43cc69eaf04bb11cae041db9c323e46
Jul 09 22:23:57.637811 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:57.637775    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zf9j9" event={"ID":"0245a63a-3c62-4d8e-ba25-c5bbe80c16d3","Type":"ContainerStarted","Data":"2345586ebf0be3966a1f770770d1133cc43cc69eaf04bb11cae041db9c323e46"}
Jul 09 22:23:59.649453 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:59.649419    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zf9j9" event={"ID":"0245a63a-3c62-4d8e-ba25-c5bbe80c16d3","Type":"ContainerStarted","Data":"8733f67cbd4c6315388f25eba11772235a45c2dfbd05e16609c9409592c25f22"}
Jul 09 22:23:59.649893 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:59.649499    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-zf9j9"
Jul 09 22:23:59.669237 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:23:59.669190    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-zf9j9" podStartSLOduration=2.190179953 podStartE2EDuration="3.669173496s" totalImagesPullingTime="1.478993543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:23:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:23:59.667701531 +0000 UTC m=+807.746471210" watchObservedRunningTime="2026-07-09 22:23:59.669173496 +0000 UTC m=+807.747943174"
Jul 09 22:24:10.657244 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:10.657214    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-zf9j9"
Jul 09 22:24:30.908864 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:30.908829    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"]
Jul 09 22:24:30.911219 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:30.911200    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:30.913932 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:30.913904    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jn279\""
Jul 09 22:24:30.914067 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:30.913950    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 22:24:30.914067 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:30.913904    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 09 22:24:30.914067 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:30.913911    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 22:24:30.921787 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:30.921764    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"]
Jul 09 22:24:30.994173 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:30.994133    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab460e94-214e-427e-b205-29cdef2602e9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:30.994173 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:30.994178    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w5zl\" (UniqueName: \"kubernetes.io/projected/ab460e94-214e-427e-b205-29cdef2602e9-kube-api-access-4w5zl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:30.994394 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:30.994263    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab460e94-214e-427e-b205-29cdef2602e9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:30.994394 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:30.994311    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab460e94-214e-427e-b205-29cdef2602e9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:30.994394 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:30.994360    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab460e94-214e-427e-b205-29cdef2602e9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:30.994394 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:30.994386    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab460e94-214e-427e-b205-29cdef2602e9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:31.095721 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:31.095680    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab460e94-214e-427e-b205-29cdef2602e9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:31.095721 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:31.095725    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5zl\" (UniqueName: \"kubernetes.io/projected/ab460e94-214e-427e-b205-29cdef2602e9-kube-api-access-4w5zl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:31.095937 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:31.095764    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab460e94-214e-427e-b205-29cdef2602e9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:31.095937 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:31.095778    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab460e94-214e-427e-b205-29cdef2602e9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:31.095937 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:31.095807    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab460e94-214e-427e-b205-29cdef2602e9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:31.096079 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:31.095979    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab460e94-214e-427e-b205-29cdef2602e9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:31.096168 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:31.096130    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab460e94-214e-427e-b205-29cdef2602e9-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:31.096265 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:31.096247    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab460e94-214e-427e-b205-29cdef2602e9-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:31.096348 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:31.096331    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab460e94-214e-427e-b205-29cdef2602e9-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:31.098101 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:31.098074    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab460e94-214e-427e-b205-29cdef2602e9-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:31.098272 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:31.098256    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab460e94-214e-427e-b205-29cdef2602e9-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:31.103397 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:31.103377    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w5zl\" (UniqueName: \"kubernetes.io/projected/ab460e94-214e-427e-b205-29cdef2602e9-kube-api-access-4w5zl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-x49fx\" (UID: \"ab460e94-214e-427e-b205-29cdef2602e9\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:31.225637 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:31.225540    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:31.359374 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:31.359348    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"]
Jul 09 22:24:31.361784 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:24:31.361749    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab460e94_214e_427e_b205_29cdef2602e9.slice/crio-97b9428b22d9abdcf175dca9f067dc1e2f8624ebf316522b9fc54ec5368dfd6a WatchSource:0}: Error finding container 97b9428b22d9abdcf175dca9f067dc1e2f8624ebf316522b9fc54ec5368dfd6a: Status 404 returned error can't find the container with id 97b9428b22d9abdcf175dca9f067dc1e2f8624ebf316522b9fc54ec5368dfd6a
Jul 09 22:24:31.807145 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:31.806722    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx" event={"ID":"ab460e94-214e-427e-b205-29cdef2602e9","Type":"ContainerStarted","Data":"97b9428b22d9abdcf175dca9f067dc1e2f8624ebf316522b9fc54ec5368dfd6a"}
Jul 09 22:24:32.819131 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:32.819017    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx" event={"ID":"ab460e94-214e-427e-b205-29cdef2602e9","Type":"ContainerStarted","Data":"a657cd4abf092a33d28f1d1d126a8e2eeecf82674ffafaeedbc8d1c9148835f3"}
Jul 09 22:24:32.836633 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:32.836578    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx" podStartSLOduration=1.780228747 podStartE2EDuration="2.836561249s" totalImagesPullingTime="1.056332502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:24:32.835241262 +0000 UTC m=+840.914010943" watchObservedRunningTime="2026-07-09 22:24:32.836561249 +0000 UTC m=+840.915330927"
Jul 09 22:24:41.226278 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:41.226225    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:41.226278 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:41.226294    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:41.239189 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:41.239162    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:24:41.875659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:24:41.875632    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-x49fx"
Jul 09 22:25:23.708327 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.708248    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"]
Jul 09 22:25:23.711837 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.711814    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.714018 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.713999    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 09 22:25:23.722278 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.721981    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"]
Jul 09 22:25:23.738976 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.738948    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr85t\" (UniqueName: \"kubernetes.io/projected/21862395-6d5b-4981-bd4b-4a60712414a1-kube-api-access-cr85t\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.739117 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.738989    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21862395-6d5b-4981-bd4b-4a60712414a1-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.739117 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.739012    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21862395-6d5b-4981-bd4b-4a60712414a1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.739199 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.739117    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21862395-6d5b-4981-bd4b-4a60712414a1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.739199 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.739161    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21862395-6d5b-4981-bd4b-4a60712414a1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.739269 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.739245    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21862395-6d5b-4981-bd4b-4a60712414a1-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.839949 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.839906    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21862395-6d5b-4981-bd4b-4a60712414a1-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.840182 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.839968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr85t\" (UniqueName: \"kubernetes.io/projected/21862395-6d5b-4981-bd4b-4a60712414a1-kube-api-access-cr85t\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.840182 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.840013    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21862395-6d5b-4981-bd4b-4a60712414a1-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.840182 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.840034    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21862395-6d5b-4981-bd4b-4a60712414a1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.840360 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.840246    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21862395-6d5b-4981-bd4b-4a60712414a1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.840360 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.840292    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21862395-6d5b-4981-bd4b-4a60712414a1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.840486 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.840462    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21862395-6d5b-4981-bd4b-4a60712414a1-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.840550 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.840532    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21862395-6d5b-4981-bd4b-4a60712414a1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.840695 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.840669    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21862395-6d5b-4981-bd4b-4a60712414a1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.842321 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.842300    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21862395-6d5b-4981-bd4b-4a60712414a1-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.842660 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.842641    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21862395-6d5b-4981-bd4b-4a60712414a1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:23.848160 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:23.848133    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr85t\" (UniqueName: \"kubernetes.io/projected/21862395-6d5b-4981-bd4b-4a60712414a1-kube-api-access-cr85t\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm\" (UID: \"21862395-6d5b-4981-bd4b-4a60712414a1\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:24.038818 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:24.038723    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:24.172913 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:24.172888    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"]
Jul 09 22:25:24.175525 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:25:24.175501    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21862395_6d5b_4981_bd4b_4a60712414a1.slice/crio-b1f4476f4d4f308afec0e27d35fcec7607b0332ca02373df5d2092c4827f9095 WatchSource:0}: Error finding container b1f4476f4d4f308afec0e27d35fcec7607b0332ca02373df5d2092c4827f9095: Status 404 returned error can't find the container with id b1f4476f4d4f308afec0e27d35fcec7607b0332ca02373df5d2092c4827f9095
Jul 09 22:25:25.075284 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:25.075241    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm" event={"ID":"21862395-6d5b-4981-bd4b-4a60712414a1","Type":"ContainerStarted","Data":"d28eed37ab072cd6ad9b5a999878ed7131ad91f2efcdcd7c79c15476f6b2a28f"}
Jul 09 22:25:25.075284 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:25.075285    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm" event={"ID":"21862395-6d5b-4981-bd4b-4a60712414a1","Type":"ContainerStarted","Data":"b1f4476f4d4f308afec0e27d35fcec7607b0332ca02373df5d2092c4827f9095"}
Jul 09 22:25:25.098808 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:25.098745    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm" podStartSLOduration=1.935041848 podStartE2EDuration="2.098727237s" totalImagesPullingTime="163.685389ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:25:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:25:25.09691536 +0000 UTC m=+893.175685038" watchObservedRunningTime="2026-07-09 22:25:25.098727237 +0000 UTC m=+893.177496916"
Jul 09 22:25:34.039402 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:34.039356    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:34.039922 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:34.039419    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:34.052136 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:34.052082    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:25:34.130550 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:25:34.130520    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm"
Jul 09 22:26:25.365491 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:25.365455    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54c4b46f95-24mqz"]
Jul 09 22:26:25.368584 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:25.368567    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c4b46f95-24mqz"
Jul 09 22:26:25.378327 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:25.378300    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54c4b46f95-24mqz"]
Jul 09 22:26:25.462394 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:25.462349    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4947k\" (UniqueName: \"kubernetes.io/projected/786d7b05-17f0-4395-86e1-26d4b92a5b9c-kube-api-access-4947k\") pod \"authorino-54c4b46f95-24mqz\" (UID: \"786d7b05-17f0-4395-86e1-26d4b92a5b9c\") " pod="kuadrant-system/authorino-54c4b46f95-24mqz"
Jul 09 22:26:25.462576 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:25.462458    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/786d7b05-17f0-4395-86e1-26d4b92a5b9c-tls-cert\") pod \"authorino-54c4b46f95-24mqz\" (UID: \"786d7b05-17f0-4395-86e1-26d4b92a5b9c\") " pod="kuadrant-system/authorino-54c4b46f95-24mqz"
Jul 09 22:26:25.563213 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:25.563174    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/786d7b05-17f0-4395-86e1-26d4b92a5b9c-tls-cert\") pod \"authorino-54c4b46f95-24mqz\" (UID: \"786d7b05-17f0-4395-86e1-26d4b92a5b9c\") " pod="kuadrant-system/authorino-54c4b46f95-24mqz"
Jul 09 22:26:25.563409 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:25.563349    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4947k\" (UniqueName: \"kubernetes.io/projected/786d7b05-17f0-4395-86e1-26d4b92a5b9c-kube-api-access-4947k\") pod \"authorino-54c4b46f95-24mqz\" (UID: \"786d7b05-17f0-4395-86e1-26d4b92a5b9c\") " pod="kuadrant-system/authorino-54c4b46f95-24mqz"
Jul 09 22:26:25.565742 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:25.565712    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/786d7b05-17f0-4395-86e1-26d4b92a5b9c-tls-cert\") pod \"authorino-54c4b46f95-24mqz\" (UID: \"786d7b05-17f0-4395-86e1-26d4b92a5b9c\") " pod="kuadrant-system/authorino-54c4b46f95-24mqz"
Jul 09 22:26:25.572372 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:25.572345    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4947k\" (UniqueName: \"kubernetes.io/projected/786d7b05-17f0-4395-86e1-26d4b92a5b9c-kube-api-access-4947k\") pod \"authorino-54c4b46f95-24mqz\" (UID: \"786d7b05-17f0-4395-86e1-26d4b92a5b9c\") " pod="kuadrant-system/authorino-54c4b46f95-24mqz"
Jul 09 22:26:25.678112 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:25.678043    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54c4b46f95-24mqz"
Jul 09 22:26:25.830907 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:25.830873    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54c4b46f95-24mqz"]
Jul 09 22:26:25.833535 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:26:25.833502    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod786d7b05_17f0_4395_86e1_26d4b92a5b9c.slice/crio-4072436e76c23450ee9518fce9fa1b6998f0e84c21a6f512cf39f0b7e369e56e WatchSource:0}: Error finding container 4072436e76c23450ee9518fce9fa1b6998f0e84c21a6f512cf39f0b7e369e56e: Status 404 returned error can't find the container with id 4072436e76c23450ee9518fce9fa1b6998f0e84c21a6f512cf39f0b7e369e56e
Jul 09 22:26:26.368699 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:26.368667    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c4b46f95-24mqz" event={"ID":"786d7b05-17f0-4395-86e1-26d4b92a5b9c","Type":"ContainerStarted","Data":"4072436e76c23450ee9518fce9fa1b6998f0e84c21a6f512cf39f0b7e369e56e"}
Jul 09 22:26:27.378354 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:27.378312    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54c4b46f95-24mqz" event={"ID":"786d7b05-17f0-4395-86e1-26d4b92a5b9c","Type":"ContainerStarted","Data":"7fae249147776d698c0e5913513bec53ba2624ca272ca5c7827902400fe8f48c"}
Jul 09 22:26:27.394678 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:27.394611    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54c4b46f95-24mqz" podStartSLOduration=1.8937675280000001 podStartE2EDuration="2.394592177s" totalImagesPullingTime="500.824649ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:26:27.394077876 +0000 UTC m=+955.472847556" watchObservedRunningTime="2026-07-09 22:26:27.394592177 +0000 UTC m=+955.473361856"
Jul 09 22:26:27.426772 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:27.426731    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66955956c4-h667b"]
Jul 09 22:26:27.427263 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:27.427228    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-66955956c4-h667b" podUID="fc7fb92d-9195-44ca-a977-14cdc4e9d14b" containerName="authorino" containerID="cri-o://740f0dbcfa5ca7d29dcdd5af5b7cf10c3a9705015ab86a5819a15f84ddfb024d" gracePeriod=30
Jul 09 22:26:27.686580 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:27.686550    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66955956c4-h667b"
Jul 09 22:26:27.783325 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:27.783292    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc7fb92d-9195-44ca-a977-14cdc4e9d14b-tls-cert\") pod \"fc7fb92d-9195-44ca-a977-14cdc4e9d14b\" (UID: \"fc7fb92d-9195-44ca-a977-14cdc4e9d14b\") "
Jul 09 22:26:27.783494 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:27.783358    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptrck\" (UniqueName: \"kubernetes.io/projected/fc7fb92d-9195-44ca-a977-14cdc4e9d14b-kube-api-access-ptrck\") pod \"fc7fb92d-9195-44ca-a977-14cdc4e9d14b\" (UID: \"fc7fb92d-9195-44ca-a977-14cdc4e9d14b\") "
Jul 09 22:26:27.785491 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:27.785455    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc7fb92d-9195-44ca-a977-14cdc4e9d14b-kube-api-access-ptrck" (OuterVolumeSpecName: "kube-api-access-ptrck") pod "fc7fb92d-9195-44ca-a977-14cdc4e9d14b" (UID: "fc7fb92d-9195-44ca-a977-14cdc4e9d14b"). InnerVolumeSpecName "kube-api-access-ptrck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:26:27.793788 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:27.793753    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc7fb92d-9195-44ca-a977-14cdc4e9d14b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fc7fb92d-9195-44ca-a977-14cdc4e9d14b" (UID: "fc7fb92d-9195-44ca-a977-14cdc4e9d14b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:26:27.884612 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:27.884568    2583 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc7fb92d-9195-44ca-a977-14cdc4e9d14b-tls-cert\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:26:27.884612 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:27.884603    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptrck\" (UniqueName: \"kubernetes.io/projected/fc7fb92d-9195-44ca-a977-14cdc4e9d14b-kube-api-access-ptrck\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:26:28.385181 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:28.385141    2583 generic.go:356] "Generic (PLEG): container finished" podID="fc7fb92d-9195-44ca-a977-14cdc4e9d14b" containerID="740f0dbcfa5ca7d29dcdd5af5b7cf10c3a9705015ab86a5819a15f84ddfb024d" exitCode=0
Jul 09 22:26:28.385776 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:28.385754    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66955956c4-h667b"
Jul 09 22:26:28.393835 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:28.393790    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66955956c4-h667b" event={"ID":"fc7fb92d-9195-44ca-a977-14cdc4e9d14b","Type":"ContainerDied","Data":"740f0dbcfa5ca7d29dcdd5af5b7cf10c3a9705015ab86a5819a15f84ddfb024d"}
Jul 09 22:26:28.394060 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:28.393864    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66955956c4-h667b" event={"ID":"fc7fb92d-9195-44ca-a977-14cdc4e9d14b","Type":"ContainerDied","Data":"10d4510588e83cd73caad0971adbc2855d0b93528a951bff8c25bbfc40b1f8d5"}
Jul 09 22:26:28.394060 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:28.393890    2583 scope.go:117] "RemoveContainer" containerID="740f0dbcfa5ca7d29dcdd5af5b7cf10c3a9705015ab86a5819a15f84ddfb024d"
Jul 09 22:26:28.416358 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:28.416329    2583 scope.go:117] "RemoveContainer" containerID="740f0dbcfa5ca7d29dcdd5af5b7cf10c3a9705015ab86a5819a15f84ddfb024d"
Jul 09 22:26:28.416776 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:26:28.416742    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"740f0dbcfa5ca7d29dcdd5af5b7cf10c3a9705015ab86a5819a15f84ddfb024d\": container with ID starting with 740f0dbcfa5ca7d29dcdd5af5b7cf10c3a9705015ab86a5819a15f84ddfb024d not found: ID does not exist" containerID="740f0dbcfa5ca7d29dcdd5af5b7cf10c3a9705015ab86a5819a15f84ddfb024d"
Jul 09 22:26:28.416862 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:28.416789    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"740f0dbcfa5ca7d29dcdd5af5b7cf10c3a9705015ab86a5819a15f84ddfb024d"} err="failed to get container status \"740f0dbcfa5ca7d29dcdd5af5b7cf10c3a9705015ab86a5819a15f84ddfb024d\": rpc error: code = NotFound desc = could not find container \"740f0dbcfa5ca7d29dcdd5af5b7cf10c3a9705015ab86a5819a15f84ddfb024d\": container with ID starting with 740f0dbcfa5ca7d29dcdd5af5b7cf10c3a9705015ab86a5819a15f84ddfb024d not found: ID does not exist"
Jul 09 22:26:28.417428 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:28.417400    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66955956c4-h667b"]
Jul 09 22:26:28.423171 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:28.423135    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-66955956c4-h667b"]
Jul 09 22:26:28.485986 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:26:28.485956    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc7fb92d-9195-44ca-a977-14cdc4e9d14b" path="/var/lib/kubelet/pods/fc7fb92d-9195-44ca-a977-14cdc4e9d14b/volumes"
Jul 09 22:46:19.367349 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.367306    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"]
Jul 09 22:46:19.367810 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.367621    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc7fb92d-9195-44ca-a977-14cdc4e9d14b" containerName="authorino"
Jul 09 22:46:19.367810 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.367632    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc7fb92d-9195-44ca-a977-14cdc4e9d14b" containerName="authorino"
Jul 09 22:46:19.367810 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.367697    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc7fb92d-9195-44ca-a977-14cdc4e9d14b" containerName="authorino"
Jul 09 22:46:19.370571 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.370554    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.373573 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.373550    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-eb6719bd\"/\"kube-root-ca.crt\""
Jul 09 22:46:19.373709 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.373573    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-eb6719bd\"/\"e2e-lifecycle-model-eb6719bd-kserve-self-signed-certs\""
Jul 09 22:46:19.373709 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.373589    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-eb6719bd\"/\"openshift-service-ca.crt\""
Jul 09 22:46:19.373709 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.373551    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-eb6719bd\"/\"default-dockercfg-rm946\""
Jul 09 22:46:19.386284 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.386248    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"]
Jul 09 22:46:19.447689 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.447654    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-tmp-dir\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.447689 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.447700    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpjnz\" (UniqueName: \"kubernetes.io/projected/35984d77-af5a-499b-89eb-561a6a30fdb5-kube-api-access-zpjnz\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.447916 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.447781    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-home\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.447916 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.447832    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35984d77-af5a-499b-89eb-561a6a30fdb5-tls-certs\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.447916 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.447859    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-model-cache\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.447916 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.447896    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-dshm\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.549265 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.549227    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35984d77-af5a-499b-89eb-561a6a30fdb5-tls-certs\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.549265 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.549271    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-model-cache\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.549504 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.549298    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-dshm\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.549504 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.549382    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-tmp-dir\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.549504 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.549415    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpjnz\" (UniqueName: \"kubernetes.io/projected/35984d77-af5a-499b-89eb-561a6a30fdb5-kube-api-access-zpjnz\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.549504 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.549450    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-home\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.549788 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.549710    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-model-cache\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.549788 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.549754    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-tmp-dir\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.549917 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.549845    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-home\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.551760 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.551727    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-dshm\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.551951 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.551934    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35984d77-af5a-499b-89eb-561a6a30fdb5-tls-certs\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.557482 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.557457    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpjnz\" (UniqueName: \"kubernetes.io/projected/35984d77-af5a-499b-89eb-561a6a30fdb5-kube-api-access-zpjnz\") pod \"e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") " pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.679978 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.679917    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:19.815179 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:19.815151    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"]
Jul 09 22:46:19.817028 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:46:19.816995    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35984d77_af5a_499b_89eb_561a6a30fdb5.slice/crio-cd756c7ee54c717d38fc26e75423d390ac805b9a2c728e7774ab62d3c2253031 WatchSource:0}: Error finding container cd756c7ee54c717d38fc26e75423d390ac805b9a2c728e7774ab62d3c2253031: Status 404 returned error can't find the container with id cd756c7ee54c717d38fc26e75423d390ac805b9a2c728e7774ab62d3c2253031
Jul 09 22:46:20.127425 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:20.127387    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b" event={"ID":"35984d77-af5a-499b-89eb-561a6a30fdb5","Type":"ContainerStarted","Data":"0ed0b74f945dab30b3285f397c818ecb7215d6d16b7f1e682055def7f00ae4d4"}
Jul 09 22:46:20.127703 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:20.127438    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b" event={"ID":"35984d77-af5a-499b-89eb-561a6a30fdb5","Type":"ContainerStarted","Data":"cd756c7ee54c717d38fc26e75423d390ac805b9a2c728e7774ab62d3c2253031"}
Jul 09 22:46:20.148152 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:20.148080    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b" podStartSLOduration=1.148062769 podStartE2EDuration="1.148062769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:46:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:46:20.146480629 +0000 UTC m=+2148.225250309" watchObservedRunningTime="2026-07-09 22:46:20.148062769 +0000 UTC m=+2148.226832447"
Jul 09 22:46:29.680197 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:29.680074    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:29.680197 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:29.680162    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:29.692520 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:29.692496    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:46:30.185316 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:46:30.185281    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:47:10.717861 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:10.717825    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"]
Jul 09 22:47:25.737883 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:25.737844    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b" podUID="35984d77-af5a-499b-89eb-561a6a30fdb5" containerName="main" containerID="cri-o://0ed0b74f945dab30b3285f397c818ecb7215d6d16b7f1e682055def7f00ae4d4" gracePeriod=45
Jul 09 22:47:25.989867 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:25.989797    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:47:26.087067 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.087032    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-model-cache\") pod \"35984d77-af5a-499b-89eb-561a6a30fdb5\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") "
Jul 09 22:47:26.087067 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.087067    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-dshm\") pod \"35984d77-af5a-499b-89eb-561a6a30fdb5\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") "
Jul 09 22:47:26.087292 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.087120    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpjnz\" (UniqueName: \"kubernetes.io/projected/35984d77-af5a-499b-89eb-561a6a30fdb5-kube-api-access-zpjnz\") pod \"35984d77-af5a-499b-89eb-561a6a30fdb5\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") "
Jul 09 22:47:26.087292 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.087147    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-home\") pod \"35984d77-af5a-499b-89eb-561a6a30fdb5\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") "
Jul 09 22:47:26.087383 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.087308    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35984d77-af5a-499b-89eb-561a6a30fdb5-tls-certs\") pod \"35984d77-af5a-499b-89eb-561a6a30fdb5\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") "
Jul 09 22:47:26.087383 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.087373    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-home" (OuterVolumeSpecName: "home") pod "35984d77-af5a-499b-89eb-561a6a30fdb5" (UID: "35984d77-af5a-499b-89eb-561a6a30fdb5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:47:26.087486 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.087384    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-model-cache" (OuterVolumeSpecName: "model-cache") pod "35984d77-af5a-499b-89eb-561a6a30fdb5" (UID: "35984d77-af5a-499b-89eb-561a6a30fdb5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:47:26.087486 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.087389    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-tmp-dir\") pod \"35984d77-af5a-499b-89eb-561a6a30fdb5\" (UID: \"35984d77-af5a-499b-89eb-561a6a30fdb5\") "
Jul 09 22:47:26.087595 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.087559    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "35984d77-af5a-499b-89eb-561a6a30fdb5" (UID: "35984d77-af5a-499b-89eb-561a6a30fdb5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:47:26.087723 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.087700    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-model-cache\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:47:26.087782 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.087727    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-home\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:47:26.087782 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.087739    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-tmp-dir\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:47:26.089467 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.089417    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35984d77-af5a-499b-89eb-561a6a30fdb5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "35984d77-af5a-499b-89eb-561a6a30fdb5" (UID: "35984d77-af5a-499b-89eb-561a6a30fdb5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:47:26.089578 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.089495    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-dshm" (OuterVolumeSpecName: "dshm") pod "35984d77-af5a-499b-89eb-561a6a30fdb5" (UID: "35984d77-af5a-499b-89eb-561a6a30fdb5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:47:26.089578 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.089526    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35984d77-af5a-499b-89eb-561a6a30fdb5-kube-api-access-zpjnz" (OuterVolumeSpecName: "kube-api-access-zpjnz") pod "35984d77-af5a-499b-89eb-561a6a30fdb5" (UID: "35984d77-af5a-499b-89eb-561a6a30fdb5"). InnerVolumeSpecName "kube-api-access-zpjnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:47:26.189172 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.189128    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35984d77-af5a-499b-89eb-561a6a30fdb5-dshm\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:47:26.189172 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.189163    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpjnz\" (UniqueName: \"kubernetes.io/projected/35984d77-af5a-499b-89eb-561a6a30fdb5-kube-api-access-zpjnz\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:47:26.189172 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.189173    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35984d77-af5a-499b-89eb-561a6a30fdb5-tls-certs\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:47:26.461888 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.461852    2583 generic.go:356] "Generic (PLEG): container finished" podID="35984d77-af5a-499b-89eb-561a6a30fdb5" containerID="0ed0b74f945dab30b3285f397c818ecb7215d6d16b7f1e682055def7f00ae4d4" exitCode=0
Jul 09 22:47:26.462067 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.461912    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"
Jul 09 22:47:26.462067 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.461928    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b" event={"ID":"35984d77-af5a-499b-89eb-561a6a30fdb5","Type":"ContainerDied","Data":"0ed0b74f945dab30b3285f397c818ecb7215d6d16b7f1e682055def7f00ae4d4"}
Jul 09 22:47:26.462067 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.461966    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b" event={"ID":"35984d77-af5a-499b-89eb-561a6a30fdb5","Type":"ContainerDied","Data":"cd756c7ee54c717d38fc26e75423d390ac805b9a2c728e7774ab62d3c2253031"}
Jul 09 22:47:26.462067 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.461986    2583 scope.go:117] "RemoveContainer" containerID="0ed0b74f945dab30b3285f397c818ecb7215d6d16b7f1e682055def7f00ae4d4"
Jul 09 22:47:26.471296 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.471271    2583 scope.go:117] "RemoveContainer" containerID="0ed0b74f945dab30b3285f397c818ecb7215d6d16b7f1e682055def7f00ae4d4"
Jul 09 22:47:26.471632 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:47:26.471612    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ed0b74f945dab30b3285f397c818ecb7215d6d16b7f1e682055def7f00ae4d4\": container with ID starting with 0ed0b74f945dab30b3285f397c818ecb7215d6d16b7f1e682055def7f00ae4d4 not found: ID does not exist" containerID="0ed0b74f945dab30b3285f397c818ecb7215d6d16b7f1e682055def7f00ae4d4"
Jul 09 22:47:26.471682 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.471643    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ed0b74f945dab30b3285f397c818ecb7215d6d16b7f1e682055def7f00ae4d4"} err="failed to get container status \"0ed0b74f945dab30b3285f397c818ecb7215d6d16b7f1e682055def7f00ae4d4\": rpc error: code = NotFound desc = could not find container \"0ed0b74f945dab30b3285f397c818ecb7215d6d16b7f1e682055def7f00ae4d4\": container with ID starting with 0ed0b74f945dab30b3285f397c818ecb7215d6d16b7f1e682055def7f00ae4d4 not found: ID does not exist"
Jul 09 22:47:26.487873 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.487843    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"]
Jul 09 22:47:26.487873 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:26.487880    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-eb6719bd/e2e-lifecycle-model-eb6719bd-kserve-6b9f6fb87f-p792b"]
Jul 09 22:47:28.486217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:47:28.486184    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35984d77-af5a-499b-89eb-561a6a30fdb5" path="/var/lib/kubelet/pods/35984d77-af5a-499b-89eb-561a6a30fdb5/volumes"
Jul 09 22:52:08.478019 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.477985    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"]
Jul 09 22:52:08.478506 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.478411    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35984d77-af5a-499b-89eb-561a6a30fdb5" containerName="main"
Jul 09 22:52:08.478506 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.478431    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="35984d77-af5a-499b-89eb-561a6a30fdb5" containerName="main"
Jul 09 22:52:08.478506 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.478504    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="35984d77-af5a-499b-89eb-561a6a30fdb5" containerName="main"
Jul 09 22:52:08.481429 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.481405    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"
Jul 09 22:52:08.483768 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.483748    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2qlgm\""
Jul 09 22:52:08.483970 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.483954    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-d2543e-serving-cert\""
Jul 09 22:52:08.484311 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.484293    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 22:52:08.484392 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.484328    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 22:52:08.493542 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.493516    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"]
Jul 09 22:52:08.548571 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.548533    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53f5b0f5-9f59-4736-857e-47ade5e977fc-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7\" (UID: \"53f5b0f5-9f59-4736-857e-47ade5e977fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"
Jul 09 22:52:08.548571 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.548576    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53f5b0f5-9f59-4736-857e-47ade5e977fc-maas-api-tls\") pod \"maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7\" (UID: \"53f5b0f5-9f59-4736-857e-47ade5e977fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"
Jul 09 22:52:08.548785 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.548700    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfbqv\" (UniqueName: \"kubernetes.io/projected/53f5b0f5-9f59-4736-857e-47ade5e977fc-kube-api-access-gfbqv\") pod \"maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7\" (UID: \"53f5b0f5-9f59-4736-857e-47ade5e977fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"
Jul 09 22:52:08.649789 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.649753    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfbqv\" (UniqueName: \"kubernetes.io/projected/53f5b0f5-9f59-4736-857e-47ade5e977fc-kube-api-access-gfbqv\") pod \"maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7\" (UID: \"53f5b0f5-9f59-4736-857e-47ade5e977fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"
Jul 09 22:52:08.649961 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.649802    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53f5b0f5-9f59-4736-857e-47ade5e977fc-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7\" (UID: \"53f5b0f5-9f59-4736-857e-47ade5e977fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"
Jul 09 22:52:08.649961 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.649830    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53f5b0f5-9f59-4736-857e-47ade5e977fc-maas-api-tls\") pod \"maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7\" (UID: \"53f5b0f5-9f59-4736-857e-47ade5e977fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"
Jul 09 22:52:08.649961 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:52:08.649943    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-serving-cert: secret "maas-api-e2e-inf-b-d2543e-serving-cert" not found
Jul 09 22:52:08.650082 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:52:08.650021    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53f5b0f5-9f59-4736-857e-47ade5e977fc-maas-api-tls podName:53f5b0f5-9f59-4736-857e-47ade5e977fc nodeName:}" failed. No retries permitted until 2026-07-09 22:52:09.149999806 +0000 UTC m=+2497.228769463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/53f5b0f5-9f59-4736-857e-47ade5e977fc-maas-api-tls") pod "maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7" (UID: "53f5b0f5-9f59-4736-857e-47ade5e977fc") : secret "maas-api-e2e-inf-b-d2543e-serving-cert" not found
Jul 09 22:52:08.650576 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.650556    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53f5b0f5-9f59-4736-857e-47ade5e977fc-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7\" (UID: \"53f5b0f5-9f59-4736-857e-47ade5e977fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"
Jul 09 22:52:08.659273 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:08.659252    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfbqv\" (UniqueName: \"kubernetes.io/projected/53f5b0f5-9f59-4736-857e-47ade5e977fc-kube-api-access-gfbqv\") pod \"maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7\" (UID: \"53f5b0f5-9f59-4736-857e-47ade5e977fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"
Jul 09 22:52:09.154520 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:09.154475    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53f5b0f5-9f59-4736-857e-47ade5e977fc-maas-api-tls\") pod \"maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7\" (UID: \"53f5b0f5-9f59-4736-857e-47ade5e977fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"
Jul 09 22:52:09.157026 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:09.156997    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53f5b0f5-9f59-4736-857e-47ade5e977fc-maas-api-tls\") pod \"maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7\" (UID: \"53f5b0f5-9f59-4736-857e-47ade5e977fc\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"
Jul 09 22:52:09.393004 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:09.392965    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"
Jul 09 22:52:09.533774 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:09.533747    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"]
Jul 09 22:52:09.536406 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:52:09.536377    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f5b0f5_9f59_4736_857e_47ade5e977fc.slice/crio-b23e18f673c5ba7f09859d53285a5add2465f6f5ee0820a31019d77ad13fdb52 WatchSource:0}: Error finding container b23e18f673c5ba7f09859d53285a5add2465f6f5ee0820a31019d77ad13fdb52: Status 404 returned error can't find the container with id b23e18f673c5ba7f09859d53285a5add2465f6f5ee0820a31019d77ad13fdb52
Jul 09 22:52:09.537673 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:09.537654    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 22:52:09.851674 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:09.851589    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7" event={"ID":"53f5b0f5-9f59-4736-857e-47ade5e977fc","Type":"ContainerStarted","Data":"b23e18f673c5ba7f09859d53285a5add2465f6f5ee0820a31019d77ad13fdb52"}
Jul 09 22:52:11.865369 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:11.865329    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7" event={"ID":"53f5b0f5-9f59-4736-857e-47ade5e977fc","Type":"ContainerStarted","Data":"0ff2eb511b8449342eca0990179d52f50c39c3c517eaca287d5e1ceed5a37a62"}
Jul 09 22:52:11.865783 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:11.865458    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"
Jul 09 22:52:11.881515 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:11.881467    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7" podStartSLOduration=2.315363591 podStartE2EDuration="3.881452649s" totalImagesPullingTime="1.566089058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:52:11.880413728 +0000 UTC m=+2499.959183409" watchObservedRunningTime="2026-07-09 22:52:11.881452649 +0000 UTC m=+2499.960222328"
Jul 09 22:52:17.877429 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:17.877390    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"
Jul 09 22:52:32.308150 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.308063    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"]
Jul 09 22:52:32.311248 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.311231    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.313419 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.313397    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-288815\"/\"openshift-service-ca.crt\""
Jul 09 22:52:32.313522 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.313506    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-288815\"/\"kube-root-ca.crt\""
Jul 09 22:52:32.314198 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.314180    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-288815\"/\"default-dockercfg-576tj\""
Jul 09 22:52:32.314293 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.314256    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-288815\"/\"test-model-288815-kserve-self-signed-certs\""
Jul 09 22:52:32.321285 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.321263    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"]
Jul 09 22:52:32.453359 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.453310    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f312e39b-6f92-4d41-a6c8-992bffa661fb-tls-certs\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.453359 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.453363    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54fkm\" (UniqueName: \"kubernetes.io/projected/f312e39b-6f92-4d41-a6c8-992bffa661fb-kube-api-access-54fkm\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.453602 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.453390    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-model-cache\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.453602 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.453429    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-tmp-dir\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.453602 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.453489    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-dshm\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.453602 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.453515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-home\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.555050 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.555006    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f312e39b-6f92-4d41-a6c8-992bffa661fb-tls-certs\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.555050 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.555053    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54fkm\" (UniqueName: \"kubernetes.io/projected/f312e39b-6f92-4d41-a6c8-992bffa661fb-kube-api-access-54fkm\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.555311 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.555081    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-model-cache\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.555311 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.555147    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-tmp-dir\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.555311 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.555179    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-dshm\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.555311 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.555205    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-home\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.555613 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.555586    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-home\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.555733 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.555621    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-tmp-dir\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.555733 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.555685    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-model-cache\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.557406 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.557387    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-dshm\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.557711 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.557695    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f312e39b-6f92-4d41-a6c8-992bffa661fb-tls-certs\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.565371 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.565314    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54fkm\" (UniqueName: \"kubernetes.io/projected/f312e39b-6f92-4d41-a6c8-992bffa661fb-kube-api-access-54fkm\") pod \"test-model-288815-kserve-5856fc45b5-qvmqx\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") " pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.621577 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.621519    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:32.766550 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.766522    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"]
Jul 09 22:52:32.768868 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:52:32.768842    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf312e39b_6f92_4d41_a6c8_992bffa661fb.slice/crio-3570ea9c36f46355df76301d7c5d9b491c57ebd92f953651967c8a119379e302 WatchSource:0}: Error finding container 3570ea9c36f46355df76301d7c5d9b491c57ebd92f953651967c8a119379e302: Status 404 returned error can't find the container with id 3570ea9c36f46355df76301d7c5d9b491c57ebd92f953651967c8a119379e302
Jul 09 22:52:32.964422 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.964388    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx" event={"ID":"f312e39b-6f92-4d41-a6c8-992bffa661fb","Type":"ContainerStarted","Data":"205d9056b70b8a91cb63ca4f46bd3db771d8d707a7f9e46407b65cb35b9ed725"}
Jul 09 22:52:32.964614 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.964434    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx" event={"ID":"f312e39b-6f92-4d41-a6c8-992bffa661fb","Type":"ContainerStarted","Data":"3570ea9c36f46355df76301d7c5d9b491c57ebd92f953651967c8a119379e302"}
Jul 09 22:52:32.979992 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:32.979937    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx" podStartSLOduration=0.979907395 podStartE2EDuration="979.907395ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:52:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:52:32.979350486 +0000 UTC m=+2521.058120165" watchObservedRunningTime="2026-07-09 22:52:32.979907395 +0000 UTC m=+2521.058677076"
Jul 09 22:52:42.622051 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:42.622009    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:42.622596 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:42.622069    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:42.634595 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:42.634562    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:52:43.024757 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:52:43.024726    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:53:11.296568 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.296535    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"]
Jul 09 22:53:11.299345 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.299328    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.302219 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.302189    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d2543e\"/\"test-model-d2543e-kserve-self-signed-certs\""
Jul 09 22:53:11.302343 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.302190    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d2543e\"/\"kube-root-ca.crt\""
Jul 09 22:53:11.302343 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.302202    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-d2543e\"/\"openshift-service-ca.crt\""
Jul 09 22:53:11.302425 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.302202    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-d2543e\"/\"default-dockercfg-dtzw8\""
Jul 09 22:53:11.310508 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.310484    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"]
Jul 09 22:53:11.400296 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.400254    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-home\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.400296 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.400295    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-tmp-dir\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.400528 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.400395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-dshm\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.400528 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.400437    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75d19a52-1acc-4991-b6d9-68d6e7de81f0-tls-certs\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.400528 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.400490    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc75x\" (UniqueName: \"kubernetes.io/projected/75d19a52-1acc-4991-b6d9-68d6e7de81f0-kube-api-access-kc75x\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.400528 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.400519    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-model-cache\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.501571 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.501536    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75d19a52-1acc-4991-b6d9-68d6e7de81f0-tls-certs\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.501747 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.501598    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc75x\" (UniqueName: \"kubernetes.io/projected/75d19a52-1acc-4991-b6d9-68d6e7de81f0-kube-api-access-kc75x\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.501747 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.501631    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-model-cache\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.501747 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.501699    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-home\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.501747 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.501721    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-tmp-dir\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.501917 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.501809    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-dshm\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.502172 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.502142    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-tmp-dir\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.502295 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.502222    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-model-cache\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.502295 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.502244    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-home\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.503998 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.503967    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-dshm\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.504371 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.504351    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75d19a52-1acc-4991-b6d9-68d6e7de81f0-tls-certs\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.509643 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.509619    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc75x\" (UniqueName: \"kubernetes.io/projected/75d19a52-1acc-4991-b6d9-68d6e7de81f0-kube-api-access-kc75x\") pod \"test-model-d2543e-kserve-56486c666c-9wd9h\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") " pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.610603 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.610498    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:11.747442 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:11.747312    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"]
Jul 09 22:53:11.749865 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:53:11.749841    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75d19a52_1acc_4991_b6d9_68d6e7de81f0.slice/crio-0c51d724b862516a2183cd7fd58021b26039e5e216436095c92be08feb193434 WatchSource:0}: Error finding container 0c51d724b862516a2183cd7fd58021b26039e5e216436095c92be08feb193434: Status 404 returned error can't find the container with id 0c51d724b862516a2183cd7fd58021b26039e5e216436095c92be08feb193434
Jul 09 22:53:12.158727 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:12.158688    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h" event={"ID":"75d19a52-1acc-4991-b6d9-68d6e7de81f0","Type":"ContainerStarted","Data":"399a9ec262895527fd4f682590d576bf9b4cec460c2b14235dee00cd0ebcd64f"}
Jul 09 22:53:12.158727 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:12.158732    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h" event={"ID":"75d19a52-1acc-4991-b6d9-68d6e7de81f0","Type":"ContainerStarted","Data":"0c51d724b862516a2183cd7fd58021b26039e5e216436095c92be08feb193434"}
Jul 09 22:53:12.176210 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:12.176155    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h" podStartSLOduration=1.176135801 podStartE2EDuration="1.176135801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:53:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:53:12.174900948 +0000 UTC m=+2560.253670618" watchObservedRunningTime="2026-07-09 22:53:12.176135801 +0000 UTC m=+2560.254905514"
Jul 09 22:53:21.611450 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:21.611409    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:21.612069 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:21.611461    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:21.630556 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:21.630527    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:22.223139 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:22.223104    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:31.852990 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:31.852954    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"]
Jul 09 22:53:32.826746 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:32.826701    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"]
Jul 09 22:53:46.874363 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:46.874300    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx" podUID="f312e39b-6f92-4d41-a6c8-992bffa661fb" containerName="main" containerID="cri-o://205d9056b70b8a91cb63ca4f46bd3db771d8d707a7f9e46407b65cb35b9ed725" gracePeriod=45
Jul 09 22:53:47.127769 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.127700    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:53:47.220411 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.220372    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-home\") pod \"f312e39b-6f92-4d41-a6c8-992bffa661fb\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") "
Jul 09 22:53:47.220602 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.220431    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-model-cache\") pod \"f312e39b-6f92-4d41-a6c8-992bffa661fb\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") "
Jul 09 22:53:47.220602 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.220461    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-dshm\") pod \"f312e39b-6f92-4d41-a6c8-992bffa661fb\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") "
Jul 09 22:53:47.220602 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.220484    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f312e39b-6f92-4d41-a6c8-992bffa661fb-tls-certs\") pod \"f312e39b-6f92-4d41-a6c8-992bffa661fb\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") "
Jul 09 22:53:47.220602 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.220512    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-tmp-dir\") pod \"f312e39b-6f92-4d41-a6c8-992bffa661fb\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") "
Jul 09 22:53:47.220824 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.220701    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-home" (OuterVolumeSpecName: "home") pod "f312e39b-6f92-4d41-a6c8-992bffa661fb" (UID: "f312e39b-6f92-4d41-a6c8-992bffa661fb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:53:47.220824 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.220781    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-model-cache" (OuterVolumeSpecName: "model-cache") pod "f312e39b-6f92-4d41-a6c8-992bffa661fb" (UID: "f312e39b-6f92-4d41-a6c8-992bffa661fb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:53:47.220938 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.220895    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f312e39b-6f92-4d41-a6c8-992bffa661fb" (UID: "f312e39b-6f92-4d41-a6c8-992bffa661fb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:53:47.222676 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.222652    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-dshm" (OuterVolumeSpecName: "dshm") pod "f312e39b-6f92-4d41-a6c8-992bffa661fb" (UID: "f312e39b-6f92-4d41-a6c8-992bffa661fb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:53:47.222770 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.222744    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f312e39b-6f92-4d41-a6c8-992bffa661fb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f312e39b-6f92-4d41-a6c8-992bffa661fb" (UID: "f312e39b-6f92-4d41-a6c8-992bffa661fb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:53:47.321023 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.320984    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54fkm\" (UniqueName: \"kubernetes.io/projected/f312e39b-6f92-4d41-a6c8-992bffa661fb-kube-api-access-54fkm\") pod \"f312e39b-6f92-4d41-a6c8-992bffa661fb\" (UID: \"f312e39b-6f92-4d41-a6c8-992bffa661fb\") "
Jul 09 22:53:47.321213 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.321128    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-tmp-dir\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:53:47.321213 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.321141    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-home\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:53:47.321213 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.321150    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-model-cache\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:53:47.321213 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.321157    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f312e39b-6f92-4d41-a6c8-992bffa661fb-dshm\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:53:47.321213 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.321165    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f312e39b-6f92-4d41-a6c8-992bffa661fb-tls-certs\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:53:47.323030 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.323004    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f312e39b-6f92-4d41-a6c8-992bffa661fb-kube-api-access-54fkm" (OuterVolumeSpecName: "kube-api-access-54fkm") pod "f312e39b-6f92-4d41-a6c8-992bffa661fb" (UID: "f312e39b-6f92-4d41-a6c8-992bffa661fb"). InnerVolumeSpecName "kube-api-access-54fkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:53:47.344496 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.344446    2583 generic.go:356] "Generic (PLEG): container finished" podID="f312e39b-6f92-4d41-a6c8-992bffa661fb" containerID="205d9056b70b8a91cb63ca4f46bd3db771d8d707a7f9e46407b65cb35b9ed725" exitCode=0
Jul 09 22:53:47.344668 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.344531    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"
Jul 09 22:53:47.344668 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.344531    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx" event={"ID":"f312e39b-6f92-4d41-a6c8-992bffa661fb","Type":"ContainerDied","Data":"205d9056b70b8a91cb63ca4f46bd3db771d8d707a7f9e46407b65cb35b9ed725"}
Jul 09 22:53:47.344668 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.344608    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx" event={"ID":"f312e39b-6f92-4d41-a6c8-992bffa661fb","Type":"ContainerDied","Data":"3570ea9c36f46355df76301d7c5d9b491c57ebd92f953651967c8a119379e302"}
Jul 09 22:53:47.344668 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.344647    2583 scope.go:117] "RemoveContainer" containerID="205d9056b70b8a91cb63ca4f46bd3db771d8d707a7f9e46407b65cb35b9ed725"
Jul 09 22:53:47.353853 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.353834    2583 scope.go:117] "RemoveContainer" containerID="205d9056b70b8a91cb63ca4f46bd3db771d8d707a7f9e46407b65cb35b9ed725"
Jul 09 22:53:47.354129 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:53:47.354109    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"205d9056b70b8a91cb63ca4f46bd3db771d8d707a7f9e46407b65cb35b9ed725\": container with ID starting with 205d9056b70b8a91cb63ca4f46bd3db771d8d707a7f9e46407b65cb35b9ed725 not found: ID does not exist" containerID="205d9056b70b8a91cb63ca4f46bd3db771d8d707a7f9e46407b65cb35b9ed725"
Jul 09 22:53:47.354221 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.354134    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"205d9056b70b8a91cb63ca4f46bd3db771d8d707a7f9e46407b65cb35b9ed725"} err="failed to get container status \"205d9056b70b8a91cb63ca4f46bd3db771d8d707a7f9e46407b65cb35b9ed725\": rpc error: code = NotFound desc = could not find container \"205d9056b70b8a91cb63ca4f46bd3db771d8d707a7f9e46407b65cb35b9ed725\": container with ID starting with 205d9056b70b8a91cb63ca4f46bd3db771d8d707a7f9e46407b65cb35b9ed725 not found: ID does not exist"
Jul 09 22:53:47.368122 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.368075    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"]
Jul 09 22:53:47.372508 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.372474    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-288815/test-model-288815-kserve-5856fc45b5-qvmqx"]
Jul 09 22:53:47.422280 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.422183    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54fkm\" (UniqueName: \"kubernetes.io/projected/f312e39b-6f92-4d41-a6c8-992bffa661fb-kube-api-access-54fkm\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:53:47.847620 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:47.847501    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h" podUID="75d19a52-1acc-4991-b6d9-68d6e7de81f0" containerName="main" containerID="cri-o://399a9ec262895527fd4f682590d576bf9b4cec460c2b14235dee00cd0ebcd64f" gracePeriod=45
Jul 09 22:53:48.099970 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.099909    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:48.126960 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.126929    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-home\") pod \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") "
Jul 09 22:53:48.127144 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.126966    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-dshm\") pod \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") "
Jul 09 22:53:48.127144 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.126985    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-tmp-dir\") pod \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") "
Jul 09 22:53:48.127144 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.127015    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-model-cache\") pod \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") "
Jul 09 22:53:48.127144 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.127049    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kc75x\" (UniqueName: \"kubernetes.io/projected/75d19a52-1acc-4991-b6d9-68d6e7de81f0-kube-api-access-kc75x\") pod \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") "
Jul 09 22:53:48.127144 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.127112    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75d19a52-1acc-4991-b6d9-68d6e7de81f0-tls-certs\") pod \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\" (UID: \"75d19a52-1acc-4991-b6d9-68d6e7de81f0\") "
Jul 09 22:53:48.127402 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.127286    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-model-cache" (OuterVolumeSpecName: "model-cache") pod "75d19a52-1acc-4991-b6d9-68d6e7de81f0" (UID: "75d19a52-1acc-4991-b6d9-68d6e7de81f0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:53:48.127402 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.127350    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "75d19a52-1acc-4991-b6d9-68d6e7de81f0" (UID: "75d19a52-1acc-4991-b6d9-68d6e7de81f0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:53:48.127508 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.127408    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-model-cache\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:53:48.127670 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.127641    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-home" (OuterVolumeSpecName: "home") pod "75d19a52-1acc-4991-b6d9-68d6e7de81f0" (UID: "75d19a52-1acc-4991-b6d9-68d6e7de81f0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:53:48.129417 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.129389    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-dshm" (OuterVolumeSpecName: "dshm") pod "75d19a52-1acc-4991-b6d9-68d6e7de81f0" (UID: "75d19a52-1acc-4991-b6d9-68d6e7de81f0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:53:48.129530 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.129444    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75d19a52-1acc-4991-b6d9-68d6e7de81f0-kube-api-access-kc75x" (OuterVolumeSpecName: "kube-api-access-kc75x") pod "75d19a52-1acc-4991-b6d9-68d6e7de81f0" (UID: "75d19a52-1acc-4991-b6d9-68d6e7de81f0"). InnerVolumeSpecName "kube-api-access-kc75x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:53:48.129530 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.129499    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75d19a52-1acc-4991-b6d9-68d6e7de81f0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "75d19a52-1acc-4991-b6d9-68d6e7de81f0" (UID: "75d19a52-1acc-4991-b6d9-68d6e7de81f0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:53:48.227862 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.227822    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-home\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:53:48.227862 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.227854    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-dshm\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:53:48.227862 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.227866    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75d19a52-1acc-4991-b6d9-68d6e7de81f0-tmp-dir\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:53:48.228143 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.227879    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kc75x\" (UniqueName: \"kubernetes.io/projected/75d19a52-1acc-4991-b6d9-68d6e7de81f0-kube-api-access-kc75x\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:53:48.228143 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.227895    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75d19a52-1acc-4991-b6d9-68d6e7de81f0-tls-certs\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:53:48.351981 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.351894    2583 generic.go:356] "Generic (PLEG): container finished" podID="75d19a52-1acc-4991-b6d9-68d6e7de81f0" containerID="399a9ec262895527fd4f682590d576bf9b4cec460c2b14235dee00cd0ebcd64f" exitCode=0
Jul 09 22:53:48.351981 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.351941    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"
Jul 09 22:53:48.351981 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.351973    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h" event={"ID":"75d19a52-1acc-4991-b6d9-68d6e7de81f0","Type":"ContainerDied","Data":"399a9ec262895527fd4f682590d576bf9b4cec460c2b14235dee00cd0ebcd64f"}
Jul 09 22:53:48.352272 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.352016    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h" event={"ID":"75d19a52-1acc-4991-b6d9-68d6e7de81f0","Type":"ContainerDied","Data":"0c51d724b862516a2183cd7fd58021b26039e5e216436095c92be08feb193434"}
Jul 09 22:53:48.352272 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.352042    2583 scope.go:117] "RemoveContainer" containerID="399a9ec262895527fd4f682590d576bf9b4cec460c2b14235dee00cd0ebcd64f"
Jul 09 22:53:48.361762 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.361738    2583 scope.go:117] "RemoveContainer" containerID="399a9ec262895527fd4f682590d576bf9b4cec460c2b14235dee00cd0ebcd64f"
Jul 09 22:53:48.362059 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:53:48.362039    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"399a9ec262895527fd4f682590d576bf9b4cec460c2b14235dee00cd0ebcd64f\": container with ID starting with 399a9ec262895527fd4f682590d576bf9b4cec460c2b14235dee00cd0ebcd64f not found: ID does not exist" containerID="399a9ec262895527fd4f682590d576bf9b4cec460c2b14235dee00cd0ebcd64f"
Jul 09 22:53:48.362146 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.362078    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"399a9ec262895527fd4f682590d576bf9b4cec460c2b14235dee00cd0ebcd64f"} err="failed to get container status \"399a9ec262895527fd4f682590d576bf9b4cec460c2b14235dee00cd0ebcd64f\": rpc error: code = NotFound desc = could not find container \"399a9ec262895527fd4f682590d576bf9b4cec460c2b14235dee00cd0ebcd64f\": container with ID starting with 399a9ec262895527fd4f682590d576bf9b4cec460c2b14235dee00cd0ebcd64f not found: ID does not exist"
Jul 09 22:53:48.373271 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.373247    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"]
Jul 09 22:53:48.377528 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.377504    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-d2543e/test-model-d2543e-kserve-56486c666c-9wd9h"]
Jul 09 22:53:48.486578 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.486546    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75d19a52-1acc-4991-b6d9-68d6e7de81f0" path="/var/lib/kubelet/pods/75d19a52-1acc-4991-b6d9-68d6e7de81f0/volumes"
Jul 09 22:53:48.486941 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:48.486928    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f312e39b-6f92-4d41-a6c8-992bffa661fb" path="/var/lib/kubelet/pods/f312e39b-6f92-4d41-a6c8-992bffa661fb/volumes"
Jul 09 22:53:59.070216 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:59.069978    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6"]
Jul 09 22:53:59.071674 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:59.071647    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d19a52-1acc-4991-b6d9-68d6e7de81f0" containerName="main"
Jul 09 22:53:59.071845 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:59.071834    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d19a52-1acc-4991-b6d9-68d6e7de81f0" containerName="main"
Jul 09 22:53:59.071949 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:59.071939    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f312e39b-6f92-4d41-a6c8-992bffa661fb" containerName="main"
Jul 09 22:53:59.072039 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:59.072030    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f312e39b-6f92-4d41-a6c8-992bffa661fb" containerName="main"
Jul 09 22:53:59.072512 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:59.072486    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f312e39b-6f92-4d41-a6c8-992bffa661fb" containerName="main"
Jul 09 22:53:59.072637 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:59.072517    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="75d19a52-1acc-4991-b6d9-68d6e7de81f0" containerName="main"
Jul 09 22:53:59.077167 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:59.077143    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6"
Jul 09 22:53:59.079265 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:59.079240    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6"]
Jul 09 22:53:59.080050 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:59.080024    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fdzhc\""
Jul 09 22:53:59.107607 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:59.107575    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/530b6b38-4ede-4c3e-9e5f-7757d96f0731-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6\" (UID: \"530b6b38-4ede-4c3e-9e5f-7757d96f0731\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6"
Jul 09 22:53:59.209025 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:59.208990    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/530b6b38-4ede-4c3e-9e5f-7757d96f0731-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6\" (UID: \"530b6b38-4ede-4c3e-9e5f-7757d96f0731\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6"
Jul 09 22:53:59.209749 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:59.209724    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/530b6b38-4ede-4c3e-9e5f-7757d96f0731-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6\" (UID: \"530b6b38-4ede-4c3e-9e5f-7757d96f0731\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6"
Jul 09 22:53:59.388108 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:59.388062    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6"
Jul 09 22:53:59.525562 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:53:59.525533    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6"]
Jul 09 22:53:59.528417 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:53:59.528390    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod530b6b38_4ede_4c3e_9e5f_7757d96f0731.slice/crio-485a017c284f9d59cb532a264ac54e48a38bf7349d5bf40aa3198cee9287d944 WatchSource:0}: Error finding container 485a017c284f9d59cb532a264ac54e48a38bf7349d5bf40aa3198cee9287d944: Status 404 returned error can't find the container with id 485a017c284f9d59cb532a264ac54e48a38bf7349d5bf40aa3198cee9287d944
Jul 09 22:54:00.414416 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:00.414381    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6" event={"ID":"530b6b38-4ede-4c3e-9e5f-7757d96f0731","Type":"ContainerStarted","Data":"485a017c284f9d59cb532a264ac54e48a38bf7349d5bf40aa3198cee9287d944"}
Jul 09 22:54:02.427050 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:02.426988    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6" event={"ID":"530b6b38-4ede-4c3e-9e5f-7757d96f0731","Type":"ContainerStarted","Data":"f3067b0a38b0a64c2d5763f78c2595d55966258ddc37678466aac567f35b5807"}
Jul 09 22:54:02.443120 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:02.443055    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6" podStartSLOduration=1.021398838 podStartE2EDuration="3.44303832s" totalImagesPullingTime="2.421639482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:53:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:54:02.440797406 +0000 UTC m=+2610.519567090" watchObservedRunningTime="2026-07-09 22:54:02.44303832 +0000 UTC m=+2610.521808055"
Jul 09 22:54:03.433814 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:03.433781    2583 generic.go:356] "Generic (PLEG): container finished" podID="530b6b38-4ede-4c3e-9e5f-7757d96f0731" containerID="f3067b0a38b0a64c2d5763f78c2595d55966258ddc37678466aac567f35b5807" exitCode=0
Jul 09 22:54:03.434223 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:03.433829    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6" event={"ID":"530b6b38-4ede-4c3e-9e5f-7757d96f0731","Type":"ContainerDied","Data":"f3067b0a38b0a64c2d5763f78c2595d55966258ddc37678466aac567f35b5807"}
Jul 09 22:54:04.572563 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:04.572535    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6"
Jul 09 22:54:04.657695 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:04.657648    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/530b6b38-4ede-4c3e-9e5f-7757d96f0731-maas-api-service-ca\") pod \"530b6b38-4ede-4c3e-9e5f-7757d96f0731\" (UID: \"530b6b38-4ede-4c3e-9e5f-7757d96f0731\") "
Jul 09 22:54:04.658052 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:04.658031    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/530b6b38-4ede-4c3e-9e5f-7757d96f0731-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "530b6b38-4ede-4c3e-9e5f-7757d96f0731" (UID: "530b6b38-4ede-4c3e-9e5f-7757d96f0731"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:54:04.758430 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:04.758351    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/530b6b38-4ede-4c3e-9e5f-7757d96f0731-maas-api-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:54:05.444234 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:05.444192    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6" event={"ID":"530b6b38-4ede-4c3e-9e5f-7757d96f0731","Type":"ContainerDied","Data":"485a017c284f9d59cb532a264ac54e48a38bf7349d5bf40aa3198cee9287d944"}
Jul 09 22:54:05.444404 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:05.444279    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="485a017c284f9d59cb532a264ac54e48a38bf7349d5bf40aa3198cee9287d944"
Jul 09 22:54:05.444404 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:05.444206    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6"
Jul 09 22:54:09.510004 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:09.509968    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"]
Jul 09 22:54:09.510531 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:09.510208    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7" podUID="53f5b0f5-9f59-4736-857e-47ade5e977fc" containerName="maas-api" containerID="cri-o://0ff2eb511b8449342eca0990179d52f50c39c3c517eaca287d5e1ceed5a37a62" gracePeriod=30
Jul 09 22:54:09.752914 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:09.752888    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"
Jul 09 22:54:09.801951 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:09.801874    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53f5b0f5-9f59-4736-857e-47ade5e977fc-openshift-service-ca\") pod \"53f5b0f5-9f59-4736-857e-47ade5e977fc\" (UID: \"53f5b0f5-9f59-4736-857e-47ade5e977fc\") "
Jul 09 22:54:09.802120 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:09.801958    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfbqv\" (UniqueName: \"kubernetes.io/projected/53f5b0f5-9f59-4736-857e-47ade5e977fc-kube-api-access-gfbqv\") pod \"53f5b0f5-9f59-4736-857e-47ade5e977fc\" (UID: \"53f5b0f5-9f59-4736-857e-47ade5e977fc\") "
Jul 09 22:54:09.802120 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:09.802082    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53f5b0f5-9f59-4736-857e-47ade5e977fc-maas-api-tls\") pod \"53f5b0f5-9f59-4736-857e-47ade5e977fc\" (UID: \"53f5b0f5-9f59-4736-857e-47ade5e977fc\") "
Jul 09 22:54:09.802244 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:09.802220    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53f5b0f5-9f59-4736-857e-47ade5e977fc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "53f5b0f5-9f59-4736-857e-47ade5e977fc" (UID: "53f5b0f5-9f59-4736-857e-47ade5e977fc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:54:09.802358 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:09.802340    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53f5b0f5-9f59-4736-857e-47ade5e977fc-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:54:09.804241 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:09.804216    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53f5b0f5-9f59-4736-857e-47ade5e977fc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "53f5b0f5-9f59-4736-857e-47ade5e977fc" (UID: "53f5b0f5-9f59-4736-857e-47ade5e977fc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:54:09.804385 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:09.804367    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53f5b0f5-9f59-4736-857e-47ade5e977fc-kube-api-access-gfbqv" (OuterVolumeSpecName: "kube-api-access-gfbqv") pod "53f5b0f5-9f59-4736-857e-47ade5e977fc" (UID: "53f5b0f5-9f59-4736-857e-47ade5e977fc"). InnerVolumeSpecName "kube-api-access-gfbqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:54:09.903678 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:09.903636    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfbqv\" (UniqueName: \"kubernetes.io/projected/53f5b0f5-9f59-4736-857e-47ade5e977fc-kube-api-access-gfbqv\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:54:09.903678 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:09.903671    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53f5b0f5-9f59-4736-857e-47ade5e977fc-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:54:10.468357 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:10.468316    2583 generic.go:356] "Generic (PLEG): container finished" podID="53f5b0f5-9f59-4736-857e-47ade5e977fc" containerID="0ff2eb511b8449342eca0990179d52f50c39c3c517eaca287d5e1ceed5a37a62" exitCode=0
Jul 09 22:54:10.468507 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:10.468380    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"
Jul 09 22:54:10.468507 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:10.468387    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7" event={"ID":"53f5b0f5-9f59-4736-857e-47ade5e977fc","Type":"ContainerDied","Data":"0ff2eb511b8449342eca0990179d52f50c39c3c517eaca287d5e1ceed5a37a62"}
Jul 09 22:54:10.468507 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:10.468455    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7" event={"ID":"53f5b0f5-9f59-4736-857e-47ade5e977fc","Type":"ContainerDied","Data":"b23e18f673c5ba7f09859d53285a5add2465f6f5ee0820a31019d77ad13fdb52"}
Jul 09 22:54:10.468507 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:10.468478    2583 scope.go:117] "RemoveContainer" containerID="0ff2eb511b8449342eca0990179d52f50c39c3c517eaca287d5e1ceed5a37a62"
Jul 09 22:54:10.477869 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:10.477848    2583 scope.go:117] "RemoveContainer" containerID="0ff2eb511b8449342eca0990179d52f50c39c3c517eaca287d5e1ceed5a37a62"
Jul 09 22:54:10.478206 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:54:10.478182    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ff2eb511b8449342eca0990179d52f50c39c3c517eaca287d5e1ceed5a37a62\": container with ID starting with 0ff2eb511b8449342eca0990179d52f50c39c3c517eaca287d5e1ceed5a37a62 not found: ID does not exist" containerID="0ff2eb511b8449342eca0990179d52f50c39c3c517eaca287d5e1ceed5a37a62"
Jul 09 22:54:10.478306 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:10.478217    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ff2eb511b8449342eca0990179d52f50c39c3c517eaca287d5e1ceed5a37a62"} err="failed to get container status \"0ff2eb511b8449342eca0990179d52f50c39c3c517eaca287d5e1ceed5a37a62\": rpc error: code = NotFound desc = could not find container \"0ff2eb511b8449342eca0990179d52f50c39c3c517eaca287d5e1ceed5a37a62\": container with ID starting with 0ff2eb511b8449342eca0990179d52f50c39c3c517eaca287d5e1ceed5a37a62 not found: ID does not exist"
Jul 09 22:54:10.490371 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:10.490341    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"]
Jul 09 22:54:10.494252 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:10.494227    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d2543e-8445964c6b-vdtl7"]
Jul 09 22:54:12.486238 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:12.486206    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53f5b0f5-9f59-4736-857e-47ade5e977fc" path="/var/lib/kubelet/pods/53f5b0f5-9f59-4736-857e-47ade5e977fc/volumes"
Jul 09 22:54:29.416743 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.416708    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"]
Jul 09 22:54:29.417159 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.417025    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53f5b0f5-9f59-4736-857e-47ade5e977fc" containerName="maas-api"
Jul 09 22:54:29.417159 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.417036    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="53f5b0f5-9f59-4736-857e-47ade5e977fc" containerName="maas-api"
Jul 09 22:54:29.417159 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.417046    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530b6b38-4ede-4c3e-9e5f-7757d96f0731" containerName="revoke-keys"
Jul 09 22:54:29.417159 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.417052    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="530b6b38-4ede-4c3e-9e5f-7757d96f0731" containerName="revoke-keys"
Jul 09 22:54:29.417159 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.417123    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="530b6b38-4ede-4c3e-9e5f-7757d96f0731" containerName="revoke-keys"
Jul 09 22:54:29.417159 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.417132    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="53f5b0f5-9f59-4736-857e-47ade5e977fc" containerName="maas-api"
Jul 09 22:54:29.421424 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.421403    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"
Jul 09 22:54:29.423845 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.423818    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-e98c97-serving-cert\""
Jul 09 22:54:29.423957 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.423904    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2qlgm\""
Jul 09 22:54:29.424035 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.424017    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 22:54:29.424460 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.424445    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 22:54:29.430187 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.430156    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"]
Jul 09 22:54:29.567175 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.567138    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7479a13c-9ec9-499e-adef-3eb980ecb603-maas-api-tls\") pod \"maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm\" (UID: \"7479a13c-9ec9-499e-adef-3eb980ecb603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"
Jul 09 22:54:29.567175 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.567178    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dhmw\" (UniqueName: \"kubernetes.io/projected/7479a13c-9ec9-499e-adef-3eb980ecb603-kube-api-access-6dhmw\") pod \"maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm\" (UID: \"7479a13c-9ec9-499e-adef-3eb980ecb603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"
Jul 09 22:54:29.567411 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.567197    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7479a13c-9ec9-499e-adef-3eb980ecb603-openshift-service-ca\") pod \"maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm\" (UID: \"7479a13c-9ec9-499e-adef-3eb980ecb603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"
Jul 09 22:54:29.668420 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.668325    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7479a13c-9ec9-499e-adef-3eb980ecb603-maas-api-tls\") pod \"maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm\" (UID: \"7479a13c-9ec9-499e-adef-3eb980ecb603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"
Jul 09 22:54:29.668420 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.668365    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dhmw\" (UniqueName: \"kubernetes.io/projected/7479a13c-9ec9-499e-adef-3eb980ecb603-kube-api-access-6dhmw\") pod \"maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm\" (UID: \"7479a13c-9ec9-499e-adef-3eb980ecb603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"
Jul 09 22:54:29.668420 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.668392    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7479a13c-9ec9-499e-adef-3eb980ecb603-openshift-service-ca\") pod \"maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm\" (UID: \"7479a13c-9ec9-499e-adef-3eb980ecb603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"
Jul 09 22:54:29.669062 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.669039    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7479a13c-9ec9-499e-adef-3eb980ecb603-openshift-service-ca\") pod \"maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm\" (UID: \"7479a13c-9ec9-499e-adef-3eb980ecb603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"
Jul 09 22:54:29.670866 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.670840    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7479a13c-9ec9-499e-adef-3eb980ecb603-maas-api-tls\") pod \"maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm\" (UID: \"7479a13c-9ec9-499e-adef-3eb980ecb603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"
Jul 09 22:54:29.680979 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.680954    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dhmw\" (UniqueName: \"kubernetes.io/projected/7479a13c-9ec9-499e-adef-3eb980ecb603-kube-api-access-6dhmw\") pod \"maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm\" (UID: \"7479a13c-9ec9-499e-adef-3eb980ecb603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"
Jul 09 22:54:29.733729 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.733684    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"
Jul 09 22:54:29.877113 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:29.875602    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"]
Jul 09 22:54:30.568675 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:30.568639    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm" event={"ID":"7479a13c-9ec9-499e-adef-3eb980ecb603","Type":"ContainerStarted","Data":"d5342655891446ab6a92b2e06212ee5613a7892de763c2496e41cb8bdd9fa8a0"}
Jul 09 22:54:30.569232 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:30.568693    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm" event={"ID":"7479a13c-9ec9-499e-adef-3eb980ecb603","Type":"ContainerStarted","Data":"7ec016262753bcfafa3c20fbd255aa6cc860133cb72c0f18d91f3b036233d464"}
Jul 09 22:54:30.569232 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:30.568785    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"
Jul 09 22:54:30.586495 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:30.586444    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm" podStartSLOduration=0.977898981 podStartE2EDuration="1.586426318s" totalImagesPullingTime="608.527337ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:54:30.584129561 +0000 UTC m=+2638.662899240" watchObservedRunningTime="2026-07-09 22:54:30.586426318 +0000 UTC m=+2638.665195996"
Jul 09 22:54:36.579716 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:36.579681    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"
Jul 09 22:54:37.340911 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:37.340877    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"]
Jul 09 22:54:37.348950 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:37.348923    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"
Jul 09 22:54:37.351217 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:37.351188    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-6ddc6a-serving-cert\""
Jul 09 22:54:37.351788 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:37.351759    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"]
Jul 09 22:54:37.436119 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:37.436052    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-openshift-service-ca\") pod \"maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648\" (UID: \"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"
Jul 09 22:54:37.436302 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:37.436171    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-maas-api-tls\") pod \"maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648\" (UID: \"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"
Jul 09 22:54:37.436302 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:37.436222    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phbc2\" (UniqueName: \"kubernetes.io/projected/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-kube-api-access-phbc2\") pod \"maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648\" (UID: \"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"
Jul 09 22:54:37.536790 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:37.536748    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phbc2\" (UniqueName: \"kubernetes.io/projected/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-kube-api-access-phbc2\") pod \"maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648\" (UID: \"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"
Jul 09 22:54:37.536976 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:37.536805    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-openshift-service-ca\") pod \"maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648\" (UID: \"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"
Jul 09 22:54:37.536976 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:37.536842    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-maas-api-tls\") pod \"maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648\" (UID: \"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"
Jul 09 22:54:37.537510 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:37.537489    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-openshift-service-ca\") pod \"maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648\" (UID: \"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"
Jul 09 22:54:37.539438 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:37.539417    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-maas-api-tls\") pod \"maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648\" (UID: \"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"
Jul 09 22:54:37.545215 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:37.545186    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phbc2\" (UniqueName: \"kubernetes.io/projected/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-kube-api-access-phbc2\") pod \"maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648\" (UID: \"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"
Jul 09 22:54:37.661606 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:37.661566    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"
Jul 09 22:54:37.805998 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:37.805861    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"]
Jul 09 22:54:37.808493 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:54:37.808464    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b5a17fe_6aef_41a3_a4f1_d3a419926a7a.slice/crio-060086b168b304b8e5fc8a8fc136f130ff7cbed3f74d73f5afe52d5bd1d98a2d WatchSource:0}: Error finding container 060086b168b304b8e5fc8a8fc136f130ff7cbed3f74d73f5afe52d5bd1d98a2d: Status 404 returned error can't find the container with id 060086b168b304b8e5fc8a8fc136f130ff7cbed3f74d73f5afe52d5bd1d98a2d
Jul 09 22:54:38.610013 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:38.609977    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648" event={"ID":"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a","Type":"ContainerStarted","Data":"1ae361d0a3ff3c2088a2bbce0d0b67616eab30b5414243708ce1645d5b0fb2a8"}
Jul 09 22:54:38.610241 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:38.610031    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648" event={"ID":"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a","Type":"ContainerStarted","Data":"060086b168b304b8e5fc8a8fc136f130ff7cbed3f74d73f5afe52d5bd1d98a2d"}
Jul 09 22:54:38.610241 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:38.610075    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"
Jul 09 22:54:38.625946 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:38.625898    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648" podStartSLOduration=1.3410226490000001 podStartE2EDuration="1.625848268s" totalImagesPullingTime="284.825619ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:54:38.625598045 +0000 UTC m=+2646.704367724" watchObservedRunningTime="2026-07-09 22:54:38.625848268 +0000 UTC m=+2646.704617946"
Jul 09 22:54:44.621048 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:44.621018    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"
Jul 09 22:54:49.798482 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:49.798447    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv"]
Jul 09 22:54:49.801800 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:49.801783    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv"
Jul 09 22:54:49.803848 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:49.803823    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fdzhc\""
Jul 09 22:54:49.808486 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:49.808460    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv"]
Jul 09 22:54:49.947070 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:49.947036    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10666c7f-b035-442c-9b8c-b6776cbaa96d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv\" (UID: \"10666c7f-b035-442c-9b8c-b6776cbaa96d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv"
Jul 09 22:54:50.048429 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:50.048392    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10666c7f-b035-442c-9b8c-b6776cbaa96d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv\" (UID: \"10666c7f-b035-442c-9b8c-b6776cbaa96d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv"
Jul 09 22:54:50.049026 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:50.048980    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10666c7f-b035-442c-9b8c-b6776cbaa96d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv\" (UID: \"10666c7f-b035-442c-9b8c-b6776cbaa96d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv"
Jul 09 22:54:50.114860 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:50.114823    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv"
Jul 09 22:54:50.252429 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:50.252385    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv"]
Jul 09 22:54:50.257818 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:54:50.257790    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10666c7f_b035_442c_9b8c_b6776cbaa96d.slice/crio-0e56a2103fc14d95288aea258ef29825e160a5f5bffed63243c7da520c053122 WatchSource:0}: Error finding container 0e56a2103fc14d95288aea258ef29825e160a5f5bffed63243c7da520c053122: Status 404 returned error can't find the container with id 0e56a2103fc14d95288aea258ef29825e160a5f5bffed63243c7da520c053122
Jul 09 22:54:50.677865 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:50.677832    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv" event={"ID":"10666c7f-b035-442c-9b8c-b6776cbaa96d","Type":"ContainerStarted","Data":"e190dc522189fcca8d13362c1bc498cdb502e9b5d1b867148c6a0456796fc15b"}
Jul 09 22:54:50.678278 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:50.677886    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv" event={"ID":"10666c7f-b035-442c-9b8c-b6776cbaa96d","Type":"ContainerStarted","Data":"0e56a2103fc14d95288aea258ef29825e160a5f5bffed63243c7da520c053122"}
Jul 09 22:54:50.693771 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:50.693719    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv" podStartSLOduration=1.693700997 podStartE2EDuration="1.693700997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:54:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:54:50.691740976 +0000 UTC m=+2658.770510654" watchObservedRunningTime="2026-07-09 22:54:50.693700997 +0000 UTC m=+2658.772470712"
Jul 09 22:54:51.684647 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:51.684611    2583 generic.go:356] "Generic (PLEG): container finished" podID="10666c7f-b035-442c-9b8c-b6776cbaa96d" containerID="e190dc522189fcca8d13362c1bc498cdb502e9b5d1b867148c6a0456796fc15b" exitCode=0
Jul 09 22:54:51.685030 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:51.684655    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv" event={"ID":"10666c7f-b035-442c-9b8c-b6776cbaa96d","Type":"ContainerDied","Data":"e190dc522189fcca8d13362c1bc498cdb502e9b5d1b867148c6a0456796fc15b"}
Jul 09 22:54:52.821859 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:52.821831    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv"
Jul 09 22:54:52.976852 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:52.976741    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10666c7f-b035-442c-9b8c-b6776cbaa96d-maas-api-service-ca\") pod \"10666c7f-b035-442c-9b8c-b6776cbaa96d\" (UID: \"10666c7f-b035-442c-9b8c-b6776cbaa96d\") "
Jul 09 22:54:52.977119 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:52.977074    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10666c7f-b035-442c-9b8c-b6776cbaa96d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "10666c7f-b035-442c-9b8c-b6776cbaa96d" (UID: "10666c7f-b035-442c-9b8c-b6776cbaa96d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:54:53.077784 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:53.077749    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10666c7f-b035-442c-9b8c-b6776cbaa96d-maas-api-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:54:53.696508 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:53.696478    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv"
Jul 09 22:54:53.696508 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:53.696489    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv" event={"ID":"10666c7f-b035-442c-9b8c-b6776cbaa96d","Type":"ContainerDied","Data":"0e56a2103fc14d95288aea258ef29825e160a5f5bffed63243c7da520c053122"}
Jul 09 22:54:53.696734 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:54:53.696542    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e56a2103fc14d95288aea258ef29825e160a5f5bffed63243c7da520c053122"
Jul 09 22:55:00.687273 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:00.687243    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"]
Jul 09 22:55:00.687738 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:00.687462    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm" podUID="7479a13c-9ec9-499e-adef-3eb980ecb603" containerName="maas-api" containerID="cri-o://d5342655891446ab6a92b2e06212ee5613a7892de763c2496e41cb8bdd9fa8a0" gracePeriod=30
Jul 09 22:55:00.934603 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:00.934576    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"
Jul 09 22:55:00.936625 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:00.936604    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7479a13c-9ec9-499e-adef-3eb980ecb603-openshift-service-ca\") pod \"7479a13c-9ec9-499e-adef-3eb980ecb603\" (UID: \"7479a13c-9ec9-499e-adef-3eb980ecb603\") "
Jul 09 22:55:00.936747 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:00.936652    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dhmw\" (UniqueName: \"kubernetes.io/projected/7479a13c-9ec9-499e-adef-3eb980ecb603-kube-api-access-6dhmw\") pod \"7479a13c-9ec9-499e-adef-3eb980ecb603\" (UID: \"7479a13c-9ec9-499e-adef-3eb980ecb603\") "
Jul 09 22:55:00.936747 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:00.936677    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7479a13c-9ec9-499e-adef-3eb980ecb603-maas-api-tls\") pod \"7479a13c-9ec9-499e-adef-3eb980ecb603\" (UID: \"7479a13c-9ec9-499e-adef-3eb980ecb603\") "
Jul 09 22:55:00.936951 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:00.936932    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7479a13c-9ec9-499e-adef-3eb980ecb603-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7479a13c-9ec9-499e-adef-3eb980ecb603" (UID: "7479a13c-9ec9-499e-adef-3eb980ecb603"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:55:00.938716 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:00.938657    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7479a13c-9ec9-499e-adef-3eb980ecb603-kube-api-access-6dhmw" (OuterVolumeSpecName: "kube-api-access-6dhmw") pod "7479a13c-9ec9-499e-adef-3eb980ecb603" (UID: "7479a13c-9ec9-499e-adef-3eb980ecb603"). InnerVolumeSpecName "kube-api-access-6dhmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:55:00.938810 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:00.938766    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7479a13c-9ec9-499e-adef-3eb980ecb603-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7479a13c-9ec9-499e-adef-3eb980ecb603" (UID: "7479a13c-9ec9-499e-adef-3eb980ecb603"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:55:01.037986 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:01.037882    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7479a13c-9ec9-499e-adef-3eb980ecb603-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:55:01.037986 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:01.037931    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dhmw\" (UniqueName: \"kubernetes.io/projected/7479a13c-9ec9-499e-adef-3eb980ecb603-kube-api-access-6dhmw\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:55:01.037986 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:01.037948    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7479a13c-9ec9-499e-adef-3eb980ecb603-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:55:01.735326 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:01.735282    2583 generic.go:356] "Generic (PLEG): container finished" podID="7479a13c-9ec9-499e-adef-3eb980ecb603" containerID="d5342655891446ab6a92b2e06212ee5613a7892de763c2496e41cb8bdd9fa8a0" exitCode=0
Jul 09 22:55:01.735864 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:01.735340    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"
Jul 09 22:55:01.735864 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:01.735374    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm" event={"ID":"7479a13c-9ec9-499e-adef-3eb980ecb603","Type":"ContainerDied","Data":"d5342655891446ab6a92b2e06212ee5613a7892de763c2496e41cb8bdd9fa8a0"}
Jul 09 22:55:01.735864 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:01.735432    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm" event={"ID":"7479a13c-9ec9-499e-adef-3eb980ecb603","Type":"ContainerDied","Data":"7ec016262753bcfafa3c20fbd255aa6cc860133cb72c0f18d91f3b036233d464"}
Jul 09 22:55:01.735864 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:01.735460    2583 scope.go:117] "RemoveContainer" containerID="d5342655891446ab6a92b2e06212ee5613a7892de763c2496e41cb8bdd9fa8a0"
Jul 09 22:55:01.744816 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:01.744797    2583 scope.go:117] "RemoveContainer" containerID="d5342655891446ab6a92b2e06212ee5613a7892de763c2496e41cb8bdd9fa8a0"
Jul 09 22:55:01.745118 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:55:01.745079    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5342655891446ab6a92b2e06212ee5613a7892de763c2496e41cb8bdd9fa8a0\": container with ID starting with d5342655891446ab6a92b2e06212ee5613a7892de763c2496e41cb8bdd9fa8a0 not found: ID does not exist" containerID="d5342655891446ab6a92b2e06212ee5613a7892de763c2496e41cb8bdd9fa8a0"
Jul 09 22:55:01.745180 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:01.745138    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5342655891446ab6a92b2e06212ee5613a7892de763c2496e41cb8bdd9fa8a0"} err="failed to get container status \"d5342655891446ab6a92b2e06212ee5613a7892de763c2496e41cb8bdd9fa8a0\": rpc error: code = NotFound desc = could not find container \"d5342655891446ab6a92b2e06212ee5613a7892de763c2496e41cb8bdd9fa8a0\": container with ID starting with d5342655891446ab6a92b2e06212ee5613a7892de763c2496e41cb8bdd9fa8a0 not found: ID does not exist"
Jul 09 22:55:01.756535 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:01.756504    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"]
Jul 09 22:55:01.758530 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:01.758506    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e98c97-7c7c844b64-7ftjm"]
Jul 09 22:55:02.486850 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:02.486815    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7479a13c-9ec9-499e-adef-3eb980ecb603" path="/var/lib/kubelet/pods/7479a13c-9ec9-499e-adef-3eb980ecb603/volumes"
Jul 09 22:55:15.896099 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:15.896039    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd"]
Jul 09 22:55:15.896598 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:15.896511    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10666c7f-b035-442c-9b8c-b6776cbaa96d" containerName="revoke-keys"
Jul 09 22:55:15.896598 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:15.896529    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="10666c7f-b035-442c-9b8c-b6776cbaa96d" containerName="revoke-keys"
Jul 09 22:55:15.896598 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:15.896567    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7479a13c-9ec9-499e-adef-3eb980ecb603" containerName="maas-api"
Jul 09 22:55:15.896598 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:15.896576    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7479a13c-9ec9-499e-adef-3eb980ecb603" containerName="maas-api"
Jul 09 22:55:15.896808 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:15.896653    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="10666c7f-b035-442c-9b8c-b6776cbaa96d" containerName="revoke-keys"
Jul 09 22:55:15.896808 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:15.896670    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7479a13c-9ec9-499e-adef-3eb980ecb603" containerName="maas-api"
Jul 09 22:55:15.899548 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:15.899525    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd"
Jul 09 22:55:15.901594 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:15.901569    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fdzhc\""
Jul 09 22:55:15.905818 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:15.905793    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd"]
Jul 09 22:55:15.961557 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:15.961515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/872ed038-e9f2-4c28-b097-fa86d7ce01e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd\" (UID: \"872ed038-e9f2-4c28-b097-fa86d7ce01e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd"
Jul 09 22:55:16.062932 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:16.062893    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/872ed038-e9f2-4c28-b097-fa86d7ce01e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd\" (UID: \"872ed038-e9f2-4c28-b097-fa86d7ce01e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd"
Jul 09 22:55:16.063597 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:16.063574    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/872ed038-e9f2-4c28-b097-fa86d7ce01e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd\" (UID: \"872ed038-e9f2-4c28-b097-fa86d7ce01e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd"
Jul 09 22:55:16.211244 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:16.211144    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd"
Jul 09 22:55:16.345259 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:16.345193    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd"]
Jul 09 22:55:16.347604 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:55:16.347579    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872ed038_e9f2_4c28_b097_fa86d7ce01e5.slice/crio-3a3d43f82ce0dc82900a235477742b07a00b5f9370c89f9a82a02d27caa2bd2a WatchSource:0}: Error finding container 3a3d43f82ce0dc82900a235477742b07a00b5f9370c89f9a82a02d27caa2bd2a: Status 404 returned error can't find the container with id 3a3d43f82ce0dc82900a235477742b07a00b5f9370c89f9a82a02d27caa2bd2a
Jul 09 22:55:16.811411 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:16.811318    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd" event={"ID":"872ed038-e9f2-4c28-b097-fa86d7ce01e5","Type":"ContainerStarted","Data":"0adc00f6ea35ef0b6f309eaec80c8768bb8464d61c1e340a9e2e18333cc87842"}
Jul 09 22:55:16.811411 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:16.811373    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd" event={"ID":"872ed038-e9f2-4c28-b097-fa86d7ce01e5","Type":"ContainerStarted","Data":"3a3d43f82ce0dc82900a235477742b07a00b5f9370c89f9a82a02d27caa2bd2a"}
Jul 09 22:55:16.828678 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:16.828629    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd" podStartSLOduration=1.8286129949999999 podStartE2EDuration="1.828612995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:55:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:55:16.826794892 +0000 UTC m=+2684.905564572" watchObservedRunningTime="2026-07-09 22:55:16.828612995 +0000 UTC m=+2684.907382683"
Jul 09 22:55:17.818299 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:17.818267    2583 generic.go:356] "Generic (PLEG): container finished" podID="872ed038-e9f2-4c28-b097-fa86d7ce01e5" containerID="0adc00f6ea35ef0b6f309eaec80c8768bb8464d61c1e340a9e2e18333cc87842" exitCode=0
Jul 09 22:55:17.818732 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:17.818361    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd" event={"ID":"872ed038-e9f2-4c28-b097-fa86d7ce01e5","Type":"ContainerDied","Data":"0adc00f6ea35ef0b6f309eaec80c8768bb8464d61c1e340a9e2e18333cc87842"}
Jul 09 22:55:18.954877 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:18.954849    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd"
Jul 09 22:55:19.089037 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:19.088940    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/872ed038-e9f2-4c28-b097-fa86d7ce01e5-maas-api-service-ca\") pod \"872ed038-e9f2-4c28-b097-fa86d7ce01e5\" (UID: \"872ed038-e9f2-4c28-b097-fa86d7ce01e5\") "
Jul 09 22:55:19.089339 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:19.089317    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/872ed038-e9f2-4c28-b097-fa86d7ce01e5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "872ed038-e9f2-4c28-b097-fa86d7ce01e5" (UID: "872ed038-e9f2-4c28-b097-fa86d7ce01e5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:55:19.189998 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:19.189957    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/872ed038-e9f2-4c28-b097-fa86d7ce01e5-maas-api-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:55:19.829600 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:19.829563    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd" event={"ID":"872ed038-e9f2-4c28-b097-fa86d7ce01e5","Type":"ContainerDied","Data":"3a3d43f82ce0dc82900a235477742b07a00b5f9370c89f9a82a02d27caa2bd2a"}
Jul 09 22:55:19.829600 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:19.829593    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd"
Jul 09 22:55:19.829876 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:19.829613    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a3d43f82ce0dc82900a235477742b07a00b5f9370c89f9a82a02d27caa2bd2a"
Jul 09 22:55:26.325369 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.325274    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"]
Jul 09 22:55:26.325812 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.325564    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648" podUID="0b5a17fe-6aef-41a3-a4f1-d3a419926a7a" containerName="maas-api" containerID="cri-o://1ae361d0a3ff3c2088a2bbce0d0b67616eab30b5414243708ce1645d5b0fb2a8" gracePeriod=30
Jul 09 22:55:26.569340 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.569307    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"
Jul 09 22:55:26.650967 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.650930    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phbc2\" (UniqueName: \"kubernetes.io/projected/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-kube-api-access-phbc2\") pod \"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a\" (UID: \"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a\") "
Jul 09 22:55:26.651188 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.650988    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-openshift-service-ca\") pod \"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a\" (UID: \"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a\") "
Jul 09 22:55:26.651188 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.651021    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-maas-api-tls\") pod \"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a\" (UID: \"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a\") "
Jul 09 22:55:26.651456 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.651431    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0b5a17fe-6aef-41a3-a4f1-d3a419926a7a" (UID: "0b5a17fe-6aef-41a3-a4f1-d3a419926a7a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 22:55:26.653158 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.653133    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0b5a17fe-6aef-41a3-a4f1-d3a419926a7a" (UID: "0b5a17fe-6aef-41a3-a4f1-d3a419926a7a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:55:26.653219 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.653163    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-kube-api-access-phbc2" (OuterVolumeSpecName: "kube-api-access-phbc2") pod "0b5a17fe-6aef-41a3-a4f1-d3a419926a7a" (UID: "0b5a17fe-6aef-41a3-a4f1-d3a419926a7a"). InnerVolumeSpecName "kube-api-access-phbc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:55:26.751849 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.751812    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phbc2\" (UniqueName: \"kubernetes.io/projected/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-kube-api-access-phbc2\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:55:26.751849 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.751842    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:55:26.751849 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.751854    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:55:26.864520 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.864489    2583 generic.go:356] "Generic (PLEG): container finished" podID="0b5a17fe-6aef-41a3-a4f1-d3a419926a7a" containerID="1ae361d0a3ff3c2088a2bbce0d0b67616eab30b5414243708ce1645d5b0fb2a8" exitCode=0
Jul 09 22:55:26.864743 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.864535    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"
Jul 09 22:55:26.864743 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.864579    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648" event={"ID":"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a","Type":"ContainerDied","Data":"1ae361d0a3ff3c2088a2bbce0d0b67616eab30b5414243708ce1645d5b0fb2a8"}
Jul 09 22:55:26.864743 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.864644    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648" event={"ID":"0b5a17fe-6aef-41a3-a4f1-d3a419926a7a","Type":"ContainerDied","Data":"060086b168b304b8e5fc8a8fc136f130ff7cbed3f74d73f5afe52d5bd1d98a2d"}
Jul 09 22:55:26.864743 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.864673    2583 scope.go:117] "RemoveContainer" containerID="1ae361d0a3ff3c2088a2bbce0d0b67616eab30b5414243708ce1645d5b0fb2a8"
Jul 09 22:55:26.876522 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.875186    2583 scope.go:117] "RemoveContainer" containerID="1ae361d0a3ff3c2088a2bbce0d0b67616eab30b5414243708ce1645d5b0fb2a8"
Jul 09 22:55:26.876522 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:55:26.875578    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ae361d0a3ff3c2088a2bbce0d0b67616eab30b5414243708ce1645d5b0fb2a8\": container with ID starting with 1ae361d0a3ff3c2088a2bbce0d0b67616eab30b5414243708ce1645d5b0fb2a8 not found: ID does not exist" containerID="1ae361d0a3ff3c2088a2bbce0d0b67616eab30b5414243708ce1645d5b0fb2a8"
Jul 09 22:55:26.876522 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.875628    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ae361d0a3ff3c2088a2bbce0d0b67616eab30b5414243708ce1645d5b0fb2a8"} err="failed to get container status \"1ae361d0a3ff3c2088a2bbce0d0b67616eab30b5414243708ce1645d5b0fb2a8\": rpc error: code = NotFound desc = could not find container \"1ae361d0a3ff3c2088a2bbce0d0b67616eab30b5414243708ce1645d5b0fb2a8\": container with ID starting with 1ae361d0a3ff3c2088a2bbce0d0b67616eab30b5414243708ce1645d5b0fb2a8 not found: ID does not exist"
Jul 09 22:55:26.891811 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.891777    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"]
Jul 09 22:55:26.895908 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:26.895884    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6ddc6a-854876c9c4-mp648"]
Jul 09 22:55:28.486564 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:28.486533    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b5a17fe-6aef-41a3-a4f1-d3a419926a7a" path="/var/lib/kubelet/pods/0b5a17fe-6aef-41a3-a4f1-d3a419926a7a/volumes"
Jul 09 22:55:45.802487 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:45.802451    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"]
Jul 09 22:55:45.803006 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:45.802759    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="872ed038-e9f2-4c28-b097-fa86d7ce01e5" containerName="revoke-keys"
Jul 09 22:55:45.803006 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:45.802769    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="872ed038-e9f2-4c28-b097-fa86d7ce01e5" containerName="revoke-keys"
Jul 09 22:55:45.803006 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:45.802792    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b5a17fe-6aef-41a3-a4f1-d3a419926a7a" containerName="maas-api"
Jul 09 22:55:45.803006 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:45.802798    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b5a17fe-6aef-41a3-a4f1-d3a419926a7a" containerName="maas-api"
Jul 09 22:55:45.803006 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:45.802840    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b5a17fe-6aef-41a3-a4f1-d3a419926a7a" containerName="maas-api"
Jul 09 22:55:45.803006 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:45.802851    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="872ed038-e9f2-4c28-b097-fa86d7ce01e5" containerName="revoke-keys"
Jul 09 22:55:45.805767 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:45.805743    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"
Jul 09 22:55:45.808458 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:45.808432    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2qlgm\""
Jul 09 22:55:45.808709 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:45.808691    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-8a6043-serving-cert\""
Jul 09 22:55:45.808781 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:45.808725    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 22:55:45.808988 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:45.808970    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 22:55:45.816998 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:45.816969    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"]
Jul 09 22:55:45.917341 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:45.917303    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86xvl\" (UniqueName: \"kubernetes.io/projected/b2e23a3b-66cc-47db-a194-f95b55daedf1-kube-api-access-86xvl\") pod \"maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr\" (UID: \"b2e23a3b-66cc-47db-a194-f95b55daedf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"
Jul 09 22:55:45.917562 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:45.917359    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2e23a3b-66cc-47db-a194-f95b55daedf1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr\" (UID: \"b2e23a3b-66cc-47db-a194-f95b55daedf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"
Jul 09 22:55:45.917562 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:45.917470    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2e23a3b-66cc-47db-a194-f95b55daedf1-maas-api-tls\") pod \"maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr\" (UID: \"b2e23a3b-66cc-47db-a194-f95b55daedf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"
Jul 09 22:55:46.018753 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:46.018715    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86xvl\" (UniqueName: \"kubernetes.io/projected/b2e23a3b-66cc-47db-a194-f95b55daedf1-kube-api-access-86xvl\") pod \"maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr\" (UID: \"b2e23a3b-66cc-47db-a194-f95b55daedf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"
Jul 09 22:55:46.018940 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:46.018763    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2e23a3b-66cc-47db-a194-f95b55daedf1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr\" (UID: \"b2e23a3b-66cc-47db-a194-f95b55daedf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"
Jul 09 22:55:46.018940 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:46.018820    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2e23a3b-66cc-47db-a194-f95b55daedf1-maas-api-tls\") pod \"maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr\" (UID: \"b2e23a3b-66cc-47db-a194-f95b55daedf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"
Jul 09 22:55:46.019570 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:46.019549    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2e23a3b-66cc-47db-a194-f95b55daedf1-openshift-service-ca\") pod \"maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr\" (UID: \"b2e23a3b-66cc-47db-a194-f95b55daedf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"
Jul 09 22:55:46.021239 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:46.021219    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2e23a3b-66cc-47db-a194-f95b55daedf1-maas-api-tls\") pod \"maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr\" (UID: \"b2e23a3b-66cc-47db-a194-f95b55daedf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"
Jul 09 22:55:46.034232 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:46.034198    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86xvl\" (UniqueName: \"kubernetes.io/projected/b2e23a3b-66cc-47db-a194-f95b55daedf1-kube-api-access-86xvl\") pod \"maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr\" (UID: \"b2e23a3b-66cc-47db-a194-f95b55daedf1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"
Jul 09 22:55:46.118390 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:46.118290    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"
Jul 09 22:55:46.260869 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:46.260843    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"]
Jul 09 22:55:46.263723 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:55:46.263688    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e23a3b_66cc_47db_a194_f95b55daedf1.slice/crio-d666a2be5df22907ce749420c750da36cb9537db7e028e8dda1587b7fe2c327e WatchSource:0}: Error finding container d666a2be5df22907ce749420c750da36cb9537db7e028e8dda1587b7fe2c327e: Status 404 returned error can't find the container with id d666a2be5df22907ce749420c750da36cb9537db7e028e8dda1587b7fe2c327e
Jul 09 22:55:46.966432 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:46.966389    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr" event={"ID":"b2e23a3b-66cc-47db-a194-f95b55daedf1","Type":"ContainerStarted","Data":"d666a2be5df22907ce749420c750da36cb9537db7e028e8dda1587b7fe2c327e"}
Jul 09 22:55:47.972623 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:47.972584    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr" event={"ID":"b2e23a3b-66cc-47db-a194-f95b55daedf1","Type":"ContainerStarted","Data":"82a7f0b90b9a33175a2ef84ebcab1f6f832f4fe473fcef80891f13fa355be5b1"}
Jul 09 22:55:47.973042 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:47.972716    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"
Jul 09 22:55:47.991188 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:47.991130    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr" podStartSLOduration=2.337645273 podStartE2EDuration="2.991111436s" totalImagesPullingTime="653.466163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:55:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:55:47.9894886 +0000 UTC m=+2716.068258282" watchObservedRunningTime="2026-07-09 22:55:47.991111436 +0000 UTC m=+2716.069881110"
Jul 09 22:55:53.752896 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:53.752855    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"]
Jul 09 22:55:53.756876 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:53.756855    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"
Jul 09 22:55:53.759003 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:53.758975    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-862c5d-serving-cert\""
Jul 09 22:55:53.766683 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:53.766655    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"]
Jul 09 22:55:53.789657 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:53.789625    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2ae98e8-0d6c-4de8-9674-47bec791879d-maas-api-tls\") pod \"maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2\" (UID: \"d2ae98e8-0d6c-4de8-9674-47bec791879d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"
Jul 09 22:55:53.789657 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:53.789661    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2ae98e8-0d6c-4de8-9674-47bec791879d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2\" (UID: \"d2ae98e8-0d6c-4de8-9674-47bec791879d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"
Jul 09 22:55:53.789883 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:53.789699    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl58b\" (UniqueName: \"kubernetes.io/projected/d2ae98e8-0d6c-4de8-9674-47bec791879d-kube-api-access-dl58b\") pod \"maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2\" (UID: \"d2ae98e8-0d6c-4de8-9674-47bec791879d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"
Jul 09 22:55:53.890193 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:53.890155    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl58b\" (UniqueName: \"kubernetes.io/projected/d2ae98e8-0d6c-4de8-9674-47bec791879d-kube-api-access-dl58b\") pod \"maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2\" (UID: \"d2ae98e8-0d6c-4de8-9674-47bec791879d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"
Jul 09 22:55:53.890380 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:53.890270    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2ae98e8-0d6c-4de8-9674-47bec791879d-maas-api-tls\") pod \"maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2\" (UID: \"d2ae98e8-0d6c-4de8-9674-47bec791879d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"
Jul 09 22:55:53.890380 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:53.890288    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2ae98e8-0d6c-4de8-9674-47bec791879d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2\" (UID: \"d2ae98e8-0d6c-4de8-9674-47bec791879d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"
Jul 09 22:55:53.890457 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:55:53.890394    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-serving-cert: secret "maas-api-e2e-shared-b-862c5d-serving-cert" not found
Jul 09 22:55:53.890457 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:55:53.890451    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2ae98e8-0d6c-4de8-9674-47bec791879d-maas-api-tls podName:d2ae98e8-0d6c-4de8-9674-47bec791879d nodeName:}" failed. No retries permitted until 2026-07-09 22:55:54.390435514 +0000 UTC m=+2722.469205171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d2ae98e8-0d6c-4de8-9674-47bec791879d-maas-api-tls") pod "maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2" (UID: "d2ae98e8-0d6c-4de8-9674-47bec791879d") : secret "maas-api-e2e-shared-b-862c5d-serving-cert" not found
Jul 09 22:55:53.890880 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:53.890861    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2ae98e8-0d6c-4de8-9674-47bec791879d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2\" (UID: \"d2ae98e8-0d6c-4de8-9674-47bec791879d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"
Jul 09 22:55:53.900617 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:53.900583    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl58b\" (UniqueName: \"kubernetes.io/projected/d2ae98e8-0d6c-4de8-9674-47bec791879d-kube-api-access-dl58b\") pod \"maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2\" (UID: \"d2ae98e8-0d6c-4de8-9674-47bec791879d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"
Jul 09 22:55:53.984700 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:53.984671    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"
Jul 09 22:55:54.394596 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:54.394562    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2ae98e8-0d6c-4de8-9674-47bec791879d-maas-api-tls\") pod \"maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2\" (UID: \"d2ae98e8-0d6c-4de8-9674-47bec791879d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"
Jul 09 22:55:54.397041 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:54.397014    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2ae98e8-0d6c-4de8-9674-47bec791879d-maas-api-tls\") pod \"maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2\" (UID: \"d2ae98e8-0d6c-4de8-9674-47bec791879d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"
Jul 09 22:55:54.669715 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:54.669615    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"
Jul 09 22:55:54.807994 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:54.807968    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"]
Jul 09 22:55:54.809927 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:55:54.809895    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ae98e8_0d6c_4de8_9674_47bec791879d.slice/crio-74fa9dd97149fdb2e4d2e4af92baa5492b7ec3ee83c51734ce81c75a7e502318 WatchSource:0}: Error finding container 74fa9dd97149fdb2e4d2e4af92baa5492b7ec3ee83c51734ce81c75a7e502318: Status 404 returned error can't find the container with id 74fa9dd97149fdb2e4d2e4af92baa5492b7ec3ee83c51734ce81c75a7e502318
Jul 09 22:55:55.009202 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:55.009084    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2" event={"ID":"d2ae98e8-0d6c-4de8-9674-47bec791879d","Type":"ContainerStarted","Data":"74fa9dd97149fdb2e4d2e4af92baa5492b7ec3ee83c51734ce81c75a7e502318"}
Jul 09 22:55:56.015836 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:56.015802    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2" event={"ID":"d2ae98e8-0d6c-4de8-9674-47bec791879d","Type":"ContainerStarted","Data":"c8c9d71fc24804056e5eae21329ae9e2e46756918ab6126b7879804fb811e2f2"}
Jul 09 22:55:56.016267 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:56.015915    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"
Jul 09 22:55:56.033792 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:55:56.033733    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2" podStartSLOduration=2.65885105 podStartE2EDuration="3.033715464s" totalImagesPullingTime="374.864414ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:55:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:55:56.031567394 +0000 UTC m=+2724.110337075" watchObservedRunningTime="2026-07-09 22:55:56.033715464 +0000 UTC m=+2724.112485143"
Jul 09 22:56:02.027234 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:02.027200    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"
Jul 09 22:56:13.634569 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.634528    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"]
Jul 09 22:56:13.637488 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.637471    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.640405 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.640364    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8a6043\"/\"auth-test-model-8a6043-kserve-self-signed-certs\""
Jul 09 22:56:13.640405 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.640388    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8a6043\"/\"default-dockercfg-gw79p\""
Jul 09 22:56:13.640619 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.640376    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8a6043\"/\"openshift-service-ca.crt\""
Jul 09 22:56:13.640619 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.640376    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8a6043\"/\"kube-root-ca.crt\""
Jul 09 22:56:13.648122 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.648074    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"]
Jul 09 22:56:13.751446 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.751410    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-tmp-dir\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.751446 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.751453    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rtrt\" (UniqueName: \"kubernetes.io/projected/493362e0-43ec-41dc-828c-ad4c5bb41008-kube-api-access-7rtrt\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.751666 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.751477    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-home\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.751666 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.751559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-dshm\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.751666 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.751597    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-model-cache\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.751666 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.751612    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/493362e0-43ec-41dc-828c-ad4c5bb41008-tls-certs\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.852945 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.852901    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-model-cache\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.852945 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.852945    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/493362e0-43ec-41dc-828c-ad4c5bb41008-tls-certs\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.853210 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.852992    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-tmp-dir\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.853210 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.853012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rtrt\" (UniqueName: \"kubernetes.io/projected/493362e0-43ec-41dc-828c-ad4c5bb41008-kube-api-access-7rtrt\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.853210 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.853034    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-home\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.853210 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.853116    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-dshm\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.853455 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.853409    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-model-cache\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.853455 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.853424    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-tmp-dir\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.853568 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.853452    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-home\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.855453 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.855434    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-dshm\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.855723 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.855702    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/493362e0-43ec-41dc-828c-ad4c5bb41008-tls-certs\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.863886 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.863859    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rtrt\" (UniqueName: \"kubernetes.io/projected/493362e0-43ec-41dc-828c-ad4c5bb41008-kube-api-access-7rtrt\") pod \"auth-test-model-8a6043-kserve-78f7996c47-wqh8m\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") " pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:13.947131 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:13.947013    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:14.081941 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:14.081903    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"]
Jul 09 22:56:14.084053 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:56:14.084023    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod493362e0_43ec_41dc_828c_ad4c5bb41008.slice/crio-7dd9d684d77934398aaa38ea60c90b889f249720796c96aea999f2cf1964a3d1 WatchSource:0}: Error finding container 7dd9d684d77934398aaa38ea60c90b889f249720796c96aea999f2cf1964a3d1: Status 404 returned error can't find the container with id 7dd9d684d77934398aaa38ea60c90b889f249720796c96aea999f2cf1964a3d1
Jul 09 22:56:14.109333 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:14.109303    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m" event={"ID":"493362e0-43ec-41dc-828c-ad4c5bb41008","Type":"ContainerStarted","Data":"7dd9d684d77934398aaa38ea60c90b889f249720796c96aea999f2cf1964a3d1"}
Jul 09 22:56:15.116159 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:15.116118    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m" event={"ID":"493362e0-43ec-41dc-828c-ad4c5bb41008","Type":"ContainerStarted","Data":"7e1d3bc6d4d123b07bc5fe9b27b75307bf3c3717781d8293927eb4aab803756f"}
Jul 09 22:56:15.133076 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:15.133021    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m" podStartSLOduration=2.133003704 podStartE2EDuration="2.133003704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:56:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:56:15.131993979 +0000 UTC m=+2743.210763671" watchObservedRunningTime="2026-07-09 22:56:15.133003704 +0000 UTC m=+2743.211773383"
Jul 09 22:56:23.947967 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:23.947929    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:23.948460 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:23.948229    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:23.960609 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:23.960580    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:56:24.171163 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:56:24.171122    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:58:42.292488 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:42.292406    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"]
Jul 09 22:58:47.007154 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.007107    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"]
Jul 09 22:58:47.010498 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.010475    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.012646 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.012625    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8a6043\"/\"sub-test-model-8a6043-kserve-self-signed-certs\""
Jul 09 22:58:47.019173 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.019148    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"]
Jul 09 22:58:47.084488 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.084451    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-home\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.084488 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.084493    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-tmp-dir\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.084713 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.084519    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xww9w\" (UniqueName: \"kubernetes.io/projected/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-kube-api-access-xww9w\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.084713 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.084546    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-model-cache\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.084713 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.084621    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-tls-certs\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.084713 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.084703    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-dshm\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.185627 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.185586    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-tls-certs\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.185822 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.185662    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-dshm\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.185822 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.185697    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-home\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.185822 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.185718    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-tmp-dir\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.185822 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.185755    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xww9w\" (UniqueName: \"kubernetes.io/projected/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-kube-api-access-xww9w\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.185999 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.185892    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-model-cache\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.186219 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.186199    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-home\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.186319 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.186245    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-tmp-dir\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.186319 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.186271    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-model-cache\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.188024 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.187999    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-dshm\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.188257 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.188238    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-tls-certs\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.193686 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.193661    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xww9w\" (UniqueName: \"kubernetes.io/projected/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-kube-api-access-xww9w\") pod \"sub-test-model-8a6043-kserve-75cdb855dc-mlgs4\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") " pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.320208 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.320078    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:47.460819 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.460791    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"]
Jul 09 22:58:47.463398 ip-10-0-143-205 kubenswrapper[2583]: W0709 22:58:47.463362    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b3d2d6f_46e6_41ae_9ec6_28c85b58809e.slice/crio-682e75fc8a33513fcc5a0277eb3e71eeed7a221d6a1313d07635e19666d98188 WatchSource:0}: Error finding container 682e75fc8a33513fcc5a0277eb3e71eeed7a221d6a1313d07635e19666d98188: Status 404 returned error can't find the container with id 682e75fc8a33513fcc5a0277eb3e71eeed7a221d6a1313d07635e19666d98188
Jul 09 22:58:47.906464 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.906429    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4" event={"ID":"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e","Type":"ContainerStarted","Data":"e6ef7c53359a3b37f018bd369edaca006c9e7f8fdd4b99b39f6ec86340ea98f5"}
Jul 09 22:58:47.906659 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.906474    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4" event={"ID":"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e","Type":"ContainerStarted","Data":"682e75fc8a33513fcc5a0277eb3e71eeed7a221d6a1313d07635e19666d98188"}
Jul 09 22:58:47.924378 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:47.924322    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4" podStartSLOduration=1.924306713 podStartE2EDuration="1.924306713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:58:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:58:47.922688753 +0000 UTC m=+2896.001458435" watchObservedRunningTime="2026-07-09 22:58:47.924306713 +0000 UTC m=+2896.003076393"
Jul 09 22:58:57.312237 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.312171    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m" podUID="493362e0-43ec-41dc-828c-ad4c5bb41008" containerName="main" containerID="cri-o://7e1d3bc6d4d123b07bc5fe9b27b75307bf3c3717781d8293927eb4aab803756f" gracePeriod=45
Jul 09 22:58:57.320721 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.320687    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:57.320867 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.320767    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:57.333899 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.333877    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:57.570201 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.570120    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:58:57.678352 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.678311    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/493362e0-43ec-41dc-828c-ad4c5bb41008-tls-certs\") pod \"493362e0-43ec-41dc-828c-ad4c5bb41008\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") "
Jul 09 22:58:57.678352 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.678361    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-home\") pod \"493362e0-43ec-41dc-828c-ad4c5bb41008\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") "
Jul 09 22:58:57.678600 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.678401    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rtrt\" (UniqueName: \"kubernetes.io/projected/493362e0-43ec-41dc-828c-ad4c5bb41008-kube-api-access-7rtrt\") pod \"493362e0-43ec-41dc-828c-ad4c5bb41008\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") "
Jul 09 22:58:57.678600 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.678423    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-dshm\") pod \"493362e0-43ec-41dc-828c-ad4c5bb41008\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") "
Jul 09 22:58:57.678600 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.678450    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-model-cache\") pod \"493362e0-43ec-41dc-828c-ad4c5bb41008\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") "
Jul 09 22:58:57.678600 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.678491    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-tmp-dir\") pod \"493362e0-43ec-41dc-828c-ad4c5bb41008\" (UID: \"493362e0-43ec-41dc-828c-ad4c5bb41008\") "
Jul 09 22:58:57.678816 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.678680    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-home" (OuterVolumeSpecName: "home") pod "493362e0-43ec-41dc-828c-ad4c5bb41008" (UID: "493362e0-43ec-41dc-828c-ad4c5bb41008"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:58:57.678816 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.678799    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-model-cache" (OuterVolumeSpecName: "model-cache") pod "493362e0-43ec-41dc-828c-ad4c5bb41008" (UID: "493362e0-43ec-41dc-828c-ad4c5bb41008"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:58:57.678908 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.678847    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "493362e0-43ec-41dc-828c-ad4c5bb41008" (UID: "493362e0-43ec-41dc-828c-ad4c5bb41008"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:58:57.680656 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.680631    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-dshm" (OuterVolumeSpecName: "dshm") pod "493362e0-43ec-41dc-828c-ad4c5bb41008" (UID: "493362e0-43ec-41dc-828c-ad4c5bb41008"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 22:58:57.680777 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.680723    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/493362e0-43ec-41dc-828c-ad4c5bb41008-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "493362e0-43ec-41dc-828c-ad4c5bb41008" (UID: "493362e0-43ec-41dc-828c-ad4c5bb41008"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 22:58:57.680817 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.680772    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/493362e0-43ec-41dc-828c-ad4c5bb41008-kube-api-access-7rtrt" (OuterVolumeSpecName: "kube-api-access-7rtrt") pod "493362e0-43ec-41dc-828c-ad4c5bb41008" (UID: "493362e0-43ec-41dc-828c-ad4c5bb41008"). InnerVolumeSpecName "kube-api-access-7rtrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 22:58:57.779845 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.779792    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-tmp-dir\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:58:57.779845 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.779837    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/493362e0-43ec-41dc-828c-ad4c5bb41008-tls-certs\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:58:57.779845 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.779846    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-home\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:58:57.779845 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.779855    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rtrt\" (UniqueName: \"kubernetes.io/projected/493362e0-43ec-41dc-828c-ad4c5bb41008-kube-api-access-7rtrt\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:58:57.779845 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.779863    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-dshm\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:58:57.780195 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.779872    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/493362e0-43ec-41dc-828c-ad4c5bb41008-model-cache\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 22:58:57.962683 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.962648    2583 generic.go:356] "Generic (PLEG): container finished" podID="493362e0-43ec-41dc-828c-ad4c5bb41008" containerID="7e1d3bc6d4d123b07bc5fe9b27b75307bf3c3717781d8293927eb4aab803756f" exitCode=0
Jul 09 22:58:57.962864 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.962699    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"
Jul 09 22:58:57.962864 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.962737    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m" event={"ID":"493362e0-43ec-41dc-828c-ad4c5bb41008","Type":"ContainerDied","Data":"7e1d3bc6d4d123b07bc5fe9b27b75307bf3c3717781d8293927eb4aab803756f"}
Jul 09 22:58:57.962864 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.962779    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m" event={"ID":"493362e0-43ec-41dc-828c-ad4c5bb41008","Type":"ContainerDied","Data":"7dd9d684d77934398aaa38ea60c90b889f249720796c96aea999f2cf1964a3d1"}
Jul 09 22:58:57.962864 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.962803    2583 scope.go:117] "RemoveContainer" containerID="7e1d3bc6d4d123b07bc5fe9b27b75307bf3c3717781d8293927eb4aab803756f"
Jul 09 22:58:57.973347 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.973326    2583 scope.go:117] "RemoveContainer" containerID="7e1d3bc6d4d123b07bc5fe9b27b75307bf3c3717781d8293927eb4aab803756f"
Jul 09 22:58:57.973696 ip-10-0-143-205 kubenswrapper[2583]: E0709 22:58:57.973676    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e1d3bc6d4d123b07bc5fe9b27b75307bf3c3717781d8293927eb4aab803756f\": container with ID starting with 7e1d3bc6d4d123b07bc5fe9b27b75307bf3c3717781d8293927eb4aab803756f not found: ID does not exist" containerID="7e1d3bc6d4d123b07bc5fe9b27b75307bf3c3717781d8293927eb4aab803756f"
Jul 09 22:58:57.973776 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.973711    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e1d3bc6d4d123b07bc5fe9b27b75307bf3c3717781d8293927eb4aab803756f"} err="failed to get container status \"7e1d3bc6d4d123b07bc5fe9b27b75307bf3c3717781d8293927eb4aab803756f\": rpc error: code = NotFound desc = could not find container \"7e1d3bc6d4d123b07bc5fe9b27b75307bf3c3717781d8293927eb4aab803756f\": container with ID starting with 7e1d3bc6d4d123b07bc5fe9b27b75307bf3c3717781d8293927eb4aab803756f not found: ID does not exist"
Jul 09 22:58:57.975011 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.974988    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 22:58:57.987064 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.987036    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"]
Jul 09 22:58:57.991078 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:57.991048    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/auth-test-model-8a6043-kserve-78f7996c47-wqh8m"]
Jul 09 22:58:58.486618 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:58:58.486583    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="493362e0-43ec-41dc-828c-ad4c5bb41008" path="/var/lib/kubelet/pods/493362e0-43ec-41dc-828c-ad4c5bb41008/volumes"
Jul 09 22:59:48.585690 ip-10-0-143-205 kubenswrapper[2583]: I0709 22:59:48.585652    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"]
Jul 09 23:00:03.605996 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:03.605884    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4" podUID="2b3d2d6f-46e6-41ae-9ec6-28c85b58809e" containerName="main" containerID="cri-o://e6ef7c53359a3b37f018bd369edaca006c9e7f8fdd4b99b39f6ec86340ea98f5" gracePeriod=45
Jul 09 23:00:03.859192 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:03.859124    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 23:00:03.956118 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:03.956053    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xww9w\" (UniqueName: \"kubernetes.io/projected/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-kube-api-access-xww9w\") pod \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") "
Jul 09 23:00:03.956118 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:03.956127    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-tmp-dir\") pod \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") "
Jul 09 23:00:03.956390 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:03.956151    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-dshm\") pod \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") "
Jul 09 23:00:03.956390 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:03.956206    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-home\") pod \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") "
Jul 09 23:00:03.956390 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:03.956258    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-tls-certs\") pod \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") "
Jul 09 23:00:03.956390 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:03.956302    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-model-cache\") pod \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\" (UID: \"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e\") "
Jul 09 23:00:03.956617 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:03.956434    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b3d2d6f-46e6-41ae-9ec6-28c85b58809e" (UID: "2b3d2d6f-46e6-41ae-9ec6-28c85b58809e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:00:03.956617 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:03.956502    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-home" (OuterVolumeSpecName: "home") pod "2b3d2d6f-46e6-41ae-9ec6-28c85b58809e" (UID: "2b3d2d6f-46e6-41ae-9ec6-28c85b58809e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:00:03.956780 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:03.956616    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-home\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:00:03.956780 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:03.956628    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b3d2d6f-46e6-41ae-9ec6-28c85b58809e" (UID: "2b3d2d6f-46e6-41ae-9ec6-28c85b58809e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:00:03.956780 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:03.956648    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-tmp-dir\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:00:03.958310 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:03.958281    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-dshm" (OuterVolumeSpecName: "dshm") pod "2b3d2d6f-46e6-41ae-9ec6-28c85b58809e" (UID: "2b3d2d6f-46e6-41ae-9ec6-28c85b58809e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:00:03.958430 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:03.958333    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b3d2d6f-46e6-41ae-9ec6-28c85b58809e" (UID: "2b3d2d6f-46e6-41ae-9ec6-28c85b58809e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 23:00:03.958479 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:03.958441    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-kube-api-access-xww9w" (OuterVolumeSpecName: "kube-api-access-xww9w") pod "2b3d2d6f-46e6-41ae-9ec6-28c85b58809e" (UID: "2b3d2d6f-46e6-41ae-9ec6-28c85b58809e"). InnerVolumeSpecName "kube-api-access-xww9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:00:04.057932 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:04.057893    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-tls-certs\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:00:04.057932 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:04.057928    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-model-cache\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:00:04.057932 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:04.057937    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xww9w\" (UniqueName: \"kubernetes.io/projected/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-kube-api-access-xww9w\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:00:04.058219 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:04.057946    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e-dshm\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:00:04.337556 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:04.337519    2583 generic.go:356] "Generic (PLEG): container finished" podID="2b3d2d6f-46e6-41ae-9ec6-28c85b58809e" containerID="e6ef7c53359a3b37f018bd369edaca006c9e7f8fdd4b99b39f6ec86340ea98f5" exitCode=0
Jul 09 23:00:04.337788 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:04.337575    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"
Jul 09 23:00:04.337788 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:04.337610    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4" event={"ID":"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e","Type":"ContainerDied","Data":"e6ef7c53359a3b37f018bd369edaca006c9e7f8fdd4b99b39f6ec86340ea98f5"}
Jul 09 23:00:04.337788 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:04.337673    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4" event={"ID":"2b3d2d6f-46e6-41ae-9ec6-28c85b58809e","Type":"ContainerDied","Data":"682e75fc8a33513fcc5a0277eb3e71eeed7a221d6a1313d07635e19666d98188"}
Jul 09 23:00:04.337788 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:04.337700    2583 scope.go:117] "RemoveContainer" containerID="e6ef7c53359a3b37f018bd369edaca006c9e7f8fdd4b99b39f6ec86340ea98f5"
Jul 09 23:00:04.347540 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:04.347520    2583 scope.go:117] "RemoveContainer" containerID="e6ef7c53359a3b37f018bd369edaca006c9e7f8fdd4b99b39f6ec86340ea98f5"
Jul 09 23:00:04.347836 ip-10-0-143-205 kubenswrapper[2583]: E0709 23:00:04.347814    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6ef7c53359a3b37f018bd369edaca006c9e7f8fdd4b99b39f6ec86340ea98f5\": container with ID starting with e6ef7c53359a3b37f018bd369edaca006c9e7f8fdd4b99b39f6ec86340ea98f5 not found: ID does not exist" containerID="e6ef7c53359a3b37f018bd369edaca006c9e7f8fdd4b99b39f6ec86340ea98f5"
Jul 09 23:00:04.347876 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:04.347848    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6ef7c53359a3b37f018bd369edaca006c9e7f8fdd4b99b39f6ec86340ea98f5"} err="failed to get container status \"e6ef7c53359a3b37f018bd369edaca006c9e7f8fdd4b99b39f6ec86340ea98f5\": rpc error: code = NotFound desc = could not find container \"e6ef7c53359a3b37f018bd369edaca006c9e7f8fdd4b99b39f6ec86340ea98f5\": container with ID starting with e6ef7c53359a3b37f018bd369edaca006c9e7f8fdd4b99b39f6ec86340ea98f5 not found: ID does not exist"
Jul 09 23:00:04.359026 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:04.358990    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"]
Jul 09 23:00:04.362509 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:04.362480    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/sub-test-model-8a6043-kserve-75cdb855dc-mlgs4"]
Jul 09 23:00:04.487160 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:04.487118    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b3d2d6f-46e6-41ae-9ec6-28c85b58809e" path="/var/lib/kubelet/pods/2b3d2d6f-46e6-41ae-9ec6-28c85b58809e/volumes"
Jul 09 23:00:07.213143 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.213113    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"]
Jul 09 23:00:07.213586 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.213566    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="493362e0-43ec-41dc-828c-ad4c5bb41008" containerName="main"
Jul 09 23:00:07.213640 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.213591    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="493362e0-43ec-41dc-828c-ad4c5bb41008" containerName="main"
Jul 09 23:00:07.213640 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.213605    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3d2d6f-46e6-41ae-9ec6-28c85b58809e" containerName="main"
Jul 09 23:00:07.213640 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.213610    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3d2d6f-46e6-41ae-9ec6-28c85b58809e" containerName="main"
Jul 09 23:00:07.213740 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.213698    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="493362e0-43ec-41dc-828c-ad4c5bb41008" containerName="main"
Jul 09 23:00:07.213740 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.213708    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3d2d6f-46e6-41ae-9ec6-28c85b58809e" containerName="main"
Jul 09 23:00:07.217908 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.217890    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.220153 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.220131    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8a6043\"/\"default-dockercfg-gw79p\""
Jul 09 23:00:07.220283 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.220167    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8a6043\"/\"kube-root-ca.crt\""
Jul 09 23:00:07.221136 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.221111    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8a6043\"/\"openshift-service-ca.crt\""
Jul 09 23:00:07.221275 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.221106    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8a6043\"/\"rate-test-model-8a6043-kserve-self-signed-certs\""
Jul 09 23:00:07.224419 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.224397    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"]
Jul 09 23:00:07.285989 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.285949    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b7dd\" (UniqueName: \"kubernetes.io/projected/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-kube-api-access-5b7dd\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.286280 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.286001    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-dshm\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.286280 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.286034    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-model-cache\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.286280 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.286056    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-home\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.286280 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.286132    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-tls-certs\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.286280 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.286215    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-tmp-dir\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.387204 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.387165    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-tls-certs\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.387506 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.387484    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-tmp-dir\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.387691 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.387669    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b7dd\" (UniqueName: \"kubernetes.io/projected/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-kube-api-access-5b7dd\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.387827 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.387713    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-dshm\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.387827 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.387734    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-model-cache\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.387827 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.387758    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-home\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.388046 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.388019    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-tmp-dir\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.388133 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.388033    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-home\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.388306 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.388263    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-model-cache\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.390193 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.390168    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-dshm\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.390548 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.390531    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-tls-certs\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.396335 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.396305    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b7dd\" (UniqueName: \"kubernetes.io/projected/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-kube-api-access-5b7dd\") pod \"rate-test-model-8a6043-kserve-5c6745698c-8pmqh\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") " pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.528893 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.528776    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:07.667457 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:07.667426    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"]
Jul 09 23:00:07.669352 ip-10-0-143-205 kubenswrapper[2583]: W0709 23:00:07.669321    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5eaadfb_79d8_480b_a9cc_a9325134e9b7.slice/crio-ad196d5401ba1896ef87c551a155c2915bf151370cc150ad13b61ca9508d12eb WatchSource:0}: Error finding container ad196d5401ba1896ef87c551a155c2915bf151370cc150ad13b61ca9508d12eb: Status 404 returned error can't find the container with id ad196d5401ba1896ef87c551a155c2915bf151370cc150ad13b61ca9508d12eb
Jul 09 23:00:08.361270 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:08.361228    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh" event={"ID":"c5eaadfb-79d8-480b-a9cc-a9325134e9b7","Type":"ContainerStarted","Data":"d6e299f644d3ca0fa5a62ac6e863edaed76b4443ff65ce7101d3d98485265507"}
Jul 09 23:00:08.361270 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:08.361274    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh" event={"ID":"c5eaadfb-79d8-480b-a9cc-a9325134e9b7","Type":"ContainerStarted","Data":"ad196d5401ba1896ef87c551a155c2915bf151370cc150ad13b61ca9508d12eb"}
Jul 09 23:00:08.378939 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:08.378885    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh" podStartSLOduration=1.378869262 podStartE2EDuration="1.378869262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:00:08.377047864 +0000 UTC m=+2976.455817543" watchObservedRunningTime="2026-07-09 23:00:08.378869262 +0000 UTC m=+2976.457638941"
Jul 09 23:00:17.529554 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:17.529514    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:17.529974 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:17.529594    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:17.542331 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:17.542300    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:00:18.422259 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:00:18.422231    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:01:11.228876 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:11.228839    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"]
Jul 09 23:01:21.964507 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:21.964475    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7235-139910759980608"]
Jul 09 23:01:21.967528 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:21.967513    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7235-139910759980608"
Jul 09 23:01:21.969897 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:21.969873    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-2sl77\""
Jul 09 23:01:21.971169 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:21.971148    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7235-139910759980608"]
Jul 09 23:01:22.131555 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:22.131517    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7ftk\" (UniqueName: \"kubernetes.io/projected/297820c5-22e4-401f-a516-a7b1d846ac8f-kube-api-access-g7ftk\") pod \"test-curl-7235-139910759980608\" (UID: \"297820c5-22e4-401f-a516-a7b1d846ac8f\") " pod="openshift-ingress/test-curl-7235-139910759980608"
Jul 09 23:01:22.232742 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:22.232642    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7ftk\" (UniqueName: \"kubernetes.io/projected/297820c5-22e4-401f-a516-a7b1d846ac8f-kube-api-access-g7ftk\") pod \"test-curl-7235-139910759980608\" (UID: \"297820c5-22e4-401f-a516-a7b1d846ac8f\") " pod="openshift-ingress/test-curl-7235-139910759980608"
Jul 09 23:01:22.240988 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:22.240948    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7ftk\" (UniqueName: \"kubernetes.io/projected/297820c5-22e4-401f-a516-a7b1d846ac8f-kube-api-access-g7ftk\") pod \"test-curl-7235-139910759980608\" (UID: \"297820c5-22e4-401f-a516-a7b1d846ac8f\") " pod="openshift-ingress/test-curl-7235-139910759980608"
Jul 09 23:01:22.277812 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:22.277773    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7235-139910759980608"
Jul 09 23:01:22.411464 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:22.411440    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7235-139910759980608"]
Jul 09 23:01:22.417424 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:22.417398    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 23:01:22.756526 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:22.756492    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7235-139910759980608" event={"ID":"297820c5-22e4-401f-a516-a7b1d846ac8f","Type":"ContainerStarted","Data":"a8a874379403c972a7c2c0ad4aa7b3dfd926362fa0803bfad9acf66a52e61a10"}
Jul 09 23:01:23.766535 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:23.766501    2583 generic.go:356] "Generic (PLEG): container finished" podID="297820c5-22e4-401f-a516-a7b1d846ac8f" containerID="6b524e7d12652e4134cfceef7d1b315115ad3063d11e77cc1a7c7ee7888eef55" exitCode=0
Jul 09 23:01:23.766974 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:23.766598    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7235-139910759980608" event={"ID":"297820c5-22e4-401f-a516-a7b1d846ac8f","Type":"ContainerDied","Data":"6b524e7d12652e4134cfceef7d1b315115ad3063d11e77cc1a7c7ee7888eef55"}
Jul 09 23:01:24.918042 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:24.918010    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7235-139910759980608"
Jul 09 23:01:24.963422 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:24.963395    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7235-139910759980608_297820c5-22e4-401f-a516-a7b1d846ac8f/test-curl-7235-139910759980608/0.log"
Jul 09 23:01:24.991320 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:24.991276    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7235-139910759980608"]
Jul 09 23:01:24.995105 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:24.995064    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7235-139910759980608"]
Jul 09 23:01:25.060235 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:25.060156    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7ftk\" (UniqueName: \"kubernetes.io/projected/297820c5-22e4-401f-a516-a7b1d846ac8f-kube-api-access-g7ftk\") pod \"297820c5-22e4-401f-a516-a7b1d846ac8f\" (UID: \"297820c5-22e4-401f-a516-a7b1d846ac8f\") "
Jul 09 23:01:25.062252 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:25.062223    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/297820c5-22e4-401f-a516-a7b1d846ac8f-kube-api-access-g7ftk" (OuterVolumeSpecName: "kube-api-access-g7ftk") pod "297820c5-22e4-401f-a516-a7b1d846ac8f" (UID: "297820c5-22e4-401f-a516-a7b1d846ac8f"). InnerVolumeSpecName "kube-api-access-g7ftk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:01:25.161340 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:25.161300    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7ftk\" (UniqueName: \"kubernetes.io/projected/297820c5-22e4-401f-a516-a7b1d846ac8f-kube-api-access-g7ftk\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:01:25.777446 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:25.777414    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7235-139910759980608"
Jul 09 23:01:25.777635 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:25.777458    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8a874379403c972a7c2c0ad4aa7b3dfd926362fa0803bfad9acf66a52e61a10"
Jul 09 23:01:25.787476 ip-10-0-143-205 kubenswrapper[2583]: E0709 23:01:25.787449    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7235-139910759980608\" is forbidden: User \"system:node:ip-10-0-143-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-205.ec2.internal' and this object" podUID="297820c5-22e4-401f-a516-a7b1d846ac8f" pod="openshift-ingress/test-curl-7235-139910759980608"
Jul 09 23:01:26.249022 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.248976    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh" podUID="c5eaadfb-79d8-480b-a9cc-a9325134e9b7" containerName="main" containerID="cri-o://d6e299f644d3ca0fa5a62ac6e863edaed76b4443ff65ce7101d3d98485265507" gracePeriod=45
Jul 09 23:01:26.487727 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.487698    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="297820c5-22e4-401f-a516-a7b1d846ac8f" path="/var/lib/kubelet/pods/297820c5-22e4-401f-a516-a7b1d846ac8f/volumes"
Jul 09 23:01:26.502378 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.502301    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:01:26.674050 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.674018    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5b7dd\" (UniqueName: \"kubernetes.io/projected/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-kube-api-access-5b7dd\") pod \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") "
Jul 09 23:01:26.674050 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.674059    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-tmp-dir\") pod \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") "
Jul 09 23:01:26.674356 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.674112    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-tls-certs\") pod \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") "
Jul 09 23:01:26.674356 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.674156    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-home\") pod \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") "
Jul 09 23:01:26.674356 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.674211    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-model-cache\") pod \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") "
Jul 09 23:01:26.674356 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.674286    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-dshm\") pod \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\" (UID: \"c5eaadfb-79d8-480b-a9cc-a9325134e9b7\") "
Jul 09 23:01:26.674581 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.674430    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-home" (OuterVolumeSpecName: "home") pod "c5eaadfb-79d8-480b-a9cc-a9325134e9b7" (UID: "c5eaadfb-79d8-480b-a9cc-a9325134e9b7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:01:26.674581 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.674455    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c5eaadfb-79d8-480b-a9cc-a9325134e9b7" (UID: "c5eaadfb-79d8-480b-a9cc-a9325134e9b7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:01:26.674581 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.674492    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-model-cache" (OuterVolumeSpecName: "model-cache") pod "c5eaadfb-79d8-480b-a9cc-a9325134e9b7" (UID: "c5eaadfb-79d8-480b-a9cc-a9325134e9b7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:01:26.674749 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.674629    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-tmp-dir\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:01:26.674749 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.674648    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-home\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:01:26.674749 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.674660    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-model-cache\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:01:26.676482 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.676453    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c5eaadfb-79d8-480b-a9cc-a9325134e9b7" (UID: "c5eaadfb-79d8-480b-a9cc-a9325134e9b7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 23:01:26.676720 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.676698    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-dshm" (OuterVolumeSpecName: "dshm") pod "c5eaadfb-79d8-480b-a9cc-a9325134e9b7" (UID: "c5eaadfb-79d8-480b-a9cc-a9325134e9b7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 23:01:26.676781 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.676714    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-kube-api-access-5b7dd" (OuterVolumeSpecName: "kube-api-access-5b7dd") pod "c5eaadfb-79d8-480b-a9cc-a9325134e9b7" (UID: "c5eaadfb-79d8-480b-a9cc-a9325134e9b7"). InnerVolumeSpecName "kube-api-access-5b7dd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:01:26.775422 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.775331    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-tls-certs\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:01:26.775422 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.775361    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-dshm\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:01:26.775422 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.775371    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5b7dd\" (UniqueName: \"kubernetes.io/projected/c5eaadfb-79d8-480b-a9cc-a9325134e9b7-kube-api-access-5b7dd\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:01:26.783807 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.783779    2583 generic.go:356] "Generic (PLEG): container finished" podID="c5eaadfb-79d8-480b-a9cc-a9325134e9b7" containerID="d6e299f644d3ca0fa5a62ac6e863edaed76b4443ff65ce7101d3d98485265507" exitCode=0
Jul 09 23:01:26.783968 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.783825    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"
Jul 09 23:01:26.783968 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.783863    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh" event={"ID":"c5eaadfb-79d8-480b-a9cc-a9325134e9b7","Type":"ContainerDied","Data":"d6e299f644d3ca0fa5a62ac6e863edaed76b4443ff65ce7101d3d98485265507"}
Jul 09 23:01:26.783968 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.783910    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh" event={"ID":"c5eaadfb-79d8-480b-a9cc-a9325134e9b7","Type":"ContainerDied","Data":"ad196d5401ba1896ef87c551a155c2915bf151370cc150ad13b61ca9508d12eb"}
Jul 09 23:01:26.783968 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.783930    2583 scope.go:117] "RemoveContainer" containerID="d6e299f644d3ca0fa5a62ac6e863edaed76b4443ff65ce7101d3d98485265507"
Jul 09 23:01:26.793129 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.793084    2583 scope.go:117] "RemoveContainer" containerID="d6e299f644d3ca0fa5a62ac6e863edaed76b4443ff65ce7101d3d98485265507"
Jul 09 23:01:26.793430 ip-10-0-143-205 kubenswrapper[2583]: E0709 23:01:26.793410    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6e299f644d3ca0fa5a62ac6e863edaed76b4443ff65ce7101d3d98485265507\": container with ID starting with d6e299f644d3ca0fa5a62ac6e863edaed76b4443ff65ce7101d3d98485265507 not found: ID does not exist" containerID="d6e299f644d3ca0fa5a62ac6e863edaed76b4443ff65ce7101d3d98485265507"
Jul 09 23:01:26.793506 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.793437    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6e299f644d3ca0fa5a62ac6e863edaed76b4443ff65ce7101d3d98485265507"} err="failed to get container status \"d6e299f644d3ca0fa5a62ac6e863edaed76b4443ff65ce7101d3d98485265507\": rpc error: code = NotFound desc = could not find container \"d6e299f644d3ca0fa5a62ac6e863edaed76b4443ff65ce7101d3d98485265507\": container with ID starting with d6e299f644d3ca0fa5a62ac6e863edaed76b4443ff65ce7101d3d98485265507 not found: ID does not exist"
Jul 09 23:01:26.818221 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.818187    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"]
Jul 09 23:01:26.823877 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:26.823852    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8a6043/rate-test-model-8a6043-kserve-5c6745698c-8pmqh"]
Jul 09 23:01:28.003482 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.003446    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7235-139910759980464"]
Jul 09 23:01:28.003887 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.003762    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="297820c5-22e4-401f-a516-a7b1d846ac8f" containerName="test-curl-7235-139910759980608"
Jul 09 23:01:28.003887 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.003774    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="297820c5-22e4-401f-a516-a7b1d846ac8f" containerName="test-curl-7235-139910759980608"
Jul 09 23:01:28.003887 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.003784    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5eaadfb-79d8-480b-a9cc-a9325134e9b7" containerName="main"
Jul 09 23:01:28.003887 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.003791    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5eaadfb-79d8-480b-a9cc-a9325134e9b7" containerName="main"
Jul 09 23:01:28.003887 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.003857    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5eaadfb-79d8-480b-a9cc-a9325134e9b7" containerName="main"
Jul 09 23:01:28.003887 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.003864    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="297820c5-22e4-401f-a516-a7b1d846ac8f" containerName="test-curl-7235-139910759980608"
Jul 09 23:01:28.008182 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.008161    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7235-139910759980464"
Jul 09 23:01:28.010581 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.010562    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-2sl77\""
Jul 09 23:01:28.014355 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.014332    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7235-139910759980464"]
Jul 09 23:01:28.187749 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.187707    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxzb4\" (UniqueName: \"kubernetes.io/projected/092c4f9f-5fcd-4494-8984-19098ec15040-kube-api-access-xxzb4\") pod \"test-curl-7235-139910759980464\" (UID: \"092c4f9f-5fcd-4494-8984-19098ec15040\") " pod="openshift-ingress/test-curl-7235-139910759980464"
Jul 09 23:01:28.288479 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.288386    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxzb4\" (UniqueName: \"kubernetes.io/projected/092c4f9f-5fcd-4494-8984-19098ec15040-kube-api-access-xxzb4\") pod \"test-curl-7235-139910759980464\" (UID: \"092c4f9f-5fcd-4494-8984-19098ec15040\") " pod="openshift-ingress/test-curl-7235-139910759980464"
Jul 09 23:01:28.296427 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.296391    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxzb4\" (UniqueName: \"kubernetes.io/projected/092c4f9f-5fcd-4494-8984-19098ec15040-kube-api-access-xxzb4\") pod \"test-curl-7235-139910759980464\" (UID: \"092c4f9f-5fcd-4494-8984-19098ec15040\") " pod="openshift-ingress/test-curl-7235-139910759980464"
Jul 09 23:01:28.318820 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.318790    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7235-139910759980464"
Jul 09 23:01:28.456131 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.456083    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7235-139910759980464"]
Jul 09 23:01:28.459159 ip-10-0-143-205 kubenswrapper[2583]: W0709 23:01:28.459132    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod092c4f9f_5fcd_4494_8984_19098ec15040.slice/crio-acc86ee6b54ca9fd3d67eb7bf10fbb6faac7ea9dbf21e0ade18d0b65e135827e WatchSource:0}: Error finding container acc86ee6b54ca9fd3d67eb7bf10fbb6faac7ea9dbf21e0ade18d0b65e135827e: Status 404 returned error can't find the container with id acc86ee6b54ca9fd3d67eb7bf10fbb6faac7ea9dbf21e0ade18d0b65e135827e
Jul 09 23:01:28.486709 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.486680    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5eaadfb-79d8-480b-a9cc-a9325134e9b7" path="/var/lib/kubelet/pods/c5eaadfb-79d8-480b-a9cc-a9325134e9b7/volumes"
Jul 09 23:01:28.801952 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:28.801918    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7235-139910759980464" event={"ID":"092c4f9f-5fcd-4494-8984-19098ec15040","Type":"ContainerStarted","Data":"acc86ee6b54ca9fd3d67eb7bf10fbb6faac7ea9dbf21e0ade18d0b65e135827e"}
Jul 09 23:01:29.809144 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:29.809109    2583 generic.go:356] "Generic (PLEG): container finished" podID="092c4f9f-5fcd-4494-8984-19098ec15040" containerID="25a510ae872037689a2995116762acb0418101749d302041a7c8ee3ba984d330" exitCode=0
Jul 09 23:01:29.809561 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:29.809193    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7235-139910759980464" event={"ID":"092c4f9f-5fcd-4494-8984-19098ec15040","Type":"ContainerDied","Data":"25a510ae872037689a2995116762acb0418101749d302041a7c8ee3ba984d330"}
Jul 09 23:01:30.950781 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:30.950754    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7235-139910759980464"
Jul 09 23:01:30.971054 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:30.971022    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7235-139910759980464_092c4f9f-5fcd-4494-8984-19098ec15040/test-curl-7235-139910759980464/0.log"
Jul 09 23:01:30.995347 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:30.995307    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7235-139910759980464"]
Jul 09 23:01:30.998971 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:30.998943    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7235-139910759980464"]
Jul 09 23:01:31.006909 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.006882    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxzb4\" (UniqueName: \"kubernetes.io/projected/092c4f9f-5fcd-4494-8984-19098ec15040-kube-api-access-xxzb4\") pod \"092c4f9f-5fcd-4494-8984-19098ec15040\" (UID: \"092c4f9f-5fcd-4494-8984-19098ec15040\") "
Jul 09 23:01:31.008932 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.008906    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/092c4f9f-5fcd-4494-8984-19098ec15040-kube-api-access-xxzb4" (OuterVolumeSpecName: "kube-api-access-xxzb4") pod "092c4f9f-5fcd-4494-8984-19098ec15040" (UID: "092c4f9f-5fcd-4494-8984-19098ec15040"). InnerVolumeSpecName "kube-api-access-xxzb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:01:31.108128 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.108009    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxzb4\" (UniqueName: \"kubernetes.io/projected/092c4f9f-5fcd-4494-8984-19098ec15040-kube-api-access-xxzb4\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:01:31.186703 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.186670    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8a6043-clctl"]
Jul 09 23:01:31.187023 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.187008    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092c4f9f-5fcd-4494-8984-19098ec15040" containerName="test-curl-7235-139910759980464"
Jul 09 23:01:31.187068 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.187024    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="092c4f9f-5fcd-4494-8984-19098ec15040" containerName="test-curl-7235-139910759980464"
Jul 09 23:01:31.187115 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.187076    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="092c4f9f-5fcd-4494-8984-19098ec15040" containerName="test-curl-7235-139910759980464"
Jul 09 23:01:31.189950 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.189925    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8a6043-clctl"
Jul 09 23:01:31.191942 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.191918    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fdzhc\""
Jul 09 23:01:31.196547 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.196516    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8a6043-clctl"]
Jul 09 23:01:31.209065 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.209030    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd34d902-79b7-4346-8a76-47ce55f225e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8a6043-clctl\" (UID: \"fd34d902-79b7-4346-8a76-47ce55f225e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8a6043-clctl"
Jul 09 23:01:31.309606 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.309565    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd34d902-79b7-4346-8a76-47ce55f225e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8a6043-clctl\" (UID: \"fd34d902-79b7-4346-8a76-47ce55f225e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8a6043-clctl"
Jul 09 23:01:31.310294 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.310273    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd34d902-79b7-4346-8a76-47ce55f225e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-8a6043-clctl\" (UID: \"fd34d902-79b7-4346-8a76-47ce55f225e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8a6043-clctl"
Jul 09 23:01:31.502024 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.501982    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8a6043-clctl"
Jul 09 23:01:31.641101 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.641062    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8a6043-clctl"]
Jul 09 23:01:31.643152 ip-10-0-143-205 kubenswrapper[2583]: W0709 23:01:31.643119    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd34d902_79b7_4346_8a76_47ce55f225e9.slice/crio-79734ff66e7446bf89057f9af5a7bfa957a30b45c7a208e826e30e9d2d44625b WatchSource:0}: Error finding container 79734ff66e7446bf89057f9af5a7bfa957a30b45c7a208e826e30e9d2d44625b: Status 404 returned error can't find the container with id 79734ff66e7446bf89057f9af5a7bfa957a30b45c7a208e826e30e9d2d44625b
Jul 09 23:01:31.819575 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.819540    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8a6043-clctl" event={"ID":"fd34d902-79b7-4346-8a76-47ce55f225e9","Type":"ContainerStarted","Data":"79734ff66e7446bf89057f9af5a7bfa957a30b45c7a208e826e30e9d2d44625b"}
Jul 09 23:01:31.820788 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.820763    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7235-139910759980464"
Jul 09 23:01:31.820905 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:31.820769    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acc86ee6b54ca9fd3d67eb7bf10fbb6faac7ea9dbf21e0ade18d0b65e135827e"
Jul 09 23:01:31.830459 ip-10-0-143-205 kubenswrapper[2583]: E0709 23:01:31.830431    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7235-139910759980464\" is forbidden: User \"system:node:ip-10-0-143-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-205.ec2.internal' and this object" podUID="092c4f9f-5fcd-4494-8984-19098ec15040" pod="openshift-ingress/test-curl-7235-139910759980464"
Jul 09 23:01:32.486793 ip-10-0-143-205 kubenswrapper[2583]: E0709 23:01:32.486755    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7235-139910759980464\" is forbidden: User \"system:node:ip-10-0-143-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-143-205.ec2.internal' and this object" podUID="092c4f9f-5fcd-4494-8984-19098ec15040" pod="openshift-ingress/test-curl-7235-139910759980464"
Jul 09 23:01:32.488177 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:32.488156    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="092c4f9f-5fcd-4494-8984-19098ec15040" path="/var/lib/kubelet/pods/092c4f9f-5fcd-4494-8984-19098ec15040/volumes"
Jul 09 23:01:32.827881 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:32.827843    2583 generic.go:356] "Generic (PLEG): container finished" podID="fd34d902-79b7-4346-8a76-47ce55f225e9" containerID="e8c48638eccf2132756a424b1344ddf191da48066f1eb4ae43dfb13cec9f700d" exitCode=0
Jul 09 23:01:32.828107 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:32.827945    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8a6043-clctl" event={"ID":"fd34d902-79b7-4346-8a76-47ce55f225e9","Type":"ContainerDied","Data":"e8c48638eccf2132756a424b1344ddf191da48066f1eb4ae43dfb13cec9f700d"}
Jul 09 23:01:33.977377 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:33.977345    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8a6043-clctl"
Jul 09 23:01:34.134246 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:34.134224    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd34d902-79b7-4346-8a76-47ce55f225e9-maas-api-service-ca\") pod \"fd34d902-79b7-4346-8a76-47ce55f225e9\" (UID: \"fd34d902-79b7-4346-8a76-47ce55f225e9\") "
Jul 09 23:01:34.134602 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:34.134580    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd34d902-79b7-4346-8a76-47ce55f225e9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fd34d902-79b7-4346-8a76-47ce55f225e9" (UID: "fd34d902-79b7-4346-8a76-47ce55f225e9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 23:01:34.235539 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:34.235504    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fd34d902-79b7-4346-8a76-47ce55f225e9-maas-api-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:01:34.842153 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:34.842071    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8a6043-clctl"
Jul 09 23:01:34.842299 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:34.842077    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-8a6043-clctl" event={"ID":"fd34d902-79b7-4346-8a76-47ce55f225e9","Type":"ContainerDied","Data":"79734ff66e7446bf89057f9af5a7bfa957a30b45c7a208e826e30e9d2d44625b"}
Jul 09 23:01:34.842299 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:34.842208    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79734ff66e7446bf89057f9af5a7bfa957a30b45c7a208e826e30e9d2d44625b"
Jul 09 23:01:41.629260 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:41.629225    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"]
Jul 09 23:01:41.629765 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:41.629515    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr" podUID="b2e23a3b-66cc-47db-a194-f95b55daedf1" containerName="maas-api" containerID="cri-o://82a7f0b90b9a33175a2ef84ebcab1f6f832f4fe473fcef80891f13fa355be5b1" gracePeriod=30
Jul 09 23:01:42.078162 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.078137    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"
Jul 09 23:01:42.092882 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.092854    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2e23a3b-66cc-47db-a194-f95b55daedf1-maas-api-tls\") pod \"b2e23a3b-66cc-47db-a194-f95b55daedf1\" (UID: \"b2e23a3b-66cc-47db-a194-f95b55daedf1\") "
Jul 09 23:01:42.095741 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.095690    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2e23a3b-66cc-47db-a194-f95b55daedf1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b2e23a3b-66cc-47db-a194-f95b55daedf1" (UID: "b2e23a3b-66cc-47db-a194-f95b55daedf1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 23:01:42.193408 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.193293    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2e23a3b-66cc-47db-a194-f95b55daedf1-openshift-service-ca\") pod \"b2e23a3b-66cc-47db-a194-f95b55daedf1\" (UID: \"b2e23a3b-66cc-47db-a194-f95b55daedf1\") "
Jul 09 23:01:42.193408 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.193348    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86xvl\" (UniqueName: \"kubernetes.io/projected/b2e23a3b-66cc-47db-a194-f95b55daedf1-kube-api-access-86xvl\") pod \"b2e23a3b-66cc-47db-a194-f95b55daedf1\" (UID: \"b2e23a3b-66cc-47db-a194-f95b55daedf1\") "
Jul 09 23:01:42.193662 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.193543    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2e23a3b-66cc-47db-a194-f95b55daedf1-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:01:42.193753 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.193725    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2e23a3b-66cc-47db-a194-f95b55daedf1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b2e23a3b-66cc-47db-a194-f95b55daedf1" (UID: "b2e23a3b-66cc-47db-a194-f95b55daedf1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 23:01:42.195466 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.195442    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2e23a3b-66cc-47db-a194-f95b55daedf1-kube-api-access-86xvl" (OuterVolumeSpecName: "kube-api-access-86xvl") pod "b2e23a3b-66cc-47db-a194-f95b55daedf1" (UID: "b2e23a3b-66cc-47db-a194-f95b55daedf1"). InnerVolumeSpecName "kube-api-access-86xvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:01:42.293984 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.293950    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2e23a3b-66cc-47db-a194-f95b55daedf1-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:01:42.293984 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.293978    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86xvl\" (UniqueName: \"kubernetes.io/projected/b2e23a3b-66cc-47db-a194-f95b55daedf1-kube-api-access-86xvl\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:01:42.893211 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.893171    2583 generic.go:356] "Generic (PLEG): container finished" podID="b2e23a3b-66cc-47db-a194-f95b55daedf1" containerID="82a7f0b90b9a33175a2ef84ebcab1f6f832f4fe473fcef80891f13fa355be5b1" exitCode=0
Jul 09 23:01:42.893692 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.893218    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"
Jul 09 23:01:42.893692 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.893212    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr" event={"ID":"b2e23a3b-66cc-47db-a194-f95b55daedf1","Type":"ContainerDied","Data":"82a7f0b90b9a33175a2ef84ebcab1f6f832f4fe473fcef80891f13fa355be5b1"}
Jul 09 23:01:42.893692 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.893283    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr" event={"ID":"b2e23a3b-66cc-47db-a194-f95b55daedf1","Type":"ContainerDied","Data":"d666a2be5df22907ce749420c750da36cb9537db7e028e8dda1587b7fe2c327e"}
Jul 09 23:01:42.893692 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.893317    2583 scope.go:117] "RemoveContainer" containerID="82a7f0b90b9a33175a2ef84ebcab1f6f832f4fe473fcef80891f13fa355be5b1"
Jul 09 23:01:42.902374 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.902354    2583 scope.go:117] "RemoveContainer" containerID="82a7f0b90b9a33175a2ef84ebcab1f6f832f4fe473fcef80891f13fa355be5b1"
Jul 09 23:01:42.902650 ip-10-0-143-205 kubenswrapper[2583]: E0709 23:01:42.902628    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82a7f0b90b9a33175a2ef84ebcab1f6f832f4fe473fcef80891f13fa355be5b1\": container with ID starting with 82a7f0b90b9a33175a2ef84ebcab1f6f832f4fe473fcef80891f13fa355be5b1 not found: ID does not exist" containerID="82a7f0b90b9a33175a2ef84ebcab1f6f832f4fe473fcef80891f13fa355be5b1"
Jul 09 23:01:42.902733 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.902658    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82a7f0b90b9a33175a2ef84ebcab1f6f832f4fe473fcef80891f13fa355be5b1"} err="failed to get container status \"82a7f0b90b9a33175a2ef84ebcab1f6f832f4fe473fcef80891f13fa355be5b1\": rpc error: code = NotFound desc = could not find container \"82a7f0b90b9a33175a2ef84ebcab1f6f832f4fe473fcef80891f13fa355be5b1\": container with ID starting with 82a7f0b90b9a33175a2ef84ebcab1f6f832f4fe473fcef80891f13fa355be5b1 not found: ID does not exist"
Jul 09 23:01:42.908763 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.908734    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"]
Jul 09 23:01:42.913964 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:42.913935    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-8a6043-5df6c57556-gt7cr"]
Jul 09 23:01:44.487229 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:44.487197    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2e23a3b-66cc-47db-a194-f95b55daedf1" path="/var/lib/kubelet/pods/b2e23a3b-66cc-47db-a194-f95b55daedf1/volumes"
Jul 09 23:01:57.397587 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:57.397542    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb"]
Jul 09 23:01:57.398204 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:57.398038    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e23a3b-66cc-47db-a194-f95b55daedf1" containerName="maas-api"
Jul 09 23:01:57.398204 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:57.398058    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e23a3b-66cc-47db-a194-f95b55daedf1" containerName="maas-api"
Jul 09 23:01:57.398204 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:57.398072    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd34d902-79b7-4346-8a76-47ce55f225e9" containerName="revoke-keys"
Jul 09 23:01:57.398204 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:57.398080    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd34d902-79b7-4346-8a76-47ce55f225e9" containerName="revoke-keys"
Jul 09 23:01:57.398440 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:57.398225    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2e23a3b-66cc-47db-a194-f95b55daedf1" containerName="maas-api"
Jul 09 23:01:57.398440 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:57.398237    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd34d902-79b7-4346-8a76-47ce55f225e9" containerName="revoke-keys"
Jul 09 23:01:57.403699 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:57.403669    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb"
Jul 09 23:01:57.406170 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:57.406074    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fdzhc\""
Jul 09 23:01:57.407538 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:57.407509    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb"]
Jul 09 23:01:57.502783 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:57.502729    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79057750-91fc-4b8e-8d7d-875c39e0778e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb\" (UID: \"79057750-91fc-4b8e-8d7d-875c39e0778e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb"
Jul 09 23:01:57.604142 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:57.604068    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79057750-91fc-4b8e-8d7d-875c39e0778e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb\" (UID: \"79057750-91fc-4b8e-8d7d-875c39e0778e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb"
Jul 09 23:01:57.604703 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:57.604681    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79057750-91fc-4b8e-8d7d-875c39e0778e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb\" (UID: \"79057750-91fc-4b8e-8d7d-875c39e0778e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb"
Jul 09 23:01:57.716353 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:57.716244    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb"
Jul 09 23:01:57.858379 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:57.858354    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb"]
Jul 09 23:01:57.860275 ip-10-0-143-205 kubenswrapper[2583]: W0709 23:01:57.860243    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79057750_91fc_4b8e_8d7d_875c39e0778e.slice/crio-1393c3c8f6edb08df5231c54f5af5484c4b038b494e33c5cda57d8dfc0edc9dc WatchSource:0}: Error finding container 1393c3c8f6edb08df5231c54f5af5484c4b038b494e33c5cda57d8dfc0edc9dc: Status 404 returned error can't find the container with id 1393c3c8f6edb08df5231c54f5af5484c4b038b494e33c5cda57d8dfc0edc9dc
Jul 09 23:01:57.972030 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:57.971940    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb" event={"ID":"79057750-91fc-4b8e-8d7d-875c39e0778e","Type":"ContainerStarted","Data":"1393c3c8f6edb08df5231c54f5af5484c4b038b494e33c5cda57d8dfc0edc9dc"}
Jul 09 23:01:58.979227 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:58.979192    2583 generic.go:356] "Generic (PLEG): container finished" podID="79057750-91fc-4b8e-8d7d-875c39e0778e" containerID="e8222a60b269341266c475e197adc4f9f3ed8aa130bc82c734f6ac6ddf5989a2" exitCode=0
Jul 09 23:01:58.979674 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:01:58.979277    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb" event={"ID":"79057750-91fc-4b8e-8d7d-875c39e0778e","Type":"ContainerDied","Data":"e8222a60b269341266c475e197adc4f9f3ed8aa130bc82c734f6ac6ddf5989a2"}
Jul 09 23:02:00.116246 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:00.116216    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb"
Jul 09 23:02:00.124609 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:00.124581    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79057750-91fc-4b8e-8d7d-875c39e0778e-maas-api-service-ca\") pod \"79057750-91fc-4b8e-8d7d-875c39e0778e\" (UID: \"79057750-91fc-4b8e-8d7d-875c39e0778e\") "
Jul 09 23:02:00.124934 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:00.124911    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79057750-91fc-4b8e-8d7d-875c39e0778e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "79057750-91fc-4b8e-8d7d-875c39e0778e" (UID: "79057750-91fc-4b8e-8d7d-875c39e0778e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 23:02:00.225187 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:00.225150    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79057750-91fc-4b8e-8d7d-875c39e0778e-maas-api-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:02:00.990445 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:00.990413    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb" event={"ID":"79057750-91fc-4b8e-8d7d-875c39e0778e","Type":"ContainerDied","Data":"1393c3c8f6edb08df5231c54f5af5484c4b038b494e33c5cda57d8dfc0edc9dc"}
Jul 09 23:02:00.990445 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:00.990431    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb"
Jul 09 23:02:00.990445 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:00.990462    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1393c3c8f6edb08df5231c54f5af5484c4b038b494e33c5cda57d8dfc0edc9dc"
Jul 09 23:02:07.845072 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:07.845040    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"]
Jul 09 23:02:07.845543 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:07.845273    2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2" podUID="d2ae98e8-0d6c-4de8-9674-47bec791879d" containerName="maas-api" containerID="cri-o://c8c9d71fc24804056e5eae21329ae9e2e46756918ab6126b7879804fb811e2f2" gracePeriod=30
Jul 09 23:02:08.029220 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:08.029188    2583 generic.go:356] "Generic (PLEG): container finished" podID="d2ae98e8-0d6c-4de8-9674-47bec791879d" containerID="c8c9d71fc24804056e5eae21329ae9e2e46756918ab6126b7879804fb811e2f2" exitCode=0
Jul 09 23:02:08.029389 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:08.029264    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2" event={"ID":"d2ae98e8-0d6c-4de8-9674-47bec791879d","Type":"ContainerDied","Data":"c8c9d71fc24804056e5eae21329ae9e2e46756918ab6126b7879804fb811e2f2"}
Jul 09 23:02:08.091648 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:08.091621    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"
Jul 09 23:02:08.191708 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:08.191672    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2ae98e8-0d6c-4de8-9674-47bec791879d-openshift-service-ca\") pod \"d2ae98e8-0d6c-4de8-9674-47bec791879d\" (UID: \"d2ae98e8-0d6c-4de8-9674-47bec791879d\") "
Jul 09 23:02:08.191708 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:08.191714    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl58b\" (UniqueName: \"kubernetes.io/projected/d2ae98e8-0d6c-4de8-9674-47bec791879d-kube-api-access-dl58b\") pod \"d2ae98e8-0d6c-4de8-9674-47bec791879d\" (UID: \"d2ae98e8-0d6c-4de8-9674-47bec791879d\") "
Jul 09 23:02:08.191981 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:08.191765    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2ae98e8-0d6c-4de8-9674-47bec791879d-maas-api-tls\") pod \"d2ae98e8-0d6c-4de8-9674-47bec791879d\" (UID: \"d2ae98e8-0d6c-4de8-9674-47bec791879d\") "
Jul 09 23:02:08.192170 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:08.192146    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2ae98e8-0d6c-4de8-9674-47bec791879d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d2ae98e8-0d6c-4de8-9674-47bec791879d" (UID: "d2ae98e8-0d6c-4de8-9674-47bec791879d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 23:02:08.193890 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:08.193862    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2ae98e8-0d6c-4de8-9674-47bec791879d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d2ae98e8-0d6c-4de8-9674-47bec791879d" (UID: "d2ae98e8-0d6c-4de8-9674-47bec791879d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 23:02:08.193990 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:08.193946    2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2ae98e8-0d6c-4de8-9674-47bec791879d-kube-api-access-dl58b" (OuterVolumeSpecName: "kube-api-access-dl58b") pod "d2ae98e8-0d6c-4de8-9674-47bec791879d" (UID: "d2ae98e8-0d6c-4de8-9674-47bec791879d"). InnerVolumeSpecName "kube-api-access-dl58b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 23:02:08.293425 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:08.293371    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2ae98e8-0d6c-4de8-9674-47bec791879d-openshift-service-ca\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:02:08.293425 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:08.293414    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl58b\" (UniqueName: \"kubernetes.io/projected/d2ae98e8-0d6c-4de8-9674-47bec791879d-kube-api-access-dl58b\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:02:08.293425 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:08.293426    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2ae98e8-0d6c-4de8-9674-47bec791879d-maas-api-tls\") on node \"ip-10-0-143-205.ec2.internal\" DevicePath \"\""
Jul 09 23:02:09.035141 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:09.035077    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2" event={"ID":"d2ae98e8-0d6c-4de8-9674-47bec791879d","Type":"ContainerDied","Data":"74fa9dd97149fdb2e4d2e4af92baa5492b7ec3ee83c51734ce81c75a7e502318"}
Jul 09 23:02:09.035141 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:09.035128    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"
Jul 09 23:02:09.035640 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:09.035175    2583 scope.go:117] "RemoveContainer" containerID="c8c9d71fc24804056e5eae21329ae9e2e46756918ab6126b7879804fb811e2f2"
Jul 09 23:02:09.051478 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:09.051449    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"]
Jul 09 23:02:09.057494 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:09.057469    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-862c5d-6499cc79f7-99cc2"]
Jul 09 23:02:10.485935 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:10.485896    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2ae98e8-0d6c-4de8-9674-47bec791879d" path="/var/lib/kubelet/pods/d2ae98e8-0d6c-4de8-9674-47bec791879d/volumes"
Jul 09 23:02:23.913983 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:23.913942    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54c4b46f95-24mqz_786d7b05-17f0-4395-86e1-26d4b92a5b9c/authorino/0.log"
Jul 09 23:02:29.409342 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:29.409315    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7k526_82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6/server/0.log"
Jul 09 23:02:29.553028 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:29.552996    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gsfpc_6f1bd6d4-f016-4246-bfec-dd952d8b60f4/manager/0.log"
Jul 09 23:02:29.689883 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:29.689801    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf875db85-5sp7j_3ae0e10f-33e2-44d8-b3b5-a58d2a635e49/copy-manifests/0.log"
Jul 09 23:02:29.696867 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:29.696841    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf875db85-5sp7j_3ae0e10f-33e2-44d8-b3b5-a58d2a635e49/manager/0.log"
Jul 09 23:02:31.044659 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:31.044630    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-e98c97-5gzgv_10666c7f-b035-442c-9b8c-b6776cbaa96d/revoke-keys/0.log"
Jul 09 23:02:31.174617 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:31.174593    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-6ddc6a-5vljd_872ed038-e9f2-4c28-b097-fa86d7ce01e5/revoke-keys/0.log"
Jul 09 23:02:31.542341 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:31.542302    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-d2543e-zq4q6_530b6b38-4ede-4c3e-9e5f-7757d96f0731/revoke-keys/0.log"
Jul 09 23:02:31.910304 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:31.910270    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-8a6043-clctl_fd34d902-79b7-4346-8a76-47ce55f225e9/revoke-keys/0.log"
Jul 09 23:02:32.022375 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:32.022342    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-862c5d-gqbxb_79057750-91fc-4b8e-8d7d-875c39e0778e/revoke-keys/0.log"
Jul 09 23:02:32.964168 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:32.964128    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7_0e08fa27-c33d-49bc-8993-d80a398c3776/pull/0.log"
Jul 09 23:02:32.969979 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:32.969909    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7_0e08fa27-c33d-49bc-8993-d80a398c3776/extract/0.log"
Jul 09 23:02:32.975184 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:32.975159    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7_0e08fa27-c33d-49bc-8993-d80a398c3776/util/0.log"
Jul 09 23:02:33.101132 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:33.101105    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c_5452aadf-5325-4e2e-922e-084ae83a7354/util/0.log"
Jul 09 23:02:33.107470 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:33.107442    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c_5452aadf-5325-4e2e-922e-084ae83a7354/pull/0.log"
Jul 09 23:02:33.113819 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:33.113797    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c_5452aadf-5325-4e2e-922e-084ae83a7354/extract/0.log"
Jul 09 23:02:33.241575 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:33.241475    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv_a822043d-5651-4b43-b1a9-2c25312b98f6/util/0.log"
Jul 09 23:02:33.248374 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:33.248345    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv_a822043d-5651-4b43-b1a9-2c25312b98f6/pull/0.log"
Jul 09 23:02:33.255029 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:33.255002    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv_a822043d-5651-4b43-b1a9-2c25312b98f6/extract/0.log"
Jul 09 23:02:33.375520 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:33.375490    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq_eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5/util/0.log"
Jul 09 23:02:33.382139 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:33.382081    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq_eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5/pull/0.log"
Jul 09 23:02:33.388196 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:33.388165    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq_eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5/extract/0.log"
Jul 09 23:02:33.527296 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:33.527207    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54c4b46f95-24mqz_786d7b05-17f0-4395-86e1-26d4b92a5b9c/authorino/0.log"
Jul 09 23:02:33.904632 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:33.904609    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-lnkr5_42eab3e4-e848-4085-a974-a91e444330da/kuadrant-console-plugin/0.log"
Jul 09 23:02:35.187009 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:35.186979    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5ff74c44b9-q29kn_b38e85be-fe05-4037-aa18-446349d115dd/kube-auth-proxy/0.log"
Jul 09 23:02:35.605062 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:35.604981    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zf9j9_0245a63a-3c62-4d8e-ba25-c5bbe80c16d3/payload-processing/0.log"
Jul 09 23:02:36.247754 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:36.247724    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-x49fx_ab460e94-214e-427e-b205-29cdef2602e9/main/0.log"
Jul 09 23:02:36.741779 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:36.741742    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-7pgjm_21862395-6d5b-4981-bd4b-4a60712414a1/main/0.log"
Jul 09 23:02:40.608917 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.608879    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5rfjs/must-gather-4lwcm"]
Jul 09 23:02:40.609369 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.609213    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79057750-91fc-4b8e-8d7d-875c39e0778e" containerName="revoke-keys"
Jul 09 23:02:40.609369 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.609224    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="79057750-91fc-4b8e-8d7d-875c39e0778e" containerName="revoke-keys"
Jul 09 23:02:40.609369 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.609241    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2ae98e8-0d6c-4de8-9674-47bec791879d" containerName="maas-api"
Jul 09 23:02:40.609369 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.609247    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2ae98e8-0d6c-4de8-9674-47bec791879d" containerName="maas-api"
Jul 09 23:02:40.609369 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.609296    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2ae98e8-0d6c-4de8-9674-47bec791879d" containerName="maas-api"
Jul 09 23:02:40.609369 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.609305    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="79057750-91fc-4b8e-8d7d-875c39e0778e" containerName="revoke-keys"
Jul 09 23:02:40.613696 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.613664    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5rfjs/must-gather-4lwcm"
Jul 09 23:02:40.616137 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.616108    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5rfjs\"/\"openshift-service-ca.crt\""
Jul 09 23:02:40.616274 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.616160    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5rfjs\"/\"kube-root-ca.crt\""
Jul 09 23:02:40.616624 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.616606    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5rfjs\"/\"default-dockercfg-dbb7w\""
Jul 09 23:02:40.623636 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.623611    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5rfjs/must-gather-4lwcm"]
Jul 09 23:02:40.773722 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.773671    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/daaf6ec4-e01b-4775-a9ca-c2baa0f8a93a-must-gather-output\") pod \"must-gather-4lwcm\" (UID: \"daaf6ec4-e01b-4775-a9ca-c2baa0f8a93a\") " pod="openshift-must-gather-5rfjs/must-gather-4lwcm"
Jul 09 23:02:40.773915 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.773809    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct6bh\" (UniqueName: \"kubernetes.io/projected/daaf6ec4-e01b-4775-a9ca-c2baa0f8a93a-kube-api-access-ct6bh\") pod \"must-gather-4lwcm\" (UID: \"daaf6ec4-e01b-4775-a9ca-c2baa0f8a93a\") " pod="openshift-must-gather-5rfjs/must-gather-4lwcm"
Jul 09 23:02:40.874650 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.874625    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct6bh\" (UniqueName: \"kubernetes.io/projected/daaf6ec4-e01b-4775-a9ca-c2baa0f8a93a-kube-api-access-ct6bh\") pod \"must-gather-4lwcm\" (UID: \"daaf6ec4-e01b-4775-a9ca-c2baa0f8a93a\") " pod="openshift-must-gather-5rfjs/must-gather-4lwcm"
Jul 09 23:02:40.874822 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.874679    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/daaf6ec4-e01b-4775-a9ca-c2baa0f8a93a-must-gather-output\") pod \"must-gather-4lwcm\" (UID: \"daaf6ec4-e01b-4775-a9ca-c2baa0f8a93a\") " pod="openshift-must-gather-5rfjs/must-gather-4lwcm"
Jul 09 23:02:40.875005 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.874988    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/daaf6ec4-e01b-4775-a9ca-c2baa0f8a93a-must-gather-output\") pod \"must-gather-4lwcm\" (UID: \"daaf6ec4-e01b-4775-a9ca-c2baa0f8a93a\") " pod="openshift-must-gather-5rfjs/must-gather-4lwcm"
Jul 09 23:02:40.883710 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.883673    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct6bh\" (UniqueName: \"kubernetes.io/projected/daaf6ec4-e01b-4775-a9ca-c2baa0f8a93a-kube-api-access-ct6bh\") pod \"must-gather-4lwcm\" (UID: \"daaf6ec4-e01b-4775-a9ca-c2baa0f8a93a\") " pod="openshift-must-gather-5rfjs/must-gather-4lwcm"
Jul 09 23:02:40.924811 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:40.924773    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5rfjs/must-gather-4lwcm"
Jul 09 23:02:41.058467 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:41.058440    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5rfjs/must-gather-4lwcm"]
Jul 09 23:02:41.060660 ip-10-0-143-205 kubenswrapper[2583]: W0709 23:02:41.060619    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddaaf6ec4_e01b_4775_a9ca_c2baa0f8a93a.slice/crio-a3579e11c3fb7880a556684727ce5e8968e6d77848c3ceb74d069f705be394a1 WatchSource:0}: Error finding container a3579e11c3fb7880a556684727ce5e8968e6d77848c3ceb74d069f705be394a1: Status 404 returned error can't find the container with id a3579e11c3fb7880a556684727ce5e8968e6d77848c3ceb74d069f705be394a1
Jul 09 23:02:41.207337 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:41.207249    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5rfjs/must-gather-4lwcm" event={"ID":"daaf6ec4-e01b-4775-a9ca-c2baa0f8a93a","Type":"ContainerStarted","Data":"a3579e11c3fb7880a556684727ce5e8968e6d77848c3ceb74d069f705be394a1"}
Jul 09 23:02:42.217040 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:42.216999    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5rfjs/must-gather-4lwcm" event={"ID":"daaf6ec4-e01b-4775-a9ca-c2baa0f8a93a","Type":"ContainerStarted","Data":"7806926e0ad12e633092edc873edda8d663c63014ae1ea885f7a86bbf9fbb1a0"}
Jul 09 23:02:42.217493 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:42.217055    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5rfjs/must-gather-4lwcm" event={"ID":"daaf6ec4-e01b-4775-a9ca-c2baa0f8a93a","Type":"ContainerStarted","Data":"bfb8c3dee08dddef47c107991aedc969855a79d2bf0fd0311a6bad9dd8f7431d"}
Jul 09 23:02:42.233161 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:42.233076    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5rfjs/must-gather-4lwcm" podStartSLOduration=1.476784536 podStartE2EDuration="2.233053483s" totalImagesPullingTime="756.268947ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 23:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:02:42.231293995 +0000 UTC m=+3130.310063689" watchObservedRunningTime="2026-07-09 23:02:42.233053483 +0000 UTC m=+3130.311823162"
Jul 09 23:02:43.556420 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:43.556379    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p6khq_db27c8e0-acdb-47a0-b8fd-e66cd8a08ae1/global-pull-secret-syncer/0.log"
Jul 09 23:02:43.691878 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:43.691845    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-szwg5_dcf1ce0b-19bb-4020-848a-9fc663ce7136/konnectivity-agent/0.log"
Jul 09 23:02:43.756472 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:43.756441    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-205.ec2.internal_443b95f9a11c785c66a6608d9d6fba98/haproxy/0.log"
Jul 09 23:02:48.821484 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:48.821446    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7_0e08fa27-c33d-49bc-8993-d80a398c3776/extract/0.log"
Jul 09 23:02:48.851694 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:48.851661    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7_0e08fa27-c33d-49bc-8993-d80a398c3776/util/0.log"
Jul 09 23:02:48.884987 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:48.884951    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cjmh7_0e08fa27-c33d-49bc-8993-d80a398c3776/pull/0.log"
Jul 09 23:02:48.930196 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:48.930161    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c_5452aadf-5325-4e2e-922e-084ae83a7354/extract/0.log"
Jul 09 23:02:48.956767 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:48.956742    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c_5452aadf-5325-4e2e-922e-084ae83a7354/util/0.log"
Jul 09 23:02:48.984076 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:48.984050    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0thz6c_5452aadf-5325-4e2e-922e-084ae83a7354/pull/0.log"
Jul 09 23:02:49.020040 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:49.020004    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv_a822043d-5651-4b43-b1a9-2c25312b98f6/extract/0.log"
Jul 09 23:02:49.050165 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:49.050134    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv_a822043d-5651-4b43-b1a9-2c25312b98f6/util/0.log"
Jul 09 23:02:49.082127 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:49.082015    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7362jwv_a822043d-5651-4b43-b1a9-2c25312b98f6/pull/0.log"
Jul 09 23:02:49.121255 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:49.121218    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq_eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5/extract/0.log"
Jul 09 23:02:49.154879 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:49.154847    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq_eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5/util/0.log"
Jul 09 23:02:49.181765 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:49.181730    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1md7jq_eea68cd1-ed8c-40ec-ac0c-a991bb9f3fa5/pull/0.log"
Jul 09 23:02:49.695111 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:49.694986    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54c4b46f95-24mqz_786d7b05-17f0-4395-86e1-26d4b92a5b9c/authorino/0.log"
Jul 09 23:02:49.794034 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:49.793998    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-lnkr5_42eab3e4-e848-4085-a974-a91e444330da/kuadrant-console-plugin/0.log"
Jul 09 23:02:52.544122 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:52.544015    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w7gts_ab862021-3ae4-47ba-b3ac-418dbb820e15/node-exporter/0.log"
Jul 09 23:02:52.572706 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:52.572676    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w7gts_ab862021-3ae4-47ba-b3ac-418dbb820e15/kube-rbac-proxy/0.log"
Jul 09 23:02:52.599396 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:52.599369    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w7gts_ab862021-3ae4-47ba-b3ac-418dbb820e15/init-textfile/0.log"
Jul 09 23:02:53.030629 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.030588    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-tnhsz_25d2ce90-d384-45ea-8900-d05e38364143/prometheus-operator-admission-webhook/0.log"
Jul 09 23:02:53.064392 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.064362    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d7bccdb7c-5x66w_19347203-7153-4167-9b2c-f9e4cdea7ee1/telemeter-client/0.log"
Jul 09 23:02:53.093318 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.093287    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d7bccdb7c-5x66w_19347203-7153-4167-9b2c-f9e4cdea7ee1/reload/0.log"
Jul 09 23:02:53.118120 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.118078    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6d7bccdb7c-5x66w_19347203-7153-4167-9b2c-f9e4cdea7ee1/kube-rbac-proxy/0.log"
Jul 09 23:02:53.527141 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.527039    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"]
Jul 09 23:02:53.532994 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.532960    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:53.542181 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.542152    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"]
Jul 09 23:02:53.701098 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.701045    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c140e92b-10ea-45a3-9ed5-7c8e2154df72-sys\") pod \"perf-node-gather-daemonset-g86zk\" (UID: \"c140e92b-10ea-45a3-9ed5-7c8e2154df72\") " pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:53.701634 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.701112    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c140e92b-10ea-45a3-9ed5-7c8e2154df72-proc\") pod \"perf-node-gather-daemonset-g86zk\" (UID: \"c140e92b-10ea-45a3-9ed5-7c8e2154df72\") " pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:53.701634 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.701141    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c140e92b-10ea-45a3-9ed5-7c8e2154df72-podres\") pod \"perf-node-gather-daemonset-g86zk\" (UID: \"c140e92b-10ea-45a3-9ed5-7c8e2154df72\") " pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:53.701634 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.701164    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdnsk\" (UniqueName: \"kubernetes.io/projected/c140e92b-10ea-45a3-9ed5-7c8e2154df72-kube-api-access-hdnsk\") pod \"perf-node-gather-daemonset-g86zk\" (UID: \"c140e92b-10ea-45a3-9ed5-7c8e2154df72\") " pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:53.701634 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.701186    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c140e92b-10ea-45a3-9ed5-7c8e2154df72-lib-modules\") pod \"perf-node-gather-daemonset-g86zk\" (UID: \"c140e92b-10ea-45a3-9ed5-7c8e2154df72\") " pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:53.801873 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.801790    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c140e92b-10ea-45a3-9ed5-7c8e2154df72-sys\") pod \"perf-node-gather-daemonset-g86zk\" (UID: \"c140e92b-10ea-45a3-9ed5-7c8e2154df72\") " pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:53.801873 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.801839    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c140e92b-10ea-45a3-9ed5-7c8e2154df72-proc\") pod \"perf-node-gather-daemonset-g86zk\" (UID: \"c140e92b-10ea-45a3-9ed5-7c8e2154df72\") " pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:53.801873 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.801859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c140e92b-10ea-45a3-9ed5-7c8e2154df72-podres\") pod \"perf-node-gather-daemonset-g86zk\" (UID: \"c140e92b-10ea-45a3-9ed5-7c8e2154df72\") " pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:53.802181 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.801925    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdnsk\" (UniqueName: \"kubernetes.io/projected/c140e92b-10ea-45a3-9ed5-7c8e2154df72-kube-api-access-hdnsk\") pod \"perf-node-gather-daemonset-g86zk\" (UID: \"c140e92b-10ea-45a3-9ed5-7c8e2154df72\") " pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:53.802181 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.801950    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c140e92b-10ea-45a3-9ed5-7c8e2154df72-proc\") pod \"perf-node-gather-daemonset-g86zk\" (UID: \"c140e92b-10ea-45a3-9ed5-7c8e2154df72\") " pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:53.802181 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.801960    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c140e92b-10ea-45a3-9ed5-7c8e2154df72-lib-modules\") pod \"perf-node-gather-daemonset-g86zk\" (UID: \"c140e92b-10ea-45a3-9ed5-7c8e2154df72\") " pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:53.802181 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.801950    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c140e92b-10ea-45a3-9ed5-7c8e2154df72-sys\") pod \"perf-node-gather-daemonset-g86zk\" (UID: \"c140e92b-10ea-45a3-9ed5-7c8e2154df72\") " pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:53.802181 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.802005    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c140e92b-10ea-45a3-9ed5-7c8e2154df72-podres\") pod \"perf-node-gather-daemonset-g86zk\" (UID: \"c140e92b-10ea-45a3-9ed5-7c8e2154df72\") " pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:53.802181 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.802078    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c140e92b-10ea-45a3-9ed5-7c8e2154df72-lib-modules\") pod \"perf-node-gather-daemonset-g86zk\" (UID: \"c140e92b-10ea-45a3-9ed5-7c8e2154df72\") " pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:53.810981 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.810937    2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdnsk\" (UniqueName: \"kubernetes.io/projected/c140e92b-10ea-45a3-9ed5-7c8e2154df72-kube-api-access-hdnsk\") pod \"perf-node-gather-daemonset-g86zk\" (UID: \"c140e92b-10ea-45a3-9ed5-7c8e2154df72\") " pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:53.850343 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:53.850307    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:54.030973 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:54.030936    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"]
Jul 09 23:02:54.306503 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:54.306462    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk" event={"ID":"c140e92b-10ea-45a3-9ed5-7c8e2154df72","Type":"ContainerStarted","Data":"83ba801dd99e19a5d7beec38a6faddbb5b8c4218ef5435e6918b7ad71216a5c6"}
Jul 09 23:02:54.306692 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:54.306530    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk" event={"ID":"c140e92b-10ea-45a3-9ed5-7c8e2154df72","Type":"ContainerStarted","Data":"e1e5a49dd387364e974942226dd6160ab337f91d0eda1b34d36fab4974b5883a"}
Jul 09 23:02:54.307017 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:54.306991    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:02:54.324936 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:54.324827    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk" podStartSLOduration=1.324804661 podStartE2EDuration="1.324804661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 23:02:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 23:02:54.323955103 +0000 UTC m=+3142.402724796" watchObservedRunningTime="2026-07-09 23:02:54.324804661 +0000 UTC m=+3142.403574345"
Jul 09 23:02:57.209664 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:57.209627    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-754cv_024d8436-668e-491e-9002-8ec850963901/dns/0.log"
Jul 09 23:02:57.232533 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:57.232495    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-754cv_024d8436-668e-491e-9002-8ec850963901/kube-rbac-proxy/0.log"
Jul 09 23:02:57.396620 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:57.396591    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-psgll_02fa67f4-019f-47f2-b81c-6a5d1f456664/dns-node-resolver/0.log"
Jul 09 23:02:57.969939 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:57.969906    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cfzct_1f1cf532-03a5-4ce5-b9ae-e71789ef7111/node-ca/0.log"
Jul 09 23:02:59.255931 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:59.255902    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5ff74c44b9-q29kn_b38e85be-fe05-4037-aa18-446349d115dd/kube-auth-proxy/0.log"
Jul 09 23:02:59.394463 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:02:59.394413    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zf9j9_0245a63a-3c62-4d8e-ba25-c5bbe80c16d3/payload-processing/0.log"
Jul 09 23:03:00.230701 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:03:00.230648    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vlfpb_21cf5cf6-2e43-4bcb-a03f-de65bbd6929a/serve-healthcheck-canary/0.log"
Jul 09 23:03:00.332350 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:03:00.332319    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5rfjs/perf-node-gather-daemonset-g86zk"
Jul 09 23:03:00.914993 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:03:00.914900    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8tg9t_637326be-847b-434f-9147-5b7aa3f5f98b/kube-rbac-proxy/0.log"
Jul 09 23:03:00.945462 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:03:00.945432    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8tg9t_637326be-847b-434f-9147-5b7aa3f5f98b/exporter/0.log"
Jul 09 23:03:00.973344 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:03:00.973311    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8tg9t_637326be-847b-434f-9147-5b7aa3f5f98b/extractor/0.log"
Jul 09 23:03:03.882072 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:03:03.881976    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7k526_82fbd4d9-5bf1-4d10-90d8-1e9b764c89b6/server/0.log"
Jul 09 23:03:03.995621 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:03:03.995587    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gsfpc_6f1bd6d4-f016-4246-bfec-dd952d8b60f4/manager/0.log"
Jul 09 23:03:04.021360 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:03:04.021333    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf875db85-5sp7j_3ae0e10f-33e2-44d8-b3b5-a58d2a635e49/manager/0.log"
Jul 09 23:03:04.043955 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:03:04.043912    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cf875db85-5sp7j_3ae0e10f-33e2-44d8-b3b5-a58d2a635e49/copy-manifests/0.log"
Jul 09 23:03:04.693899 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:03:04.693815    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5ff74c44b9-q29kn_b38e85be-fe05-4037-aa18-446349d115dd/kube-auth-proxy/0.log"
Jul 09 23:03:04.805753 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:03:04.805718    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zf9j9_0245a63a-3c62-4d8e-ba25-c5bbe80c16d3/payload-processing/0.log"
Jul 09 23:03:05.458884 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:03:05.458851    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76dfc7bb46-vv9db_9d1566bb-aee2-4bc5-b433-2d43df002852/manager/0.log"
Jul 09 23:03:06.393264 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:03:06.393231    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5ff74c44b9-q29kn_b38e85be-fe05-4037-aa18-446349d115dd/kube-auth-proxy/0.log"
Jul 09 23:03:06.655429 ip-10-0-143-205 kubenswrapper[2583]: I0709 23:03:06.655312    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zf9j9_0245a63a-3c62-4d8e-ba25-c5bbe80c16d3/payload-processing/0.log"