Jul 20 04:59:04.054188 ip-10-0-135-196 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 04:59:04.502122 ip-10-0-135-196 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 04:59:04.502122 ip-10-0-135-196 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 04:59:04.502122 ip-10-0-135-196 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 04:59:04.502122 ip-10-0-135-196 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 04:59:04.502122 ip-10-0-135-196 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 04:59:04.505076 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.504968    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 04:59:04.509344 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509328    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 04:59:04.509344 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509344    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509348    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509352    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509354    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509357    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509360    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509362    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509365    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509369    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509372    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509374    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509377    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509380    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509383    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509385    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509387    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509390    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509393    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509396    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509399    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 04:59:04.509408 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509401    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509404    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509406    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509409    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509413    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509417    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509420    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509423    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509426    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509429    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509432    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509435    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509438    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509441    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509443    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509446    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509448    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509451    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509453    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 04:59:04.509928 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509456    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509458    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509461    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509464    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509466    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509469    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509471    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509474    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509477    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509480    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509482    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509485    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509487    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509490    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509493    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509495    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509498    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509500    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509503    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509505    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 04:59:04.510372 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509508    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509510    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509513    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509517    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509520    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509523    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509525    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509529    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509531    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509534    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509536    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509540    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509544    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509547    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509550    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509553    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509555    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509558    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509560    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 04:59:04.510850 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509564    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509566    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509569    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509571    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509574    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509577    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509579    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509583    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509586    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509588    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509591    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509594    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509596    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509599    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509601    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509604    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509606    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509609    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509611    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.509614    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 04:59:04.511314 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511117    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511126    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511130    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511133    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511136    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511140    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511143    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511146    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511149    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511152    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511154    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511157    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511159    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511162    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511164    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511167    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511169    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511172    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511175    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511178    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511181    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 04:59:04.511793 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511183    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511187    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511191    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511194    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511196    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511199    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511202    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511204    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511208    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511212    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511214    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511217    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511220    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511223    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511225    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511228    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511231    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511234    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511237    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 04:59:04.512361 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511240    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511242    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511245    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511248    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511250    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511253    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511256    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511259    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511261    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511264    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511266    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511269    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511272    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511275    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511277    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511280    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511282    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511285    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511287    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511290    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 04:59:04.512936 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511292    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511296    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511298    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511301    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511304    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511306    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511309    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511311    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511314    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511316    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511319    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511322    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511324    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511327    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511329    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511332    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511334    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511337    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511339    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 04:59:04.513430 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511342    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511344    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511347    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511349    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511352    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511355    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511357    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511360    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511362    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511365    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511367    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511370    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511372    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511375    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511377    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511379    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511382    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511384    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511386    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511389    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 04:59:04.513902 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511758    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511763    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511766    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511769    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511772    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511775    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511778    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511780    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511783    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511785    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511788    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511791    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511793    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511796    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511798    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511801    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511804    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511807    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511809    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511811    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 04:59:04.514383 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511814    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511816    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511819    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511821    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511824    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511826    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511829    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511832    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511834    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511836    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511839    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511843    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511847    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511851    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511854    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511857    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511859    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511862    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511864    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 04:59:04.514872 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511867    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511871    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511888    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511892    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511895    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511898    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511901    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511904    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511907    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511910    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511914    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511916    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511919    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511922    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511925    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511927    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511930    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511932    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511935    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 04:59:04.515334 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511937    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511939    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511942    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511944    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511946    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511949    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511951    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511954    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511956    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511958    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511961    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511963    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511967    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511970    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511972    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511975    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511977    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511980    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511982    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 04:59:04.515796 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511985    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511987    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511989    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511992    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511995    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.511997    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512000    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512002    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512004    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512007    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512010    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512012    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512014    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512017    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512019    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512022    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512024    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512027    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512029    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512032    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 04:59:04.524490 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512035    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512037    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512107    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512114    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512120    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512124    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512128    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512132    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512136    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512140    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512143    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512146    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512149    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512153    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512156    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512159    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512161    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512164    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512167    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512170    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512175    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512177    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512180    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512184    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 04:59:04.524989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512187    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512190    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512193    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512196    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512199    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512203    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512206    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512209    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512212    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512214    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512218    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512221    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512224    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512227    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512229    2576 flags.go:64] FLAG: --enable-server="true"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512233    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512237    2576 flags.go:64] FLAG: --event-burst="100"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512240    2576 flags.go:64] FLAG: --event-qps="50"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512243    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512245    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512248    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512252    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512255    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512258    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512261    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 20 04:59:04.525564 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512264    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512266    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512269    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512271    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512274    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512277    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512280    2576 flags.go:64] FLAG: --feature-gates=""
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512283    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512286    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512289    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512292    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512294    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512297    2576 flags.go:64] FLAG: --help="false"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512300    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-135-196.ec2.internal"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512302    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512309    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512311    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512315    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512318    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512320    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512323    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512326    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512329    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 04:59:04.526207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512332    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512335    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512338    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512341    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512343    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512346    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512352    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512355    2576 flags.go:64] FLAG: --lock-file=""
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512358    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512361    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512364    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512370    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512373    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512376    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512379    2576 flags.go:64] FLAG: --logging-format="text"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512382    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512385    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512387    2576 flags.go:64] FLAG: --manifest-url=""
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512391    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512395    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512398    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512402    2576 flags.go:64] FLAG: --max-pods="110"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512405    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512408    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512411    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 04:59:04.526777 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512414    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512417    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512420    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512423    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512429    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512432    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512435    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512438    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512442    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512447    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512449    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512452    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512455    2576 flags.go:64] FLAG: --port="10250"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512458    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512462    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a258463ab2b6553f"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512465    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512468    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512470    2576 flags.go:64] FLAG: --register-node="true"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512473    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512477    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512479    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512482    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512485    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512488    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512491    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 04:59:04.527384 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512494    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512496    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512499    2576 flags.go:64] FLAG: --runonce="false"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512502    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512505    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512507    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512511    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512514    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512517    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512520    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512523    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512526    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512528    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512531    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512534    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512537    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512540    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512543    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512549    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512551    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512554    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512559    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512562    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512564    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512567    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 04:59:04.528034 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512570    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512573    2576 flags.go:64] FLAG: --v="2"
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512577    2576 flags.go:64] FLAG: --version="false"
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512581    2576 flags.go:64] FLAG: --vmodule=""
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512585    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.512588    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512728    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512744    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512748    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512751    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512754    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512757    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512760    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512763    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512767    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512770    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512773    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512776    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512779    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512783    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512788    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 04:59:04.528628 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512791    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512796    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512800    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512803    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512806    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512808    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512811    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512814    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512816    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512819    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512822    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512825    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512828    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512830    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512833    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512836    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512838    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512841    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512845    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 04:59:04.529161 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512848    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512851    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512854    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512856    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512859    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512862    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512865    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512867    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512870    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512873    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512885    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512888    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512891    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512893    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512896    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512898    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512901    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512903    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512906    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 04:59:04.529762 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512908    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512911    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512913    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512916    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512919    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512922    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512924    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512927    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512930    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512932    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512935    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512938    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512944    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512947    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512949    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512952    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512955    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512957    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512960    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512962    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 04:59:04.530241 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512965    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512968    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512972    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512975    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512978    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512981    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512984    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512986    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512989    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512991    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512994    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512997    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.512999    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.513001    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.513004    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.513006    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.513009    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.513012    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.513015    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.513017    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 04:59:04.530729 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.513020    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 04:59:04.531225 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.513022    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 04:59:04.531225 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.513025    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 04:59:04.531225 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.513027    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 04:59:04.531225 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.513031    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 04:59:04.531225 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.513034    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 04:59:04.531225 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.513044    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 04:59:04.531225 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.521570    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 04:59:04.531225 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.521589    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 04:59:04.531225 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.521607    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 04:59:04.531225 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.521618    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 04:59:04.531225 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521679    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 04:59:04.531225 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521687    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 04:59:04.531225 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521690    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 04:59:04.531225 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521693    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 04:59:04.531225 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521696    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521700    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521704    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521706    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521709    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521712    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521715    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521718    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521720    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521723    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521725    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521728    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521730    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521733    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521735    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521738    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521740    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521743    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521745    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 04:59:04.531612 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521748    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521750    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521753    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521755    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521758    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521760    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521769    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521772    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521775    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521778    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521781    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521783    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521787    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521791    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521793    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521796    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521798    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521801    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521803    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521806    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 04:59:04.532191 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521808    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521811    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521813    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521816    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521818    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521820    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521823    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521825    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521828    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521830    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521833    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521835    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521837    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521840    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521842    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521845    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521847    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521850    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521853    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521861    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 04:59:04.532667 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521864    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521866    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521869    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521871    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521874    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521894    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521897    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521900    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521903    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521905    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521908    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521910    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521913    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521915    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521918    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521920    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521923    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521925    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521928    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 04:59:04.533190 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521930    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 04:59:04.533650 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521934    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 04:59:04.533650 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521938    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 04:59:04.533650 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521941    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 04:59:04.533650 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521944    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 04:59:04.533650 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521947    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 04:59:04.533650 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521949    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 04:59:04.533650 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521952    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 04:59:04.533650 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521954    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 04:59:04.533650 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521956    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 04:59:04.533650 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521959    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 04:59:04.533650 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521962    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 04:59:04.533650 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521965    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 04:59:04.533650 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521973    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 04:59:04.533650 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521976    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 04:59:04.533650 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521979    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 04:59:04.533650 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.521981    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 04:59:04.534056 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.521986    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 04:59:04.534056 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522138    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 04:59:04.534056 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522143    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 04:59:04.534056 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522146    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 04:59:04.534056 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522148    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 04:59:04.534056 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522151    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 04:59:04.534056 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522154    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 04:59:04.534056 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522157    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 04:59:04.534056 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522160    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 04:59:04.534056 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522162    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 04:59:04.534056 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522164    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 04:59:04.534056 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522167    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 04:59:04.534056 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522169    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 04:59:04.534056 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522172    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 04:59:04.534056 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522175    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522177    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522179    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522182    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522184    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522187    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522189    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522192    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522194    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522197    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522199    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522202    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522204    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522207    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522209    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522217    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522220    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522223    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522226    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 04:59:04.534416 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522228    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522231    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522233    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522236    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522238    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522241    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522243    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522246    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522248    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522252    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522255    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522258    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522261    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522264    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522266    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522268    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522271    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522273    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522276    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 04:59:04.534871 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522278    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522281    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522283    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522286    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522288    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522291    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522294    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522297    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522300    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522302    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522312    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522314    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522317    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522319    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522322    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522324    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522326    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522329    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522331    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522334    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 04:59:04.535338 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522336    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522338    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522341    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522343    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522346    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522348    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522350    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522353    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522355    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522357    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522360    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522362    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522365    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522367    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522370    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522372    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522374    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522377    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522380    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522382    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 04:59:04.536083 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522385    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 04:59:04.536895 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522387    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 04:59:04.536895 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522390    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 04:59:04.536895 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522397    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 04:59:04.536895 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522400    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 04:59:04.536895 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522403    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 04:59:04.536895 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522405    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 04:59:04.536895 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:04.522409    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 04:59:04.536895 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.522414    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 04:59:04.536895 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.522537    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 04:59:04.536895 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.525899    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 04:59:04.536895 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.527902    2576 server.go:1019] "Starting client certificate rotation"
Jul 20 04:59:04.536895 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.528000    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 04:59:04.536895 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.528035    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 04:59:04.537378 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.531514    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 04:59:04.538602 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.538582    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 04:59:04.548577 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.548559    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 20 04:59:04.552665 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.552648    2576 log.go:25] "Validated CRI v1 image API"
Jul 20 04:59:04.553494 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.553477    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 04:59:04.556187 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.556168    2576 fs.go:135] Filesystem UUIDs: map[0bb57830-f845-4197-9851-45afe0b21a90:/dev/nvme0n1p4 5119f55a-220c-4a35-ad48-48ce65f96461:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 20 04:59:04.556248 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.556188    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 04:59:04.561660 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.561556    2576 manager.go:216] Machine: {Timestamp:2026-07-20 04:59:04.561067678 +0000 UTC m=+0.376561740 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097705 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d1a070a4d2c1ea24a75e0b19351d5 SystemUUID:ec2d1a07-0a4d-2c1e-a24a-75e0b19351d5 BootID:6553d1db-2a5a-43ef-b53d-2f958cfb5277 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6d:98:bb:b7:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6d:98:bb:b7:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:a0:03:7a:4b:c1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 04:59:04.561660 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.561657    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 04:59:04.561775 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.561735    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 04:59:04.565108 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.565080    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 04:59:04.565248 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.565113    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-196.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 04:59:04.565451 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.565437    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 04:59:04.565986 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.565974    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 04:59:04.566022 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.565990    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 04:59:04.566022 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.565998    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 04:59:04.566022 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.566012    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 04:59:04.567682 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.567669    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 04:59:04.571026 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.571015    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 04:59:04.571149 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.571140    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 04:59:04.571179 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.571170    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 04:59:04.571208 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.571182    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 04:59:04.571208 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.571193    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 04:59:04.571208 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.571201    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 20 04:59:04.571283 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.571210    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 04:59:04.571653 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.571641    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 04:59:04.571706 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.571662    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 04:59:04.574308 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.574291    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 04:59:04.576486 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.576471    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 04:59:04.576542 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.576501    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 04:59:04.577960 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.577948    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 04:59:04.578005 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.577964    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 04:59:04.578005 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.577970    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 04:59:04.578005 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.577977    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 04:59:04.578005 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.577985    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 04:59:04.578005 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.577991    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 04:59:04.578005 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.577998    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 04:59:04.578005 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.578003    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 04:59:04.578186 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.578009    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 04:59:04.578186 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.578015    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 04:59:04.578186 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.578023    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 04:59:04.578186 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.578029    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 04:59:04.578903 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.578874    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 04:59:04.578938 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.578907    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 04:59:04.582383 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.582365    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-196.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 04:59:04.582479 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.582451    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 04:59:04.582573 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.582556    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-196.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 04:59:04.582625 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.582590    2576 server.go:1268] "Started kubelet"
Jul 20 04:59:04.582701 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.582671    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 04:59:04.587266 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.587151    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 04:59:04.587354 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.587292    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 04:59:04.587439 ip-10-0-135-196 systemd[1]: Started Kubernetes Kubelet.
Jul 20 04:59:04.590227 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.590209    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 04:59:04.590412 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.590388    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 04:59:04.592725 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.592705    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 04:59:04.594117 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.592995    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-196.ec2.internal.18c3e6b5802a2394  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-196.ec2.internal,UID:ip-10-0-135-196.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-196.ec2.internal,},FirstTimestamp:2026-07-20 04:59:04.582562708 +0000 UTC m=+0.398056771,LastTimestamp:2026-07-20 04:59:04.582562708 +0000 UTC m=+0.398056771,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-196.ec2.internal,}"
Jul 20 04:59:04.598933 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.598917    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 04:59:04.599013 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.598995    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 04:59:04.599262 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.599084    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-196.ec2.internal\" not found"
Jul 20 04:59:04.599788 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.599772    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 04:59:04.599870 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.599792    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 04:59:04.599870 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.599774    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 04:59:04.600006 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.599921    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 04:59:04.600006 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.599929    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 04:59:04.600103 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.600007    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 04:59:04.600103 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.600020    2576 factory.go:55] Registering systemd factory
Jul 20 04:59:04.600103 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.600027    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 20 04:59:04.600245 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.600239    2576 factory.go:153] Registering CRI-O factory
Jul 20 04:59:04.600300 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.600250    2576 factory.go:223] Registration of the crio container factory successfully
Jul 20 04:59:04.600300 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.600267    2576 factory.go:103] Registering Raw factory
Jul 20 04:59:04.600300 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.600281    2576 manager.go:1196] Started watching for new ooms in manager
Jul 20 04:59:04.600631 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.600613    2576 manager.go:349] Starting recovery of all containers
Jul 20 04:59:04.604440 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.604416    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 04:59:04.604539 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.604475    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-196.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 04:59:04.607729 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.607693    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mcnrn"
Jul 20 04:59:04.609312 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.609294    2576 manager.go:354] Recovery completed
Jul 20 04:59:04.613469 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.613455    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 04:59:04.614224 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.614204    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mcnrn"
Jul 20 04:59:04.615229 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.615212    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 04:59:04.615290 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.615247    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 04:59:04.615290 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.615262    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasSufficientPID"
Jul 20 04:59:04.615794 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.615779    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 04:59:04.615794 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.615790    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 04:59:04.615987 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.615800    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 04:59:04.615987 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.615804    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 04:59:04.616620 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.616604    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 04:59:04.616684 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.616632    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 04:59:04.616684 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.616647    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasSufficientPID"
Jul 20 04:59:04.616938 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.616842    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-196.ec2.internal.18c3e6b5821c9a59  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-196.ec2.internal,UID:ip-10-0-135-196.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-196.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-196.ec2.internal,},FirstTimestamp:2026-07-20 04:59:04.615230041 +0000 UTC m=+0.430724110,LastTimestamp:2026-07-20 04:59:04.615230041 +0000 UTC m=+0.430724110,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-196.ec2.internal,}"
Jul 20 04:59:04.617165 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.617154    2576 policy_none.go:49] "None policy: Start"
Jul 20 04:59:04.617213 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.617170    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 04:59:04.617213 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.617180    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 04:59:04.618111 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.618100    2576 policy_none.go:47] "Start"
Jul 20 04:59:04.650261 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.650093    2576 manager.go:337] "Starting Device Plugin manager"
Jul 20 04:59:04.650347 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.650289    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 04:59:04.650347 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.650305    2576 server.go:87] "Starting device plugin registration server"
Jul 20 04:59:04.650545 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.650532    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 04:59:04.650588 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.650549    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 04:59:04.650755 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.650708    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 04:59:04.650834 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.650812    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 04:59:04.650834 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.650821    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 04:59:04.651274 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.651248    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 04:59:04.651364 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.651300    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-196.ec2.internal\" not found"
Jul 20 04:59:04.672789 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.672764    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 04:59:04.674143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.674128    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 04:59:04.674236 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.674162    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 04:59:04.674236 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.674182    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 04:59:04.674236 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.674212    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 04:59:04.676584 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.676567    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 04:59:04.751592 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.751549    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 04:59:04.752540 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.752490    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 04:59:04.752540 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.752519    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 04:59:04.752540 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.752530    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasSufficientPID"
Jul 20 04:59:04.752675 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.752553    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-196.ec2.internal"
Jul 20 04:59:04.761730 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.761714    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-196.ec2.internal"
Jul 20 04:59:04.761777 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.761736    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-196.ec2.internal\": node \"ip-10-0-135-196.ec2.internal\" not found"
Jul 20 04:59:04.774495 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.774469    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-196.ec2.internal"]
Jul 20 04:59:04.774594 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.774536    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 04:59:04.776095 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.776079    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 04:59:04.776170 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.776108    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 04:59:04.776170 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.776117    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasSufficientPID"
Jul 20 04:59:04.777230 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.777218    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 04:59:04.777366 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.777352    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal"
Jul 20 04:59:04.777401 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.777383    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 04:59:04.779184 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.779167    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 04:59:04.779184 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.779173    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 04:59:04.779286 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.779192    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 04:59:04.779286 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.779196    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 04:59:04.779286 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.779205    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasSufficientPID"
Jul 20 04:59:04.779373 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.779207    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasSufficientPID"
Jul 20 04:59:04.780360 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.780344    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-196.ec2.internal"
Jul 20 04:59:04.780441 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.780373    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 04:59:04.781111 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.781096    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 04:59:04.781191 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.781117    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 04:59:04.781191 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.781132    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeHasSufficientPID"
Jul 20 04:59:04.789223 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.789203    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-196.ec2.internal\" not found"
Jul 20 04:59:04.806450 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.806426    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-196.ec2.internal\" not found" node="ip-10-0-135-196.ec2.internal"
Jul 20 04:59:04.810777 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.810759    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-196.ec2.internal\" not found" node="ip-10-0-135-196.ec2.internal"
Jul 20 04:59:04.889956 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.889927    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-196.ec2.internal\" not found"
Jul 20 04:59:04.900707 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.900686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/375bab45795bfb097938a9d45503a9ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal\" (UID: \"375bab45795bfb097938a9d45503a9ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal"
Jul 20 04:59:04.900762 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.900712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/375bab45795bfb097938a9d45503a9ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal\" (UID: \"375bab45795bfb097938a9d45503a9ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal"
Jul 20 04:59:04.900762 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:04.900742    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa8803663572406e0c5539a65925db49-config\") pod \"kube-apiserver-proxy-ip-10-0-135-196.ec2.internal\" (UID: \"fa8803663572406e0c5539a65925db49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-196.ec2.internal"
Jul 20 04:59:04.990892 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:04.990841    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-196.ec2.internal\" not found"
Jul 20 04:59:05.001102 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.001082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/375bab45795bfb097938a9d45503a9ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal\" (UID: \"375bab45795bfb097938a9d45503a9ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal"
Jul 20 04:59:05.001148 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.001115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/375bab45795bfb097938a9d45503a9ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal\" (UID: \"375bab45795bfb097938a9d45503a9ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal"
Jul 20 04:59:05.001148 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.001132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa8803663572406e0c5539a65925db49-config\") pod \"kube-apiserver-proxy-ip-10-0-135-196.ec2.internal\" (UID: \"fa8803663572406e0c5539a65925db49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-196.ec2.internal"
Jul 20 04:59:05.001212 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.001160    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa8803663572406e0c5539a65925db49-config\") pod \"kube-apiserver-proxy-ip-10-0-135-196.ec2.internal\" (UID: \"fa8803663572406e0c5539a65925db49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-196.ec2.internal"
Jul 20 04:59:05.001212 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.001183    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/375bab45795bfb097938a9d45503a9ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal\" (UID: \"375bab45795bfb097938a9d45503a9ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal"
Jul 20 04:59:05.001212 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.001183    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/375bab45795bfb097938a9d45503a9ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal\" (UID: \"375bab45795bfb097938a9d45503a9ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal"
Jul 20 04:59:05.091635 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:05.091547    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-196.ec2.internal\" not found"
Jul 20 04:59:05.111022 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.111001    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal"
Jul 20 04:59:05.115138 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.114987    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-196.ec2.internal"
Jul 20 04:59:05.192436 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:05.192381    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-196.ec2.internal\" not found"
Jul 20 04:59:05.292938 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:05.292907    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-196.ec2.internal\" not found"
Jul 20 04:59:05.393458 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:05.393387    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-196.ec2.internal\" not found"
Jul 20 04:59:05.493966 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:05.493925    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-196.ec2.internal\" not found"
Jul 20 04:59:05.526387 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.526359    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 04:59:05.526779 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.526495    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 04:59:05.585610 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.585585    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 04:59:05.599808 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.599788    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal"
Jul 20 04:59:05.599924 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.599796    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 04:59:05.611124 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.611101    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 04:59:05.614020 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.614006    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 04:59:05.615938 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.615925    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-196.ec2.internal"
Jul 20 04:59:05.619776 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.619751    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 04:54:05 +0000 UTC" deadline="2028-02-12 16:33:41.071751005 +0000 UTC"
Jul 20 04:59:05.619776 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.619776    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13739h34m35.451979088s"
Jul 20 04:59:05.625087 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.625073    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 04:59:05.633064 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.633044    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wmbj8"
Jul 20 04:59:05.643137 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.643115    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wmbj8"
Jul 20 04:59:05.707704 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.707637    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 04:59:05.747799 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:05.747769    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8803663572406e0c5539a65925db49.slice/crio-e6d20c82785a84d16201682b27acb050775dcb60c8084f55b70ca8743e7e5604 WatchSource:0}: Error finding container e6d20c82785a84d16201682b27acb050775dcb60c8084f55b70ca8743e7e5604: Status 404 returned error can't find the container with id e6d20c82785a84d16201682b27acb050775dcb60c8084f55b70ca8743e7e5604
Jul 20 04:59:05.748001 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:05.747981    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375bab45795bfb097938a9d45503a9ae.slice/crio-a94877b5e70ec28f5b137b77caf2edd920038e748c5b2d68f307b55abceef4b6 WatchSource:0}: Error finding container a94877b5e70ec28f5b137b77caf2edd920038e748c5b2d68f307b55abceef4b6: Status 404 returned error can't find the container with id a94877b5e70ec28f5b137b77caf2edd920038e748c5b2d68f307b55abceef4b6
Jul 20 04:59:05.752137 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.752122    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 04:59:05.825380 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:05.825356    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 04:59:06.572213 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.572119    2576 apiserver.go:52] "Watching apiserver"
Jul 20 04:59:06.586568 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.586538    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 04:59:06.587617 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.587223    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-842kd","openshift-network-operator/iptables-alerter-qrz45","kube-system/konnectivity-agent-9kxcb","kube-system/kube-apiserver-proxy-ip-10-0-135-196.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb","openshift-cluster-node-tuning-operator/tuned-sdlmg","openshift-multus/network-metrics-daemon-wcqzq","openshift-ovn-kubernetes/ovnkube-node-dng2q","kube-system/global-pull-secret-syncer-rq2k2","openshift-dns/node-resolver-7q97q","openshift-image-registry/node-ca-qqt42","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal","openshift-multus/multus-additional-cni-plugins-qvzvv","openshift-multus/multus-nrrn9"]
Jul 20 04:59:06.590533 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.589906    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7q97q"
Jul 20 04:59:06.592584 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.592557    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7j556\""
Jul 20 04:59:06.592697 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.592638    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 04:59:06.593134 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.592923    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 04:59:06.593134 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.593036    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.595585 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.595555    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.596211 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.596190    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bq5lz\""
Jul 20 04:59:06.596427 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.596409    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 04:59:06.596891 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.596441    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 04:59:06.597243 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.596716    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 04:59:06.597243 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.596720    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 04:59:06.597243 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.596776    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 04:59:06.602168 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.597590    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 04:59:06.602168 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.597920    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-64gwh\""
Jul 20 04:59:06.602168 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.598707    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.602168 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.601236    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 04:59:06.602168 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.601300    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.602168 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.601461    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jqzrx\""
Jul 20 04:59:06.602168 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.601663    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 04:59:06.602168 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.601710    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 04:59:06.603868 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.602991    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 04:59:06.603868 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.603262    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.605070 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.604278    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 04:59:06.605070 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.604362    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 04:59:06.605070 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.604580    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 04:59:06.605070 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.604601    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 04:59:06.605070 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.604812    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 04:59:06.605070 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.604841    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ns7pw\""
Jul 20 04:59:06.606104 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.605873    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qqt42"
Jul 20 04:59:06.606104 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.606004    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 04:59:06.606104 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.606038    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g5vp8\""
Jul 20 04:59:06.606524 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.606508    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 04:59:06.608328 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.608199    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 04:59:06.608885 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.608735    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:06.608885 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.608795    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-cni-binary-copy\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.608885 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:06.608803    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:06.608885 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.608812    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 04:59:06.608885 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.608831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.608885 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.608876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-device-dir\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.609293 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.608907    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0af4aff-f764-4b26-bb61-f9afc814fc08-tmp\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.609293 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.608955    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dljcb\" (UniqueName: \"kubernetes.io/projected/e5c87251-66a3-49c9-ae5f-8ed4e6ac4075-kube-api-access-dljcb\") pod \"node-resolver-7q97q\" (UID: \"e5c87251-66a3-49c9-ae5f-8ed4e6ac4075\") " pod="openshift-dns/node-resolver-7q97q"
Jul 20 04:59:06.609293 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.608988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-os-release\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.609293 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.608999    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 04:59:06.609293 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-multus-conf-dir\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.609293 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-node-log\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.609293 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609056    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71a6a6ed-8042-481f-827e-f686f89c6094-ovnkube-config\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.609293 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd8w8\" (UniqueName: \"kubernetes.io/projected/d50b6621-23c7-4762-82e2-0d723970866a-kube-api-access-kd8w8\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.609293 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-run-netns\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.609293 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-run\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.609293 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609152    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-run-k8s-cni-cncf-io\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.609293 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-var-lib-cni-multus\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.609293 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609224    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e5c87251-66a3-49c9-ae5f-8ed4e6ac4075-hosts-file\") pod \"node-resolver-7q97q\" (UID: \"e5c87251-66a3-49c9-ae5f-8ed4e6ac4075\") " pod="openshift-dns/node-resolver-7q97q"
Jul 20 04:59:06.609293 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609248    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5c87251-66a3-49c9-ae5f-8ed4e6ac4075-tmp-dir\") pod \"node-resolver-7q97q\" (UID: \"e5c87251-66a3-49c9-ae5f-8ed4e6ac4075\") " pod="openshift-dns/node-resolver-7q97q"
Jul 20 04:59:06.609293 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-run-netns\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-cni-bin\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609346    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71a6a6ed-8042-481f-827e-f686f89c6094-ovn-node-metrics-cert\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-lib-modules\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609406    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-run-systemd\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609447    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-modprobe-d\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609471    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-sysconfig\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609524    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-host\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-var-lib-cni-bin\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-cni-netd\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-sys\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609713    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-slash\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-var-lib-openvswitch\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.608744    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8bzk2\""
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609795    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc5r6\" (UniqueName: \"kubernetes.io/projected/71a6a6ed-8042-481f-827e-f686f89c6094-kube-api-access-qc5r6\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609854    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-var-lib-kubelet\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.610052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-hostroot\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.610856 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609919    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-etc-openvswitch\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.610856 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.609986    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-tuned\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.610856 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610059    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-system-cni-dir\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.610856 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610141    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fdg8\" (UniqueName: \"kubernetes.io/projected/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-kube-api-access-8fdg8\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.610856 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610171    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-system-cni-dir\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.610856 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610207    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-var-lib-kubelet\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.610856 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610243    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-log-socket\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.610856 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610277    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-socket-dir\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.610856 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610316    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-registration-dir\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.610856 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610365    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-cnibin\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.610856 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610400    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-multus-socket-dir-parent\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.610856 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610435    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71a6a6ed-8042-481f-827e-f686f89c6094-ovnkube-script-lib\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.610856 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610471    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.610856 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610496    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-etc-selinux\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.610856 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-sysctl-conf\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.610856 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610565    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcxhv\" (UniqueName: \"kubernetes.io/projected/f0af4aff-f764-4b26-bb61-f9afc814fc08-kube-api-access-zcxhv\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.611502 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-multus-cni-dir\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.611502 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610631    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-os-release\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.611502 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610654    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-run-multus-certs\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.611502 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610678    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-kubelet\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.611502 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610716    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-systemd\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.611502 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-cnibin\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.611502 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.611502 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ad5e720-6cda-450f-966e-63560e8edbfe-cni-binary-copy\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.611502 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-etc-kubernetes\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.611502 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610869    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-systemd-units\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.611502 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610891    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-sys-fs\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.611502 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-run-openvswitch\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.611989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.610987    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-sysctl-d\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.611989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.611974    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ad5e720-6cda-450f-966e-63560e8edbfe-multus-daemon-config\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.612079 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.612026    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c89dw\" (UniqueName: \"kubernetes.io/projected/9ad5e720-6cda-450f-966e-63560e8edbfe-kube-api-access-c89dw\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.612079 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.612051    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-run-ovn\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.612147 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.612080    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71a6a6ed-8042-481f-827e-f686f89c6094-env-overrides\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.612147 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.612103    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-kubernetes\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.612147 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.612127    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.612252 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.612162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-run-ovn-kubernetes\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.612336 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.612308    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qrz45"
Jul 20 04:59:06.615617 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.614257    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:06.615617 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:06.614389    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:06.615617 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.614909    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 04:59:06.615617 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.615146    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 04:59:06.615617 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.615197    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 04:59:06.615617 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.615443    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z4fdg\""
Jul 20 04:59:06.618308 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.618232    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:06.618408 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:06.618333    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:06.620979 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.620942    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9kxcb"
Jul 20 04:59:06.623541 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.623519    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 04:59:06.623628 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.623564    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mxj6s\""
Jul 20 04:59:06.623706 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.623565    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 04:59:06.645796 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.645712    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 04:54:06 +0000 UTC" deadline="2027-12-25 22:01:02.630773889 +0000 UTC"
Jul 20 04:59:06.645796 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.645759    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12569h1m55.985019239s"
Jul 20 04:59:06.680053 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.680008    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal" event={"ID":"375bab45795bfb097938a9d45503a9ae","Type":"ContainerStarted","Data":"a94877b5e70ec28f5b137b77caf2edd920038e748c5b2d68f307b55abceef4b6"}
Jul 20 04:59:06.681508 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.681481    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-196.ec2.internal" event={"ID":"fa8803663572406e0c5539a65925db49","Type":"ContainerStarted","Data":"e6d20c82785a84d16201682b27acb050775dcb60c8084f55b70ca8743e7e5604"}
Jul 20 04:59:06.701447 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.701426    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 04:59:06.712491 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712462    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c89dw\" (UniqueName: \"kubernetes.io/projected/9ad5e720-6cda-450f-966e-63560e8edbfe-kube-api-access-c89dw\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.712609 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-run-ovn\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.712609 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71a6a6ed-8042-481f-827e-f686f89c6094-env-overrides\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.712609 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712555    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-kubernetes\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.712609 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712581    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.712795 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-run-ovn-kubernetes\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.712795 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712633    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-cni-binary-copy\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.712795 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712662    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.712795 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712688    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-device-dir\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.712795 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0af4aff-f764-4b26-bb61-f9afc814fc08-tmp\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.712795 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dljcb\" (UniqueName: \"kubernetes.io/projected/e5c87251-66a3-49c9-ae5f-8ed4e6ac4075-kube-api-access-dljcb\") pod \"node-resolver-7q97q\" (UID: \"e5c87251-66a3-49c9-ae5f-8ed4e6ac4075\") " pod="openshift-dns/node-resolver-7q97q"
Jul 20 04:59:06.712795 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-os-release\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712804    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-multus-conf-dir\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712816    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-run-ovn-kubernetes\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712829    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-node-log\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712866    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71a6a6ed-8042-481f-827e-f686f89c6094-ovnkube-config\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712868    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-run-ovn\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712873    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-node-log\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712904    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd8w8\" (UniqueName: \"kubernetes.io/projected/d50b6621-23c7-4762-82e2-0d723970866a-kube-api-access-kd8w8\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712932    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcx78\" (UniqueName: \"kubernetes.io/projected/88b1cb62-7157-467a-8a3f-742e959c5a3a-kube-api-access-tcx78\") pod \"iptables-alerter-qrz45\" (UID: \"88b1cb62-7157-467a-8a3f-742e959c5a3a\") " pod="openshift-network-operator/iptables-alerter-qrz45"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-run-netns\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-run\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.712991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs\") pod \"network-metrics-daemon-wcqzq\" (UID: \"00052a42-6eff-4102-b46e-67ee21d241f0\") " pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713024    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88b1cb62-7157-467a-8a3f-742e959c5a3a-host-slash\") pod \"iptables-alerter-qrz45\" (UID: \"88b1cb62-7157-467a-8a3f-742e959c5a3a\") " pod="openshift-network-operator/iptables-alerter-qrz45"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713052    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-run-k8s-cni-cncf-io\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713083    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-var-lib-cni-multus\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713100    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/88b1cb62-7157-467a-8a3f-742e959c5a3a-iptables-alerter-script\") pod \"iptables-alerter-qrz45\" (UID: \"88b1cb62-7157-467a-8a3f-742e959c5a3a\") " pod="openshift-network-operator/iptables-alerter-qrz45"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713127    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-855ps\" (UniqueName: \"kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps\") pod \"network-check-target-842kd\" (UID: \"f6861683-6a87-42a1-9f74-e1722936d58a\") " pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:06.713143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e5c87251-66a3-49c9-ae5f-8ed4e6ac4075-hosts-file\") pod \"node-resolver-7q97q\" (UID: \"e5c87251-66a3-49c9-ae5f-8ed4e6ac4075\") " pod="openshift-dns/node-resolver-7q97q"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713171    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5c87251-66a3-49c9-ae5f-8ed4e6ac4075-tmp-dir\") pod \"node-resolver-7q97q\" (UID: \"e5c87251-66a3-49c9-ae5f-8ed4e6ac4075\") " pod="openshift-dns/node-resolver-7q97q"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713198    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-run-netns\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713222    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-cni-bin\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713239    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71a6a6ed-8042-481f-827e-f686f89c6094-ovn-node-metrics-cert\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-lib-modules\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713298    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e97dc9be-002f-49cc-9308-66d2d9119e64-agent-certs\") pod \"konnectivity-agent-9kxcb\" (UID: \"e97dc9be-002f-49cc-9308-66d2d9119e64\") " pod="kube-system/konnectivity-agent-9kxcb"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-run-systemd\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-modprobe-d\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-sysconfig\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-host\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-var-lib-cni-bin\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713472    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-cni-netd\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713514    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-cni-binary-copy\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713559    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-sys\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713585    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713616    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-slash\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.713854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-var-lib-openvswitch\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc5r6\" (UniqueName: \"kubernetes.io/projected/71a6a6ed-8042-481f-827e-f686f89c6094-kube-api-access-qc5r6\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-var-lib-kubelet\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713807    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgqs7\" (UniqueName: \"kubernetes.io/projected/7aeacaeb-c51d-4a2c-962a-cc69281308f9-kube-api-access-sgqs7\") pod \"node-ca-qqt42\" (UID: \"7aeacaeb-c51d-4a2c-962a-cc69281308f9\") " pod="openshift-image-registry/node-ca-qqt42"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713820    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-os-release\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713831    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-hostroot\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-etc-openvswitch\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713877    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-multus-conf-dir\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-tuned\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713905    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713915    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret\") pod \"global-pull-secret-syncer-rq2k2\" (UID: \"d1d1f768-3baf-41e6-afbc-15c2b7856475\") " pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713930    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713948    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-system-cni-dir\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.713990    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fdg8\" (UniqueName: \"kubernetes.io/projected/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-kube-api-access-8fdg8\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714014    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-device-dir\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-system-cni-dir\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714060    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-kubernetes\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.714471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-var-lib-kubelet\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-log-socket\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-socket-dir\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714157    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-registration-dir\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-cnibin\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714211    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-multus-socket-dir-parent\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714239    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71a6a6ed-8042-481f-827e-f686f89c6094-ovnkube-script-lib\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714271    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-var-lib-kubelet\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714295    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-etc-selinux\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-sysctl-conf\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714334    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-cni-netd\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714354    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71a6a6ed-8042-481f-827e-f686f89c6094-env-overrides\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714365    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcxhv\" (UniqueName: \"kubernetes.io/projected/f0af4aff-f764-4b26-bb61-f9afc814fc08-kube-api-access-zcxhv\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714390    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1d1f768-3baf-41e6-afbc-15c2b7856475-dbus\") pod \"global-pull-secret-syncer-rq2k2\" (UID: \"d1d1f768-3baf-41e6-afbc-15c2b7856475\") " pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714414    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-multus-cni-dir\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714449    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-sysctl-conf\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.715201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-os-release\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714501    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-run-multus-certs\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714506    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-os-release\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714555    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-sys\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-kubelet\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-systemd\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7aeacaeb-c51d-4a2c-962a-cc69281308f9-serviceca\") pod \"node-ca-qqt42\" (UID: \"7aeacaeb-c51d-4a2c-962a-cc69281308f9\") " pod="openshift-image-registry/node-ca-qqt42"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714653    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4r9x\" (UniqueName: \"kubernetes.io/projected/00052a42-6eff-4102-b46e-67ee21d241f0-kube-api-access-j4r9x\") pod \"network-metrics-daemon-wcqzq\" (UID: \"00052a42-6eff-4102-b46e-67ee21d241f0\") " pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714682    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e97dc9be-002f-49cc-9308-66d2d9119e64-konnectivity-ca\") pod \"konnectivity-agent-9kxcb\" (UID: \"e97dc9be-002f-49cc-9308-66d2d9119e64\") " pod="kube-system/konnectivity-agent-9kxcb"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714695    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-cnibin\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714741    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-slash\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714742    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ad5e720-6cda-450f-966e-63560e8edbfe-cni-binary-copy\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714815    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-etc-kubernetes\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714843    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-systemd-units\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714876    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-sys-fs\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.715854 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714908    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1d1f768-3baf-41e6-afbc-15c2b7856475-kubelet-config\") pod \"global-pull-secret-syncer-rq2k2\" (UID: \"d1d1f768-3baf-41e6-afbc-15c2b7856475\") " pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-run-openvswitch\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714990    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-sysctl-d\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.715035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7aeacaeb-c51d-4a2c-962a-cc69281308f9-host\") pod \"node-ca-qqt42\" (UID: \"7aeacaeb-c51d-4a2c-962a-cc69281308f9\") " pod="openshift-image-registry/node-ca-qqt42"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.715067    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ad5e720-6cda-450f-966e-63560e8edbfe-multus-daemon-config\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.715229    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.715305    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e5c87251-66a3-49c9-ae5f-8ed4e6ac4075-hosts-file\") pod \"node-resolver-7q97q\" (UID: \"e5c87251-66a3-49c9-ae5f-8ed4e6ac4075\") " pod="openshift-dns/node-resolver-7q97q"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.715564    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5c87251-66a3-49c9-ae5f-8ed4e6ac4075-tmp-dir\") pod \"node-resolver-7q97q\" (UID: \"e5c87251-66a3-49c9-ae5f-8ed4e6ac4075\") " pod="openshift-dns/node-resolver-7q97q"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.715626    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-run-netns\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.715667    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-cni-bin\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.715725    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9ad5e720-6cda-450f-966e-63560e8edbfe-multus-daemon-config\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.715785    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-var-lib-openvswitch\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.716121    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-multus-socket-dir-parent\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.716144    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-var-lib-kubelet\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.716203    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-hostroot\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.716227    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-lib-modules\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.716247    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-etc-openvswitch\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.714816    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71a6a6ed-8042-481f-827e-f686f89c6094-ovnkube-config\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.716576 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.716424    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-host-kubelet\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.717621 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.716483    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-system-cni-dir\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.717621 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.716736    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-system-cni-dir\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.717621 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717081    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-multus-cni-dir\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.717621 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717232    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-run-systemd\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.717621 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717339    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-modprobe-d\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.717621 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717386    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-sysconfig\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.717621 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717427    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-host\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.717621 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717463    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-var-lib-cni-bin\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.717621 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717501    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-log-socket\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.717621 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717599    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-socket-dir\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.717621 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717607    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ad5e720-6cda-450f-966e-63560e8edbfe-cni-binary-copy\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.718202 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717642    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-registration-dir\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.718202 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717664    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-etc-kubernetes\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.718202 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717687    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-cnibin\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.718202 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717734    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-systemd-units\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.718202 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717738    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-systemd\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.718202 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717775    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-sys-fs\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.718202 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717811    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71a6a6ed-8042-481f-827e-f686f89c6094-run-openvswitch\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.718202 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-run-netns\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.718202 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717885    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-sysctl-d\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.718202 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.717924    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0af4aff-f764-4b26-bb61-f9afc814fc08-run\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.718202 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.718073    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-etc-selinux\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.718202 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.718121    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d50b6621-23c7-4762-82e2-0d723970866a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.718804 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.718401    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71a6a6ed-8042-481f-827e-f686f89c6094-ovnkube-script-lib\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.718804 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.718452    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-run-multus-certs\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.718804 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.718648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-run-k8s-cni-cncf-io\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.718804 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.718714    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-cnibin\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.718804 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.718757    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9ad5e720-6cda-450f-966e-63560e8edbfe-host-var-lib-cni-multus\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.719101 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.719080    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0af4aff-f764-4b26-bb61-f9afc814fc08-etc-tuned\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.719349 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.719324    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71a6a6ed-8042-481f-827e-f686f89c6094-ovn-node-metrics-cert\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.719757 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.719737    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0af4aff-f764-4b26-bb61-f9afc814fc08-tmp\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.722231 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.722064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dljcb\" (UniqueName: \"kubernetes.io/projected/e5c87251-66a3-49c9-ae5f-8ed4e6ac4075-kube-api-access-dljcb\") pod \"node-resolver-7q97q\" (UID: \"e5c87251-66a3-49c9-ae5f-8ed4e6ac4075\") " pod="openshift-dns/node-resolver-7q97q"
Jul 20 04:59:06.722472 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.722447    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c89dw\" (UniqueName: \"kubernetes.io/projected/9ad5e720-6cda-450f-966e-63560e8edbfe-kube-api-access-c89dw\") pod \"multus-nrrn9\" (UID: \"9ad5e720-6cda-450f-966e-63560e8edbfe\") " pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.724052 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.724007    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc5r6\" (UniqueName: \"kubernetes.io/projected/71a6a6ed-8042-481f-827e-f686f89c6094-kube-api-access-qc5r6\") pod \"ovnkube-node-dng2q\" (UID: \"71a6a6ed-8042-481f-827e-f686f89c6094\") " pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.724425 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.724398    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fdg8\" (UniqueName: \"kubernetes.io/projected/37a2fefc-0ae8-45b5-893b-6d60a8dbe178-kube-api-access-8fdg8\") pod \"multus-additional-cni-plugins-qvzvv\" (UID: \"37a2fefc-0ae8-45b5-893b-6d60a8dbe178\") " pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.725731 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.725711    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcxhv\" (UniqueName: \"kubernetes.io/projected/f0af4aff-f764-4b26-bb61-f9afc814fc08-kube-api-access-zcxhv\") pod \"tuned-sdlmg\" (UID: \"f0af4aff-f764-4b26-bb61-f9afc814fc08\") " pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.726464 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.726443    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd8w8\" (UniqueName: \"kubernetes.io/projected/d50b6621-23c7-4762-82e2-0d723970866a-kube-api-access-kd8w8\") pod \"aws-ebs-csi-driver-node-crdlb\" (UID: \"d50b6621-23c7-4762-82e2-0d723970866a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.816305 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.816267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/88b1cb62-7157-467a-8a3f-742e959c5a3a-iptables-alerter-script\") pod \"iptables-alerter-qrz45\" (UID: \"88b1cb62-7157-467a-8a3f-742e959c5a3a\") " pod="openshift-network-operator/iptables-alerter-qrz45"
Jul 20 04:59:06.816305 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.816315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-855ps\" (UniqueName: \"kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps\") pod \"network-check-target-842kd\" (UID: \"f6861683-6a87-42a1-9f74-e1722936d58a\") " pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:06.816624 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.816343    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e97dc9be-002f-49cc-9308-66d2d9119e64-agent-certs\") pod \"konnectivity-agent-9kxcb\" (UID: \"e97dc9be-002f-49cc-9308-66d2d9119e64\") " pod="kube-system/konnectivity-agent-9kxcb"
Jul 20 04:59:06.816624 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.816378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgqs7\" (UniqueName: \"kubernetes.io/projected/7aeacaeb-c51d-4a2c-962a-cc69281308f9-kube-api-access-sgqs7\") pod \"node-ca-qqt42\" (UID: \"7aeacaeb-c51d-4a2c-962a-cc69281308f9\") " pod="openshift-image-registry/node-ca-qqt42"
Jul 20 04:59:06.816624 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.816407    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret\") pod \"global-pull-secret-syncer-rq2k2\" (UID: \"d1d1f768-3baf-41e6-afbc-15c2b7856475\") " pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:06.816624 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.816438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1d1f768-3baf-41e6-afbc-15c2b7856475-dbus\") pod \"global-pull-secret-syncer-rq2k2\" (UID: \"d1d1f768-3baf-41e6-afbc-15c2b7856475\") " pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:06.816624 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.816466    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7aeacaeb-c51d-4a2c-962a-cc69281308f9-serviceca\") pod \"node-ca-qqt42\" (UID: \"7aeacaeb-c51d-4a2c-962a-cc69281308f9\") " pod="openshift-image-registry/node-ca-qqt42"
Jul 20 04:59:06.816624 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.816492    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4r9x\" (UniqueName: \"kubernetes.io/projected/00052a42-6eff-4102-b46e-67ee21d241f0-kube-api-access-j4r9x\") pod \"network-metrics-daemon-wcqzq\" (UID: \"00052a42-6eff-4102-b46e-67ee21d241f0\") " pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:06.816624 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.816520    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e97dc9be-002f-49cc-9308-66d2d9119e64-konnectivity-ca\") pod \"konnectivity-agent-9kxcb\" (UID: \"e97dc9be-002f-49cc-9308-66d2d9119e64\") " pod="kube-system/konnectivity-agent-9kxcb"
Jul 20 04:59:06.816624 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.816549    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1d1f768-3baf-41e6-afbc-15c2b7856475-kubelet-config\") pod \"global-pull-secret-syncer-rq2k2\" (UID: \"d1d1f768-3baf-41e6-afbc-15c2b7856475\") " pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:06.816624 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.816569    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7aeacaeb-c51d-4a2c-962a-cc69281308f9-host\") pod \"node-ca-qqt42\" (UID: \"7aeacaeb-c51d-4a2c-962a-cc69281308f9\") " pod="openshift-image-registry/node-ca-qqt42"
Jul 20 04:59:06.816624 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.816599    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcx78\" (UniqueName: \"kubernetes.io/projected/88b1cb62-7157-467a-8a3f-742e959c5a3a-kube-api-access-tcx78\") pod \"iptables-alerter-qrz45\" (UID: \"88b1cb62-7157-467a-8a3f-742e959c5a3a\") " pod="openshift-network-operator/iptables-alerter-qrz45"
Jul 20 04:59:06.816624 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.816626    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs\") pod \"network-metrics-daemon-wcqzq\" (UID: \"00052a42-6eff-4102-b46e-67ee21d241f0\") " pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:06.817169 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.816651    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88b1cb62-7157-467a-8a3f-742e959c5a3a-host-slash\") pod \"iptables-alerter-qrz45\" (UID: \"88b1cb62-7157-467a-8a3f-742e959c5a3a\") " pod="openshift-network-operator/iptables-alerter-qrz45"
Jul 20 04:59:06.817169 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.816705    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/88b1cb62-7157-467a-8a3f-742e959c5a3a-host-slash\") pod \"iptables-alerter-qrz45\" (UID: \"88b1cb62-7157-467a-8a3f-742e959c5a3a\") " pod="openshift-network-operator/iptables-alerter-qrz45"
Jul 20 04:59:06.817169 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.817044    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/88b1cb62-7157-467a-8a3f-742e959c5a3a-iptables-alerter-script\") pod \"iptables-alerter-qrz45\" (UID: \"88b1cb62-7157-467a-8a3f-742e959c5a3a\") " pod="openshift-network-operator/iptables-alerter-qrz45"
Jul 20 04:59:06.817303 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:06.817286    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 04:59:06.817355 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.817298    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1d1f768-3baf-41e6-afbc-15c2b7856475-dbus\") pod \"global-pull-secret-syncer-rq2k2\" (UID: \"d1d1f768-3baf-41e6-afbc-15c2b7856475\") " pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:06.817402 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:06.817384    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret podName:d1d1f768-3baf-41e6-afbc-15c2b7856475 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:07.31736022 +0000 UTC m=+3.132854271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret") pod "global-pull-secret-syncer-rq2k2" (UID: "d1d1f768-3baf-41e6-afbc-15c2b7856475") : object "kube-system"/"original-pull-secret" not registered
Jul 20 04:59:06.817749 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.817723    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7aeacaeb-c51d-4a2c-962a-cc69281308f9-serviceca\") pod \"node-ca-qqt42\" (UID: \"7aeacaeb-c51d-4a2c-962a-cc69281308f9\") " pod="openshift-image-registry/node-ca-qqt42"
Jul 20 04:59:06.817815 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.817730    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7aeacaeb-c51d-4a2c-962a-cc69281308f9-host\") pod \"node-ca-qqt42\" (UID: \"7aeacaeb-c51d-4a2c-962a-cc69281308f9\") " pod="openshift-image-registry/node-ca-qqt42"
Jul 20 04:59:06.817875 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.817817    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1d1f768-3baf-41e6-afbc-15c2b7856475-kubelet-config\") pod \"global-pull-secret-syncer-rq2k2\" (UID: \"d1d1f768-3baf-41e6-afbc-15c2b7856475\") " pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:06.818116 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:06.818092    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 04:59:06.818233 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:06.818157    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs podName:00052a42-6eff-4102-b46e-67ee21d241f0 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:07.318139175 +0000 UTC m=+3.133633233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs") pod "network-metrics-daemon-wcqzq" (UID: "00052a42-6eff-4102-b46e-67ee21d241f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 04:59:06.818317 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.818244    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e97dc9be-002f-49cc-9308-66d2d9119e64-konnectivity-ca\") pod \"konnectivity-agent-9kxcb\" (UID: \"e97dc9be-002f-49cc-9308-66d2d9119e64\") " pod="kube-system/konnectivity-agent-9kxcb"
Jul 20 04:59:06.819839 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.819817    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e97dc9be-002f-49cc-9308-66d2d9119e64-agent-certs\") pod \"konnectivity-agent-9kxcb\" (UID: \"e97dc9be-002f-49cc-9308-66d2d9119e64\") " pod="kube-system/konnectivity-agent-9kxcb"
Jul 20 04:59:06.825966 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:06.825892    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 04:59:06.825966 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:06.825942    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 04:59:06.825966 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:06.825959    2576 projected.go:196] Error preparing data for projected volume kube-api-access-855ps for pod openshift-network-diagnostics/network-check-target-842kd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 04:59:06.826128 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:06.826024    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps podName:f6861683-6a87-42a1-9f74-e1722936d58a nodeName:}" failed. No retries permitted until 2026-07-20 04:59:07.326006814 +0000 UTC m=+3.141500870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-855ps" (UniqueName: "kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps") pod "network-check-target-842kd" (UID: "f6861683-6a87-42a1-9f74-e1722936d58a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 04:59:06.829672 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.829647    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcx78\" (UniqueName: \"kubernetes.io/projected/88b1cb62-7157-467a-8a3f-742e959c5a3a-kube-api-access-tcx78\") pod \"iptables-alerter-qrz45\" (UID: \"88b1cb62-7157-467a-8a3f-742e959c5a3a\") " pod="openshift-network-operator/iptables-alerter-qrz45"
Jul 20 04:59:06.831292 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.830736    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgqs7\" (UniqueName: \"kubernetes.io/projected/7aeacaeb-c51d-4a2c-962a-cc69281308f9-kube-api-access-sgqs7\") pod \"node-ca-qqt42\" (UID: \"7aeacaeb-c51d-4a2c-962a-cc69281308f9\") " pod="openshift-image-registry/node-ca-qqt42"
Jul 20 04:59:06.831292 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.831251    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4r9x\" (UniqueName: \"kubernetes.io/projected/00052a42-6eff-4102-b46e-67ee21d241f0-kube-api-access-j4r9x\") pod \"network-metrics-daemon-wcqzq\" (UID: \"00052a42-6eff-4102-b46e-67ee21d241f0\") " pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:06.848883 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.848864    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 04:59:06.913303 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.913260    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7q97q"
Jul 20 04:59:06.923817 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.923795    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qvzvv"
Jul 20 04:59:06.934843 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.934821    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nrrn9"
Jul 20 04:59:06.942165 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.941976    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:06.951041 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.951023    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb"
Jul 20 04:59:06.961002 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.960982    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sdlmg"
Jul 20 04:59:06.969020 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.969004    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qqt42"
Jul 20 04:59:06.976585 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.976562    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qrz45"
Jul 20 04:59:06.984413 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:06.984396    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9kxcb"
Jul 20 04:59:07.321860 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:07.321773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret\") pod \"global-pull-secret-syncer-rq2k2\" (UID: \"d1d1f768-3baf-41e6-afbc-15c2b7856475\") " pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:07.321860 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:07.321829    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs\") pod \"network-metrics-daemon-wcqzq\" (UID: \"00052a42-6eff-4102-b46e-67ee21d241f0\") " pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:07.322092 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:07.321970    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 04:59:07.322092 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:07.322044    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret podName:d1d1f768-3baf-41e6-afbc-15c2b7856475 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:08.322025746 +0000 UTC m=+4.137519798 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret") pod "global-pull-secret-syncer-rq2k2" (UID: "d1d1f768-3baf-41e6-afbc-15c2b7856475") : object "kube-system"/"original-pull-secret" not registered
Jul 20 04:59:07.322092 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:07.322075    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 04:59:07.322275 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:07.322138    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs podName:00052a42-6eff-4102-b46e-67ee21d241f0 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:08.322122083 +0000 UTC m=+4.137616136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs") pod "network-metrics-daemon-wcqzq" (UID: "00052a42-6eff-4102-b46e-67ee21d241f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 04:59:07.422436 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:07.422400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-855ps\" (UniqueName: \"kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps\") pod \"network-check-target-842kd\" (UID: \"f6861683-6a87-42a1-9f74-e1722936d58a\") " pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:07.422591 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:07.422572    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 04:59:07.422631 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:07.422600    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 04:59:07.422631 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:07.422611    2576 projected.go:196] Error preparing data for projected volume kube-api-access-855ps for pod openshift-network-diagnostics/network-check-target-842kd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 04:59:07.422704 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:07.422665    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps podName:f6861683-6a87-42a1-9f74-e1722936d58a nodeName:}" failed. No retries permitted until 2026-07-20 04:59:08.422648719 +0000 UTC m=+4.238142771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-855ps" (UniqueName: "kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps") pod "network-check-target-842kd" (UID: "f6861683-6a87-42a1-9f74-e1722936d58a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 04:59:07.646359 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:07.646240    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 04:54:06 +0000 UTC" deadline="2028-01-18 20:30:09.848739456 +0000 UTC"
Jul 20 04:59:07.646359 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:07.646299    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13143h31m2.202444509s"
Jul 20 04:59:07.963374 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:07.963345    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97dc9be_002f_49cc_9308_66d2d9119e64.slice/crio-1984d69c5d05f11f777b33f53586635e70319d38c61c815583dbd993406f73a9 WatchSource:0}: Error finding container 1984d69c5d05f11f777b33f53586635e70319d38c61c815583dbd993406f73a9: Status 404 returned error can't find the container with id 1984d69c5d05f11f777b33f53586635e70319d38c61c815583dbd993406f73a9
Jul 20 04:59:07.990377 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:07.990345    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ad5e720_6cda_450f_966e_63560e8edbfe.slice/crio-1a9c1a924f983ee8327e283675205c575d8bf810d0913e699357c4d26b1dc9c5 WatchSource:0}: Error finding container 1a9c1a924f983ee8327e283675205c575d8bf810d0913e699357c4d26b1dc9c5: Status 404 returned error can't find the container with id 1a9c1a924f983ee8327e283675205c575d8bf810d0913e699357c4d26b1dc9c5
Jul 20 04:59:07.991223 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:07.991199    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b1cb62_7157_467a_8a3f_742e959c5a3a.slice/crio-45ee25591c8ffdd5a7b1f56a2880099b29d95725ca2b04d95474b4e0e35324c0 WatchSource:0}: Error finding container 45ee25591c8ffdd5a7b1f56a2880099b29d95725ca2b04d95474b4e0e35324c0: Status 404 returned error can't find the container with id 45ee25591c8ffdd5a7b1f56a2880099b29d95725ca2b04d95474b4e0e35324c0
Jul 20 04:59:07.992234 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:07.992098    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a2fefc_0ae8_45b5_893b_6d60a8dbe178.slice/crio-e40d8e6e0e47b49a36ed141eb242e1026287712c443bba5403bb622e6335fa02 WatchSource:0}: Error finding container e40d8e6e0e47b49a36ed141eb242e1026287712c443bba5403bb622e6335fa02: Status 404 returned error can't find the container with id e40d8e6e0e47b49a36ed141eb242e1026287712c443bba5403bb622e6335fa02
Jul 20 04:59:07.999926 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:07.999892    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a6a6ed_8042_481f_827e_f686f89c6094.slice/crio-6946439392b3ff4c425be6faadd4383de3e6303175ca40e2af7366e45c66a666 WatchSource:0}: Error finding container 6946439392b3ff4c425be6faadd4383de3e6303175ca40e2af7366e45c66a666: Status 404 returned error can't find the container with id 6946439392b3ff4c425be6faadd4383de3e6303175ca40e2af7366e45c66a666
Jul 20 04:59:08.329207 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.329168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs\") pod \"network-metrics-daemon-wcqzq\" (UID: \"00052a42-6eff-4102-b46e-67ee21d241f0\") " pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:08.329339 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.329237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret\") pod \"global-pull-secret-syncer-rq2k2\" (UID: \"d1d1f768-3baf-41e6-afbc-15c2b7856475\") " pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:08.329381 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:08.329340    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 04:59:08.329381 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:08.329347    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 04:59:08.329443 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:08.329408    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs podName:00052a42-6eff-4102-b46e-67ee21d241f0 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:10.329391774 +0000 UTC m=+6.144885826 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs") pod "network-metrics-daemon-wcqzq" (UID: "00052a42-6eff-4102-b46e-67ee21d241f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 04:59:08.329443 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:08.329422    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret podName:d1d1f768-3baf-41e6-afbc-15c2b7856475 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:10.329415643 +0000 UTC m=+6.144909695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret") pod "global-pull-secret-syncer-rq2k2" (UID: "d1d1f768-3baf-41e6-afbc-15c2b7856475") : object "kube-system"/"original-pull-secret" not registered
Jul 20 04:59:08.429648 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.429612    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-855ps\" (UniqueName: \"kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps\") pod \"network-check-target-842kd\" (UID: \"f6861683-6a87-42a1-9f74-e1722936d58a\") " pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:08.429814 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:08.429783    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 04:59:08.429814 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:08.429806    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 04:59:08.429814 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:08.429816    2576 projected.go:196] Error preparing data for projected volume kube-api-access-855ps for pod openshift-network-diagnostics/network-check-target-842kd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 04:59:08.429930 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:08.429913    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps podName:f6861683-6a87-42a1-9f74-e1722936d58a nodeName:}" failed. No retries permitted until 2026-07-20 04:59:10.429877331 +0000 UTC m=+6.245371382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-855ps" (UniqueName: "kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps") pod "network-check-target-842kd" (UID: "f6861683-6a87-42a1-9f74-e1722936d58a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 04:59:08.677180 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.677108    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:08.677759 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:08.677252    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:08.677759 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.677680    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:08.677882 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:08.677793    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:08.677977 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.677959    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:08.678112 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:08.678091    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:08.690250 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.690219    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb" event={"ID":"d50b6621-23c7-4762-82e2-0d723970866a","Type":"ContainerStarted","Data":"cb64cd1c9ad0aa108dd92a9fab435fe46908ffa830f01a0277d3340e0d04b338"}
Jul 20 04:59:08.693866 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.693844    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvzvv" event={"ID":"37a2fefc-0ae8-45b5-893b-6d60a8dbe178","Type":"ContainerStarted","Data":"e40d8e6e0e47b49a36ed141eb242e1026287712c443bba5403bb622e6335fa02"}
Jul 20 04:59:08.696597 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.696574    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qrz45" event={"ID":"88b1cb62-7157-467a-8a3f-742e959c5a3a","Type":"ContainerStarted","Data":"45ee25591c8ffdd5a7b1f56a2880099b29d95725ca2b04d95474b4e0e35324c0"}
Jul 20 04:59:08.698773 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.698718    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nrrn9" event={"ID":"9ad5e720-6cda-450f-966e-63560e8edbfe","Type":"ContainerStarted","Data":"1a9c1a924f983ee8327e283675205c575d8bf810d0913e699357c4d26b1dc9c5"}
Jul 20 04:59:08.705473 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.704638    2576 generic.go:356] "Generic (PLEG): container finished" podID="375bab45795bfb097938a9d45503a9ae" containerID="64b64fb43e66e5f6325e9fba174478fa921d72a63ebb28fd204f1c9b8bc65e84" exitCode=0
Jul 20 04:59:08.705473 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.704715    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal" event={"ID":"375bab45795bfb097938a9d45503a9ae","Type":"ContainerDied","Data":"64b64fb43e66e5f6325e9fba174478fa921d72a63ebb28fd204f1c9b8bc65e84"}
Jul 20 04:59:08.710146 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.709609    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-196.ec2.internal" event={"ID":"fa8803663572406e0c5539a65925db49","Type":"ContainerStarted","Data":"98c4c22c24ab814533abf4b0d6552ed34c579fcdab8250c4b0242036777d803f"}
Jul 20 04:59:08.715875 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.715397    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sdlmg" event={"ID":"f0af4aff-f764-4b26-bb61-f9afc814fc08","Type":"ContainerStarted","Data":"2502e9b21e373fa60e58f23a7fb92ed12b6b1ac93b19c58501065e4b903e7634"}
Jul 20 04:59:08.718009 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.717842    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q" event={"ID":"71a6a6ed-8042-481f-827e-f686f89c6094","Type":"ContainerStarted","Data":"6946439392b3ff4c425be6faadd4383de3e6303175ca40e2af7366e45c66a666"}
Jul 20 04:59:08.719991 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.719924    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9kxcb" event={"ID":"e97dc9be-002f-49cc-9308-66d2d9119e64","Type":"ContainerStarted","Data":"1984d69c5d05f11f777b33f53586635e70319d38c61c815583dbd993406f73a9"}
Jul 20 04:59:08.721215 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.721189    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7q97q" event={"ID":"e5c87251-66a3-49c9-ae5f-8ed4e6ac4075","Type":"ContainerStarted","Data":"c26e47a1ed6a3c82e56906ee2780c76d7b0410e2952f14790316e67965b3b459"}
Jul 20 04:59:08.724726 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:08.724702    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qqt42" event={"ID":"7aeacaeb-c51d-4a2c-962a-cc69281308f9","Type":"ContainerStarted","Data":"62db625b97a94bbf21e103f360c63d106d6e11eee248a7fc80bf8a8610ab9fd3"}
Jul 20 04:59:09.750020 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:09.749981    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal" event={"ID":"375bab45795bfb097938a9d45503a9ae","Type":"ContainerStarted","Data":"c24e7e531f52241fd4c59cdda0c7d8e181c4bb522b03ce218f1895bb633078d2"}
Jul 20 04:59:09.765505 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:09.765443    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-196.ec2.internal" podStartSLOduration=3.7654156370000003 podStartE2EDuration="3.765415637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:59:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:59:08.738138761 +0000 UTC m=+4.553632838" watchObservedRunningTime="2026-07-20 04:59:09.765415637 +0000 UTC m=+5.580909714"
Jul 20 04:59:10.355978 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:10.355894    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs\") pod \"network-metrics-daemon-wcqzq\" (UID: \"00052a42-6eff-4102-b46e-67ee21d241f0\") " pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:10.356160 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:10.356018    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret\") pod \"global-pull-secret-syncer-rq2k2\" (UID: \"d1d1f768-3baf-41e6-afbc-15c2b7856475\") " pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:10.356248 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:10.356163    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 04:59:10.356248 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:10.356231    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret podName:d1d1f768-3baf-41e6-afbc-15c2b7856475 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:14.356209578 +0000 UTC m=+10.171703650 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret") pod "global-pull-secret-syncer-rq2k2" (UID: "d1d1f768-3baf-41e6-afbc-15c2b7856475") : object "kube-system"/"original-pull-secret" not registered
Jul 20 04:59:10.356790 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:10.356768    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 04:59:10.356882 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:10.356830    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs podName:00052a42-6eff-4102-b46e-67ee21d241f0 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:14.356813343 +0000 UTC m=+10.172307397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs") pod "network-metrics-daemon-wcqzq" (UID: "00052a42-6eff-4102-b46e-67ee21d241f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 04:59:10.456904 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:10.456848    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-855ps\" (UniqueName: \"kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps\") pod \"network-check-target-842kd\" (UID: \"f6861683-6a87-42a1-9f74-e1722936d58a\") " pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:10.457108 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:10.457081    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 04:59:10.457108 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:10.457103    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 04:59:10.457225 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:10.457117    2576 projected.go:196] Error preparing data for projected volume kube-api-access-855ps for pod openshift-network-diagnostics/network-check-target-842kd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 04:59:10.457225 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:10.457182    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps podName:f6861683-6a87-42a1-9f74-e1722936d58a nodeName:}" failed. No retries permitted until 2026-07-20 04:59:14.457161295 +0000 UTC m=+10.272655368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-855ps" (UniqueName: "kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps") pod "network-check-target-842kd" (UID: "f6861683-6a87-42a1-9f74-e1722936d58a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 04:59:10.677162 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:10.677079    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:10.677332 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:10.677225    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:10.677332 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:10.677308    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:10.677446 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:10.677419    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:10.677500 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:10.677079    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:10.677570 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:10.677532    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:12.677210 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:12.677180    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:12.677692 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:12.677284    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:12.677692 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:12.677359    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:12.677692 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:12.677421    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:12.677692 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:12.677475    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:12.677692 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:12.677535    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:14.393744 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:14.393011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret\") pod \"global-pull-secret-syncer-rq2k2\" (UID: \"d1d1f768-3baf-41e6-afbc-15c2b7856475\") " pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:14.393744 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:14.393085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs\") pod \"network-metrics-daemon-wcqzq\" (UID: \"00052a42-6eff-4102-b46e-67ee21d241f0\") " pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:14.393744 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:14.393221    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 04:59:14.393744 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:14.393287    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs podName:00052a42-6eff-4102-b46e-67ee21d241f0 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:22.393265617 +0000 UTC m=+18.208759671 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs") pod "network-metrics-daemon-wcqzq" (UID: "00052a42-6eff-4102-b46e-67ee21d241f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 04:59:14.393744 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:14.393653    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 04:59:14.393744 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:14.393704    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret podName:d1d1f768-3baf-41e6-afbc-15c2b7856475 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:22.393687096 +0000 UTC m=+18.209181189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret") pod "global-pull-secret-syncer-rq2k2" (UID: "d1d1f768-3baf-41e6-afbc-15c2b7856475") : object "kube-system"/"original-pull-secret" not registered
Jul 20 04:59:14.494284 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:14.493947    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-855ps\" (UniqueName: \"kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps\") pod \"network-check-target-842kd\" (UID: \"f6861683-6a87-42a1-9f74-e1722936d58a\") " pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:14.494284 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:14.494124    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 04:59:14.494284 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:14.494147    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 04:59:14.494284 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:14.494161    2576 projected.go:196] Error preparing data for projected volume kube-api-access-855ps for pod openshift-network-diagnostics/network-check-target-842kd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 04:59:14.494284 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:14.494226    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps podName:f6861683-6a87-42a1-9f74-e1722936d58a nodeName:}" failed. No retries permitted until 2026-07-20 04:59:22.494206461 +0000 UTC m=+18.309700517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-855ps" (UniqueName: "kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps") pod "network-check-target-842kd" (UID: "f6861683-6a87-42a1-9f74-e1722936d58a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 04:59:14.675977 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:14.675898    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:14.676120 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:14.676043    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:14.676198 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:14.676137    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:14.677078 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:14.676248    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:14.677078 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:14.676264    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:14.677078 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:14.676340    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:16.675826 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:16.675788    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:16.676356 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:16.675952    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:16.676356 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:16.675949    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:16.676356 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:16.676057    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:16.676356 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:16.675788    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:16.676356 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:16.676161    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:18.677272 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:18.677243    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:18.677272 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:18.677253    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:18.677652 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:18.677253    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:18.677652 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:18.677340    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:18.677652 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:18.677407    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:18.677652 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:18.677490    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:20.678102 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:20.678071    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:20.678530 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:20.678114    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:20.678530 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:20.678183    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:20.678530 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:20.678205    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:20.678530 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:20.678255    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:20.678530 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:20.678353    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:22.459295 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:22.459257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs\") pod \"network-metrics-daemon-wcqzq\" (UID: \"00052a42-6eff-4102-b46e-67ee21d241f0\") " pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:22.459849 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:22.459335    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret\") pod \"global-pull-secret-syncer-rq2k2\" (UID: \"d1d1f768-3baf-41e6-afbc-15c2b7856475\") " pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:22.459849 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:22.459408    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 04:59:22.459849 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:22.459450    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 04:59:22.459849 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:22.459480    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs podName:00052a42-6eff-4102-b46e-67ee21d241f0 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:38.459459783 +0000 UTC m=+34.274953837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs") pod "network-metrics-daemon-wcqzq" (UID: "00052a42-6eff-4102-b46e-67ee21d241f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 04:59:22.459849 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:22.459503    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret podName:d1d1f768-3baf-41e6-afbc-15c2b7856475 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:38.459486453 +0000 UTC m=+34.274980506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret") pod "global-pull-secret-syncer-rq2k2" (UID: "d1d1f768-3baf-41e6-afbc-15c2b7856475") : object "kube-system"/"original-pull-secret" not registered
Jul 20 04:59:22.560163 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:22.560118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-855ps\" (UniqueName: \"kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps\") pod \"network-check-target-842kd\" (UID: \"f6861683-6a87-42a1-9f74-e1722936d58a\") " pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:22.560348 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:22.560283    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 04:59:22.560348 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:22.560310    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 04:59:22.560348 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:22.560322    2576 projected.go:196] Error preparing data for projected volume kube-api-access-855ps for pod openshift-network-diagnostics/network-check-target-842kd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 04:59:22.560506 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:22.560379    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps podName:f6861683-6a87-42a1-9f74-e1722936d58a nodeName:}" failed. No retries permitted until 2026-07-20 04:59:38.56036021 +0000 UTC m=+34.375854271 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-855ps" (UniqueName: "kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps") pod "network-check-target-842kd" (UID: "f6861683-6a87-42a1-9f74-e1722936d58a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 04:59:22.675264 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:22.675230    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:22.675435 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:22.675237    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:22.675435 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:22.675366    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:22.675435 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:22.675236    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:22.675636 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:22.675436    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:22.675636 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:22.675497    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:24.677693 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:24.677661    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:24.678205 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:24.677706    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:24.678205 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:24.677680    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:24.678205 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:24.677791    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:24.678205 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:24.677902    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:24.678205 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:24.677983    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:26.674447 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:26.674418    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:26.674915 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:26.674540    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:26.674915 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:26.674558    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:26.674915 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:26.674671    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:26.675076 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:26.675042    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:26.675151 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:26.675132    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:28.675348 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.674999    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:28.676208 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.675013    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:28.676208 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:28.675415    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:28.676208 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.675121    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:28.676208 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:28.675488    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:28.676208 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:28.675554    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:28.794653 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.794431    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nrrn9" event={"ID":"9ad5e720-6cda-450f-966e-63560e8edbfe","Type":"ContainerStarted","Data":"def9ef411f9ef99cf2ce15f1753e9bd68f899bd4ee0432ac3d23d9dc73441240"}
Jul 20 04:59:28.797143 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.796126    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sdlmg" event={"ID":"f0af4aff-f764-4b26-bb61-f9afc814fc08","Type":"ContainerStarted","Data":"7f60ca0d123f93edbff90132c3a764ae370f5bb18937bdf850fffceff47c2ce4"}
Jul 20 04:59:28.799735 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.799712    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q" event={"ID":"71a6a6ed-8042-481f-827e-f686f89c6094","Type":"ContainerStarted","Data":"98ce45b8dad43992783b5cf8c80f6623a16492a22ffb50da63eb550149a5808f"}
Jul 20 04:59:28.799837 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.799790    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q" event={"ID":"71a6a6ed-8042-481f-827e-f686f89c6094","Type":"ContainerStarted","Data":"92e84fbec2fadfdc8bbec64f2fcce17ebcefeccd6024f209fd242167bb5ee0a8"}
Jul 20 04:59:28.799921 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.799839    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q" event={"ID":"71a6a6ed-8042-481f-827e-f686f89c6094","Type":"ContainerStarted","Data":"4a0604f446c1999aa385a0a75177120ae3e082cf8c575c20c12c277382ee4de1"}
Jul 20 04:59:28.799921 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.799899    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q" event={"ID":"71a6a6ed-8042-481f-827e-f686f89c6094","Type":"ContainerStarted","Data":"dd1e7c3223b2faca6f914cdd2140f83cb0fd50899d873dabbdef5a157e6c3d5d"}
Jul 20 04:59:28.800026 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.799931    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q" event={"ID":"71a6a6ed-8042-481f-827e-f686f89c6094","Type":"ContainerStarted","Data":"5ac7e4e4abe84302f3d015272a7ec66f6ba7baae55927364ff915951afcf9576"}
Jul 20 04:59:28.800026 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.799957    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q" event={"ID":"71a6a6ed-8042-481f-827e-f686f89c6094","Type":"ContainerStarted","Data":"c25da1bb5acd6d037756d766e2d9c6f7c32c6e15f9c787072e0019ea153cca32"}
Jul 20 04:59:28.801697 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.801675    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9kxcb" event={"ID":"e97dc9be-002f-49cc-9308-66d2d9119e64","Type":"ContainerStarted","Data":"6b607de4139fb2ac6c254118137f4f9a1cd2c6223523fe43892a77dfc54f1f97"}
Jul 20 04:59:28.803437 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.803398    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7q97q" event={"ID":"e5c87251-66a3-49c9-ae5f-8ed4e6ac4075","Type":"ContainerStarted","Data":"cb5d08a1f7051f6f60e1c78617dc1129ad942163d91749d1acda2a8d939b5a54"}
Jul 20 04:59:28.804857 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.804834    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qqt42" event={"ID":"7aeacaeb-c51d-4a2c-962a-cc69281308f9","Type":"ContainerStarted","Data":"8d96f8ad880d75ad08cfd71f832a3a829e3484b0717c0a882fc3393f6403eb6d"}
Jul 20 04:59:28.806505 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.806488    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb" event={"ID":"d50b6621-23c7-4762-82e2-0d723970866a","Type":"ContainerStarted","Data":"395e9f68c5b2c468c09a7a6606ecb3e76b7c300583cf89d98afbf5604ac6017f"}
Jul 20 04:59:28.808335 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.808263    2576 generic.go:356] "Generic (PLEG): container finished" podID="37a2fefc-0ae8-45b5-893b-6d60a8dbe178" containerID="07df39d59551e135941d8f08cf4855155398de987c03e1505d4c41654dd343c0" exitCode=0
Jul 20 04:59:28.808335 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.808300    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvzvv" event={"ID":"37a2fefc-0ae8-45b5-893b-6d60a8dbe178","Type":"ContainerDied","Data":"07df39d59551e135941d8f08cf4855155398de987c03e1505d4c41654dd343c0"}
Jul 20 04:59:28.812371 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.812329    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-196.ec2.internal" podStartSLOduration=22.812314186000002 podStartE2EDuration="22.812314186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:59:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:59:09.766537154 +0000 UTC m=+5.582031231" watchObservedRunningTime="2026-07-20 04:59:28.812314186 +0000 UTC m=+24.627808261"
Jul 20 04:59:28.812578 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.812547    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nrrn9" podStartSLOduration=3.946935053 podStartE2EDuration="23.812540988s" totalImagesPullingTime="19.865605935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:59:28.81212865 +0000 UTC m=+24.627622721" watchObservedRunningTime="2026-07-20 04:59:28.812540988 +0000 UTC m=+24.628035063"
Jul 20 04:59:28.825361 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.825321    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9kxcb" podStartSLOduration=3.032728048 podStartE2EDuration="22.825304844s" totalImagesPullingTime="19.792576796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:59:28.825259156 +0000 UTC m=+24.640753228" watchObservedRunningTime="2026-07-20 04:59:28.825304844 +0000 UTC m=+24.640798917"
Jul 20 04:59:28.840433 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.840399    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sdlmg" podStartSLOduration=4.046110481 podStartE2EDuration="23.84038903s" totalImagesPullingTime="19.794278549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:59:28.840034118 +0000 UTC m=+24.655528191" watchObservedRunningTime="2026-07-20 04:59:28.84038903 +0000 UTC m=+24.655883101"
Jul 20 04:59:28.853072 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.853043    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qqt42" podStartSLOduration=4.067635907 podStartE2EDuration="23.853032156s" totalImagesPullingTime="19.785396249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:59:28.852568998 +0000 UTC m=+24.668063069" watchObservedRunningTime="2026-07-20 04:59:28.853032156 +0000 UTC m=+24.668526229"
Jul 20 04:59:28.874859 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:28.874825    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7q97q" podStartSLOduration=4.088307558 podStartE2EDuration="23.874814923s" totalImagesPullingTime="19.786507365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:59:28.874794117 +0000 UTC m=+24.690288188" watchObservedRunningTime="2026-07-20 04:59:28.874814923 +0000 UTC m=+24.690308996"
Jul 20 04:59:29.502337 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:29.502316    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 04:59:29.665111 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:29.664961    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T04:59:29.502333117Z","UUID":"59f60193-3853-4590-866a-a3e51f8b63be","Handler":null,"Name":"","Endpoint":""}
Jul 20 04:59:29.666683 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:29.666655    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 04:59:29.666806 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:29.666720    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 04:59:29.812832 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:29.812719    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb" event={"ID":"d50b6621-23c7-4762-82e2-0d723970866a","Type":"ContainerStarted","Data":"f93a44286a18f6e666b8f86cab234c1ce49d156d8d7b1f99ebee87f50ada2c01"}
Jul 20 04:59:29.815059 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:29.815030    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qrz45" event={"ID":"88b1cb62-7157-467a-8a3f-742e959c5a3a","Type":"ContainerStarted","Data":"b0cf0961ea04da890ea90d08ac6d4cddf73114b11006724d49cdd3dbddfd91c0"}
Jul 20 04:59:29.829193 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:29.829154    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qrz45" podStartSLOduration=5.027657878 podStartE2EDuration="24.829140228s" totalImagesPullingTime="19.80148235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:59:29.828536928 +0000 UTC m=+25.644031001" watchObservedRunningTime="2026-07-20 04:59:29.829140228 +0000 UTC m=+25.644634299"
Jul 20 04:59:30.674672 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:30.674575    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:30.674672 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:30.674619    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:30.674672 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:30.674575    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:30.674895 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:30.674720    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:30.674895 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:30.674788    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:30.674895 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:30.674859    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:30.819699 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:30.819667    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q" event={"ID":"71a6a6ed-8042-481f-827e-f686f89c6094","Type":"ContainerStarted","Data":"b444f3e8ccb20e9a83fdd87b6ab8a858119aff9c7dad8752c728a266ad7fb05c"}
Jul 20 04:59:31.824980 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:31.824945    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb" event={"ID":"d50b6621-23c7-4762-82e2-0d723970866a","Type":"ContainerStarted","Data":"5ee7d193f0de3d29e2094e718077f0c7f7baa9f88b2ca129b75293e6e884d36a"}
Jul 20 04:59:31.846262 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:31.846207    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-crdlb" podStartSLOduration=4.246159773 podStartE2EDuration="26.84619232s" totalImagesPullingTime="22.600032547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:59:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:59:31.845724833 +0000 UTC m=+27.661218910" watchObservedRunningTime="2026-07-20 04:59:31.84619232 +0000 UTC m=+27.661686391"
Jul 20 04:59:32.674925 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:32.674892    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:32.674925 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:32.674925    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:32.675134 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:32.674896    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:32.675134 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:32.675003    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:32.675134 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:32.675097    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:32.675273 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:32.675202    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:33.785483 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:33.785291    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9kxcb"
Jul 20 04:59:33.786076 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:33.785820    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9kxcb"
Jul 20 04:59:34.675531 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:34.675505    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:34.675682 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:34.675594    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:34.675682 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:34.675621    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:34.675794 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:34.675597    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:34.675794 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:34.675694    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:34.675909 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:34.675806    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:34.834559 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:34.834368    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q" event={"ID":"71a6a6ed-8042-481f-827e-f686f89c6094","Type":"ContainerStarted","Data":"e89ead718793bdd9e41dd9f5381fe81b9fc409f67c855e049e34dd5f63671494"}
Jul 20 04:59:34.835159 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:34.834620    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:34.835159 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:34.834670    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:34.849492 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:34.849470    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:34.861607 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:34.861553    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q" podStartSLOduration=10.010695732 podStartE2EDuration="29.861540478s" totalImagesPullingTime="19.850844746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:59:34.860926451 +0000 UTC m=+30.676420526" watchObservedRunningTime="2026-07-20 04:59:34.861540478 +0000 UTC m=+30.677034599"
Jul 20 04:59:35.200016 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:35.199984    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9kxcb"
Jul 20 04:59:35.200205 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:35.200116    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 04:59:35.200553 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:35.200535    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9kxcb"
Jul 20 04:59:35.837789 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:35.837757    2576 generic.go:356] "Generic (PLEG): container finished" podID="37a2fefc-0ae8-45b5-893b-6d60a8dbe178" containerID="9a6328dbc800dc046ef5202e8bbda5b95f6224a7a64c5a2c687f9e8521dd85c7" exitCode=0
Jul 20 04:59:35.838241 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:35.837849    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvzvv" event={"ID":"37a2fefc-0ae8-45b5-893b-6d60a8dbe178","Type":"ContainerDied","Data":"9a6328dbc800dc046ef5202e8bbda5b95f6224a7a64c5a2c687f9e8521dd85c7"}
Jul 20 04:59:35.838989 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:35.838546    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:35.853004 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:35.852987    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 04:59:36.475106 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:36.475077    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rq2k2"]
Jul 20 04:59:36.475260 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:36.475231    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:36.475354 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:36.475326    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:36.479532 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:36.479506    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wcqzq"]
Jul 20 04:59:36.479809 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:36.479792    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:36.480093 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:36.480051    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:36.480309 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:36.480284    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-842kd"]
Jul 20 04:59:36.480399 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:36.480385    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:36.480480 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:36.480462    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:37.674546 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:37.674518    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:37.674933 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:37.674619    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 04:59:37.844166 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:37.844132    2576 generic.go:356] "Generic (PLEG): container finished" podID="37a2fefc-0ae8-45b5-893b-6d60a8dbe178" containerID="9b883234e838be8c9ae405d4fbc03aad42ef6ab6cec044cf5ca28434c5930c5e" exitCode=0
Jul 20 04:59:37.844322 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:37.844212    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvzvv" event={"ID":"37a2fefc-0ae8-45b5-893b-6d60a8dbe178","Type":"ContainerDied","Data":"9b883234e838be8c9ae405d4fbc03aad42ef6ab6cec044cf5ca28434c5930c5e"}
Jul 20 04:59:38.472850 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:38.472676    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs\") pod \"network-metrics-daemon-wcqzq\" (UID: \"00052a42-6eff-4102-b46e-67ee21d241f0\") " pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:38.473012 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:38.472893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret\") pod \"global-pull-secret-syncer-rq2k2\" (UID: \"d1d1f768-3baf-41e6-afbc-15c2b7856475\") " pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:38.473012 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:38.472817    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 04:59:38.473012 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:38.472965    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs podName:00052a42-6eff-4102-b46e-67ee21d241f0 nodeName:}" failed. No retries permitted until 2026-07-20 05:00:10.472949181 +0000 UTC m=+66.288443231 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs") pod "network-metrics-daemon-wcqzq" (UID: "00052a42-6eff-4102-b46e-67ee21d241f0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 04:59:38.473012 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:38.472992    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 04:59:38.473177 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:38.473033    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret podName:d1d1f768-3baf-41e6-afbc-15c2b7856475 nodeName:}" failed. No retries permitted until 2026-07-20 05:00:10.473021681 +0000 UTC m=+66.288515730 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret") pod "global-pull-secret-syncer-rq2k2" (UID: "d1d1f768-3baf-41e6-afbc-15c2b7856475") : object "kube-system"/"original-pull-secret" not registered
Jul 20 04:59:38.573753 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:38.573680    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-855ps\" (UniqueName: \"kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps\") pod \"network-check-target-842kd\" (UID: \"f6861683-6a87-42a1-9f74-e1722936d58a\") " pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:38.573919 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:38.573842    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 04:59:38.573919 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:38.573865    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 04:59:38.573919 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:38.573894    2576 projected.go:196] Error preparing data for projected volume kube-api-access-855ps for pod openshift-network-diagnostics/network-check-target-842kd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 04:59:38.574085 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:38.573958    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps podName:f6861683-6a87-42a1-9f74-e1722936d58a nodeName:}" failed. No retries permitted until 2026-07-20 05:00:10.573937664 +0000 UTC m=+66.389431736 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-855ps" (UniqueName: "kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps") pod "network-check-target-842kd" (UID: "f6861683-6a87-42a1-9f74-e1722936d58a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 04:59:38.675201 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:38.675169    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:38.675471 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:38.675281    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq2k2" podUID="d1d1f768-3baf-41e6-afbc-15c2b7856475"
Jul 20 04:59:38.675471 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:38.675334    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:38.675471 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:38.675417    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-842kd" podUID="f6861683-6a87-42a1-9f74-e1722936d58a"
Jul 20 04:59:38.848588 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:38.848502    2576 generic.go:356] "Generic (PLEG): container finished" podID="37a2fefc-0ae8-45b5-893b-6d60a8dbe178" containerID="8d13f6da978f7d45ab60915681b8b18151ff91c1e9159a8b6689e958afe6528c" exitCode=0
Jul 20 04:59:38.848588 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:38.848567    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvzvv" event={"ID":"37a2fefc-0ae8-45b5-893b-6d60a8dbe178","Type":"ContainerDied","Data":"8d13f6da978f7d45ab60915681b8b18151ff91c1e9159a8b6689e958afe6528c"}
Jul 20 04:59:39.464675 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.464649    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-196.ec2.internal" event="NodeReady"
Jul 20 04:59:39.464796 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.464789    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 04:59:39.496429 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.496400    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c8bcd566-2mq6z"]
Jul 20 04:59:39.498311 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.498287    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.501007 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.500986    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 04:59:39.501116 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.501080    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vkwrd\""
Jul 20 04:59:39.501296 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.501267    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 04:59:39.501408 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.501347    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 04:59:39.508862 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.508845    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 04:59:39.510987 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.510966    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c8bcd566-2mq6z"]
Jul 20 04:59:39.518391 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.517586    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sq92c"]
Jul 20 04:59:39.519420 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.519401    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"]
Jul 20 04:59:39.519558 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.519511    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sq92c"
Jul 20 04:59:39.521073 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.521053    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 04:59:39.522577 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.522556    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 04:59:39.522922 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.522905    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 04:59:39.523093 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.523075    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 04:59:39.523670 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.523653    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-96pw8\""
Jul 20 04:59:39.523971 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.523945    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 20 04:59:39.524170 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.524158    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 20 04:59:39.525067 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.524754    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bbct5\""
Jul 20 04:59:39.530628 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.530610    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-khcvq"]
Jul 20 04:59:39.532152 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.532134    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:39.535869 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.535847    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jlw9p\""
Jul 20 04:59:39.536010 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.535952    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 04:59:39.536010 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.535978    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 04:59:39.536490 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.536469    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sq92c"]
Jul 20 04:59:39.548377 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.548360    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"]
Jul 20 04:59:39.554978 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.554957    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-khcvq"]
Jul 20 04:59:39.579900 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.579857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-ca-trust-extracted\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.579994 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.579904    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxsc9\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-kube-api-access-vxsc9\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.579994 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.579927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-image-registry-private-configuration\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.579994 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.579964    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-trusted-ca\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.579994 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.579985    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-bound-sa-token\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.580121 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.580089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-certificates\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.580151 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.580121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-installation-pull-secrets\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.580182 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.580153    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.674726 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.674656    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 04:59:39.677277 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.677250    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 04:59:39.677277 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.677274    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z27sm\""
Jul 20 04:59:39.680838 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.680814    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-installation-pull-secrets\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.680976 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.680851    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d085e9fe-4517-4144-90fa-7e3b024db7f5-cert\") pod \"ingress-canary-sq92c\" (UID: \"d085e9fe-4517-4144-90fa-7e3b024db7f5\") " pod="openshift-ingress-canary/ingress-canary-sq92c"
Jul 20 04:59:39.680976 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.680916    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.681084 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.680987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-ca-trust-extracted\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.681084 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.681019    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxsc9\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-kube-api-access-vxsc9\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.681084 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:39.681041    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 04:59:39.681084 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:39.681057    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8bcd566-2mq6z: secret "image-registry-tls" not found
Jul 20 04:59:39.681261 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:39.681108    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls podName:09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:40.18108914 +0000 UTC m=+35.996583199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls") pod "image-registry-7c8bcd566-2mq6z" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46") : secret "image-registry-tls" not found
Jul 20 04:59:39.681261 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.681041    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93ea7d70-7e2b-4be9-bec1-42e998a570a9-tmp-dir\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:39.681448 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.681268    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s77ss\" (UniqueName: \"kubernetes.io/projected/93ea7d70-7e2b-4be9-bec1-42e998a570a9-kube-api-access-s77ss\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:39.681448 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.681349    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-image-registry-private-configuration\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.681448 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.681386    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-ca-trust-extracted\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.681448 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.681389    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-trusted-ca\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.681448 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.681434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-bound-sa-token\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.681693 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.681464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9vf5\" (UniqueName: \"kubernetes.io/projected/d085e9fe-4517-4144-90fa-7e3b024db7f5-kube-api-access-m9vf5\") pod \"ingress-canary-sq92c\" (UID: \"d085e9fe-4517-4144-90fa-7e3b024db7f5\") " pod="openshift-ingress-canary/ingress-canary-sq92c"
Jul 20 04:59:39.681693 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.681498    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bab9155b-7f0f-49b7-bd95-bce008c0f322-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-nddcd\" (UID: \"bab9155b-7f0f-49b7-bd95-bce008c0f322\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 04:59:39.681693 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.681523    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nddcd\" (UID: \"bab9155b-7f0f-49b7-bd95-bce008c0f322\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 04:59:39.681693 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.681589    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-certificates\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.681693 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.681626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/93ea7d70-7e2b-4be9-bec1-42e998a570a9-config-volume\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:39.681693 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.681649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:39.682632 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.682227    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-certificates\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.682632 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.682387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-trusted-ca\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.686612 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.686398    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-installation-pull-secrets\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.686612 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.686523    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-image-registry-private-configuration\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.694735 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.694583    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kxcb_e97dc9be-002f-49cc-9308-66d2d9119e64/konnectivity-agent/0.log" limit=1024
Jul 20 04:59:39.694934 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.694908    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-bound-sa-token\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.695325 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.695301    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxsc9\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-kube-api-access-vxsc9\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:39.775010 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.774970    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9kxcb_e97dc9be-002f-49cc-9308-66d2d9119e64/konnectivity-agent/0.log" limit=1024
Jul 20 04:59:39.782768 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.782744    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d085e9fe-4517-4144-90fa-7e3b024db7f5-cert\") pod \"ingress-canary-sq92c\" (UID: \"d085e9fe-4517-4144-90fa-7e3b024db7f5\") " pod="openshift-ingress-canary/ingress-canary-sq92c"
Jul 20 04:59:39.782906 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.782838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93ea7d70-7e2b-4be9-bec1-42e998a570a9-tmp-dir\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:39.782906 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.782863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s77ss\" (UniqueName: \"kubernetes.io/projected/93ea7d70-7e2b-4be9-bec1-42e998a570a9-kube-api-access-s77ss\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:39.783029 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.782916    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9vf5\" (UniqueName: \"kubernetes.io/projected/d085e9fe-4517-4144-90fa-7e3b024db7f5-kube-api-access-m9vf5\") pod \"ingress-canary-sq92c\" (UID: \"d085e9fe-4517-4144-90fa-7e3b024db7f5\") " pod="openshift-ingress-canary/ingress-canary-sq92c"
Jul 20 04:59:39.783127 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.783103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bab9155b-7f0f-49b7-bd95-bce008c0f322-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-nddcd\" (UID: \"bab9155b-7f0f-49b7-bd95-bce008c0f322\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 04:59:39.783197 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.783150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nddcd\" (UID: \"bab9155b-7f0f-49b7-bd95-bce008c0f322\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 04:59:39.783299 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:39.783284    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 04:59:39.783368 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.783313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/93ea7d70-7e2b-4be9-bec1-42e998a570a9-config-volume\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:39.783368 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.783288    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93ea7d70-7e2b-4be9-bec1-42e998a570a9-tmp-dir\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:39.783368 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:39.783341    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert podName:bab9155b-7f0f-49b7-bd95-bce008c0f322 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:40.283325633 +0000 UTC m=+36.098819703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nddcd" (UID: "bab9155b-7f0f-49b7-bd95-bce008c0f322") : secret "networking-console-plugin-cert" not found
Jul 20 04:59:39.783368 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.783359    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:39.783556 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:39.783437    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 04:59:39.783556 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:39.783467    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls podName:93ea7d70-7e2b-4be9-bec1-42e998a570a9 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:40.283455379 +0000 UTC m=+36.098949455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls") pod "dns-default-khcvq" (UID: "93ea7d70-7e2b-4be9-bec1-42e998a570a9") : secret "dns-default-metrics-tls" not found
Jul 20 04:59:39.783824 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.783807    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bab9155b-7f0f-49b7-bd95-bce008c0f322-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-nddcd\" (UID: \"bab9155b-7f0f-49b7-bd95-bce008c0f322\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 04:59:39.784006 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.783984    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/93ea7d70-7e2b-4be9-bec1-42e998a570a9-config-volume\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:39.785711 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.785692    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d085e9fe-4517-4144-90fa-7e3b024db7f5-cert\") pod \"ingress-canary-sq92c\" (UID: \"d085e9fe-4517-4144-90fa-7e3b024db7f5\") " pod="openshift-ingress-canary/ingress-canary-sq92c"
Jul 20 04:59:39.795787 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.795757    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s77ss\" (UniqueName: \"kubernetes.io/projected/93ea7d70-7e2b-4be9-bec1-42e998a570a9-kube-api-access-s77ss\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:39.795997 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.795980    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9vf5\" (UniqueName: \"kubernetes.io/projected/d085e9fe-4517-4144-90fa-7e3b024db7f5-kube-api-access-m9vf5\") pod \"ingress-canary-sq92c\" (UID: \"d085e9fe-4517-4144-90fa-7e3b024db7f5\") " pod="openshift-ingress-canary/ingress-canary-sq92c"
Jul 20 04:59:39.831794 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.831764    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sq92c"
Jul 20 04:59:39.979033 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:39.978964    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sq92c"]
Jul 20 04:59:39.983613 ip-10-0-135-196 kubenswrapper[2576]: W0720 04:59:39.983578    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd085e9fe_4517_4144_90fa_7e3b024db7f5.slice/crio-728703ef181bf169657b4410abcd09f74a30a0827e804821408241bc85f41231 WatchSource:0}: Error finding container 728703ef181bf169657b4410abcd09f74a30a0827e804821408241bc85f41231: Status 404 returned error can't find the container with id 728703ef181bf169657b4410abcd09f74a30a0827e804821408241bc85f41231
Jul 20 04:59:40.187733 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:40.187643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:40.187925 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:40.187773    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 04:59:40.187925 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:40.187790    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8bcd566-2mq6z: secret "image-registry-tls" not found
Jul 20 04:59:40.187925 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:40.187861    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls podName:09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:41.187845825 +0000 UTC m=+37.003339884 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls") pod "image-registry-7c8bcd566-2mq6z" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46") : secret "image-registry-tls" not found
Jul 20 04:59:40.288419 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:40.288382    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nddcd\" (UID: \"bab9155b-7f0f-49b7-bd95-bce008c0f322\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 04:59:40.288602 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:40.288469    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:40.288602 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:40.288521    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 04:59:40.288602 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:40.288595    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert podName:bab9155b-7f0f-49b7-bd95-bce008c0f322 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:41.288576376 +0000 UTC m=+37.104070438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nddcd" (UID: "bab9155b-7f0f-49b7-bd95-bce008c0f322") : secret "networking-console-plugin-cert" not found
Jul 20 04:59:40.288774 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:40.288607    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 04:59:40.288774 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:40.288652    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls podName:93ea7d70-7e2b-4be9-bec1-42e998a570a9 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:41.288637563 +0000 UTC m=+37.104131612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls") pod "dns-default-khcvq" (UID: "93ea7d70-7e2b-4be9-bec1-42e998a570a9") : secret "dns-default-metrics-tls" not found
Jul 20 04:59:40.674610 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:40.674575    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 04:59:40.675322 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:40.675292    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 04:59:40.677460 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:40.677366    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 04:59:40.677460 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:40.677387    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-flt2r\""
Jul 20 04:59:40.677460 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:40.677417    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 04:59:40.678321 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:40.677700    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 04:59:40.855153 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:40.855088    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sq92c" event={"ID":"d085e9fe-4517-4144-90fa-7e3b024db7f5","Type":"ContainerStarted","Data":"728703ef181bf169657b4410abcd09f74a30a0827e804821408241bc85f41231"}
Jul 20 04:59:41.196487 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:41.196445    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:41.196657 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:41.196591    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 04:59:41.196657 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:41.196607    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8bcd566-2mq6z: secret "image-registry-tls" not found
Jul 20 04:59:41.196730 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:41.196687    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls podName:09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:43.19665952 +0000 UTC m=+39.012153570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls") pod "image-registry-7c8bcd566-2mq6z" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46") : secret "image-registry-tls" not found
Jul 20 04:59:41.297001 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:41.296961    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nddcd\" (UID: \"bab9155b-7f0f-49b7-bd95-bce008c0f322\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 04:59:41.297184 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:41.297039    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:41.297184 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:41.297124    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 04:59:41.297184 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:41.297180    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 04:59:41.297338 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:41.297203    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert podName:bab9155b-7f0f-49b7-bd95-bce008c0f322 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:43.297181743 +0000 UTC m=+39.112675820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nddcd" (UID: "bab9155b-7f0f-49b7-bd95-bce008c0f322") : secret "networking-console-plugin-cert" not found
Jul 20 04:59:41.297338 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:41.297238    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls podName:93ea7d70-7e2b-4be9-bec1-42e998a570a9 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:43.297222297 +0000 UTC m=+39.112716350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls") pod "dns-default-khcvq" (UID: "93ea7d70-7e2b-4be9-bec1-42e998a570a9") : secret "dns-default-metrics-tls" not found
Jul 20 04:59:43.215912 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:43.215575    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:43.215912 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:43.215733    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 04:59:43.215912 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:43.215910    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8bcd566-2mq6z: secret "image-registry-tls" not found
Jul 20 04:59:43.216383 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:43.215994    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls podName:09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:47.215970747 +0000 UTC m=+43.031464817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls") pod "image-registry-7c8bcd566-2mq6z" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46") : secret "image-registry-tls" not found
Jul 20 04:59:43.317180 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:43.317136    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nddcd\" (UID: \"bab9155b-7f0f-49b7-bd95-bce008c0f322\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 04:59:43.317401 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:43.317247    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:43.317401 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:43.317342    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 04:59:43.317401 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:43.317357    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 04:59:43.317566 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:43.317408    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert podName:bab9155b-7f0f-49b7-bd95-bce008c0f322 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:47.317392525 +0000 UTC m=+43.132886578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nddcd" (UID: "bab9155b-7f0f-49b7-bd95-bce008c0f322") : secret "networking-console-plugin-cert" not found
Jul 20 04:59:43.317566 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:43.317434    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls podName:93ea7d70-7e2b-4be9-bec1-42e998a570a9 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:47.31741566 +0000 UTC m=+43.132909723 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls") pod "dns-default-khcvq" (UID: "93ea7d70-7e2b-4be9-bec1-42e998a570a9") : secret "dns-default-metrics-tls" not found
Jul 20 04:59:44.867228 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:44.867196    2576 generic.go:356] "Generic (PLEG): container finished" podID="37a2fefc-0ae8-45b5-893b-6d60a8dbe178" containerID="1742b68766b31668e1241d50c09db2274552de5a5d485392c5adba80847b814e" exitCode=0
Jul 20 04:59:44.867713 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:44.867277    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvzvv" event={"ID":"37a2fefc-0ae8-45b5-893b-6d60a8dbe178","Type":"ContainerDied","Data":"1742b68766b31668e1241d50c09db2274552de5a5d485392c5adba80847b814e"}
Jul 20 04:59:44.868648 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:44.868623    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sq92c" event={"ID":"d085e9fe-4517-4144-90fa-7e3b024db7f5","Type":"ContainerStarted","Data":"805d31e0f36b1696b286fcb0fb0a436c0d73923450c2ef691303c2635191c85d"}
Jul 20 04:59:44.902920 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:44.902848    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sq92c" podStartSLOduration=1.7932809060000001 podStartE2EDuration="5.902834637s" totalImagesPullingTime="4.109553731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:59:44.902387792 +0000 UTC m=+40.717881863" watchObservedRunningTime="2026-07-20 04:59:44.902834637 +0000 UTC m=+40.718328732"
Jul 20 04:59:45.873796 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:45.873758    2576 generic.go:356] "Generic (PLEG): container finished" podID="37a2fefc-0ae8-45b5-893b-6d60a8dbe178" containerID="14c4dff62e417965db96b8c586deb65f0d877b8c3d592eccb449e71a44252fe3" exitCode=0
Jul 20 04:59:45.874177 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:45.873841    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvzvv" event={"ID":"37a2fefc-0ae8-45b5-893b-6d60a8dbe178","Type":"ContainerDied","Data":"14c4dff62e417965db96b8c586deb65f0d877b8c3d592eccb449e71a44252fe3"}
Jul 20 04:59:46.879038 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:46.879007    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qvzvv" event={"ID":"37a2fefc-0ae8-45b5-893b-6d60a8dbe178","Type":"ContainerStarted","Data":"8e6cf7c165f99925338f201e7fa597a8c8b4977db31f02f6c708933b412e4c84"}
Jul 20 04:59:46.901862 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:46.901813    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qvzvv" podStartSLOduration=8.870134362 podStartE2EDuration="41.901795229s" totalImagesPullingTime="33.031660867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:59:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 04:59:46.89958376 +0000 UTC m=+42.715077832" watchObservedRunningTime="2026-07-20 04:59:46.901795229 +0000 UTC m=+42.717289301"
Jul 20 04:59:47.248731 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:47.248698    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:47.248913 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:47.248820    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 04:59:47.248913 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:47.248833    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8bcd566-2mq6z: secret "image-registry-tls" not found
Jul 20 04:59:47.248913 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:47.248903    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls podName:09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:55.248868943 +0000 UTC m=+51.064362997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls") pod "image-registry-7c8bcd566-2mq6z" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46") : secret "image-registry-tls" not found
Jul 20 04:59:47.350109 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:47.350069    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nddcd\" (UID: \"bab9155b-7f0f-49b7-bd95-bce008c0f322\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 04:59:47.350275 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:47.350164    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:47.350275 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:47.350212    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 04:59:47.350275 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:47.350268    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 04:59:47.350379 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:47.350273    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert podName:bab9155b-7f0f-49b7-bd95-bce008c0f322 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:55.350258878 +0000 UTC m=+51.165752929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nddcd" (UID: "bab9155b-7f0f-49b7-bd95-bce008c0f322") : secret "networking-console-plugin-cert" not found
Jul 20 04:59:47.350379 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:47.350323    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls podName:93ea7d70-7e2b-4be9-bec1-42e998a570a9 nodeName:}" failed. No retries permitted until 2026-07-20 04:59:55.350305843 +0000 UTC m=+51.165799893 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls") pod "dns-default-khcvq" (UID: "93ea7d70-7e2b-4be9-bec1-42e998a570a9") : secret "dns-default-metrics-tls" not found
Jul 20 04:59:55.311668 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:55.311632    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 04:59:55.312142 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:55.311770    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 04:59:55.312142 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:55.311786    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8bcd566-2mq6z: secret "image-registry-tls" not found
Jul 20 04:59:55.312142 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:55.311834    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls podName:09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46 nodeName:}" failed. No retries permitted until 2026-07-20 05:00:11.311819301 +0000 UTC m=+67.127313350 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls") pod "image-registry-7c8bcd566-2mq6z" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46") : secret "image-registry-tls" not found
Jul 20 04:59:55.412997 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:55.412962    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nddcd\" (UID: \"bab9155b-7f0f-49b7-bd95-bce008c0f322\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 04:59:55.413124 ip-10-0-135-196 kubenswrapper[2576]: I0720 04:59:55.413017    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 04:59:55.413124 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:55.413102    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 04:59:55.413124 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:55.413106    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 04:59:55.413232 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:55.413144    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls podName:93ea7d70-7e2b-4be9-bec1-42e998a570a9 nodeName:}" failed. No retries permitted until 2026-07-20 05:00:11.413132887 +0000 UTC m=+67.228626938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls") pod "dns-default-khcvq" (UID: "93ea7d70-7e2b-4be9-bec1-42e998a570a9") : secret "dns-default-metrics-tls" not found
Jul 20 04:59:55.413232 ip-10-0-135-196 kubenswrapper[2576]: E0720 04:59:55.413211    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert podName:bab9155b-7f0f-49b7-bd95-bce008c0f322 nodeName:}" failed. No retries permitted until 2026-07-20 05:00:11.413198868 +0000 UTC m=+67.228692918 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nddcd" (UID: "bab9155b-7f0f-49b7-bd95-bce008c0f322") : secret "networking-console-plugin-cert" not found
Jul 20 05:00:07.854828 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:07.854799    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dng2q"
Jul 20 05:00:10.521178 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:10.521142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret\") pod \"global-pull-secret-syncer-rq2k2\" (UID: \"d1d1f768-3baf-41e6-afbc-15c2b7856475\") " pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 05:00:10.521555 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:10.521212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs\") pod \"network-metrics-daemon-wcqzq\" (UID: \"00052a42-6eff-4102-b46e-67ee21d241f0\") " pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 05:00:10.523951 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:10.523931    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 05:00:10.524054 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:10.523993    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 05:00:10.532020 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:00:10.532004    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 05:00:10.532099 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:00:10.532068    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs podName:00052a42-6eff-4102-b46e-67ee21d241f0 nodeName:}" failed. No retries permitted until 2026-07-20 05:01:14.532049879 +0000 UTC m=+130.347543930 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs") pod "network-metrics-daemon-wcqzq" (UID: "00052a42-6eff-4102-b46e-67ee21d241f0") : secret "metrics-daemon-secret" not found
Jul 20 05:00:10.535769 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:10.535747    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1d1f768-3baf-41e6-afbc-15c2b7856475-original-pull-secret\") pod \"global-pull-secret-syncer-rq2k2\" (UID: \"d1d1f768-3baf-41e6-afbc-15c2b7856475\") " pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 05:00:10.622254 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:10.622220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-855ps\" (UniqueName: \"kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps\") pod \"network-check-target-842kd\" (UID: \"f6861683-6a87-42a1-9f74-e1722936d58a\") " pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 05:00:10.624717 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:10.624697    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 05:00:10.634781 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:10.634763    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 05:00:10.646058 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:10.646031    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-855ps\" (UniqueName: \"kubernetes.io/projected/f6861683-6a87-42a1-9f74-e1722936d58a-kube-api-access-855ps\") pod \"network-check-target-842kd\" (UID: \"f6861683-6a87-42a1-9f74-e1722936d58a\") " pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 05:00:10.690156 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:10.690134    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-flt2r\""
Jul 20 05:00:10.698212 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:10.698184    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 05:00:10.705651 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:10.705633    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq2k2"
Jul 20 05:00:10.843668 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:10.843557    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-842kd"]
Jul 20 05:00:10.846749 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:00:10.846724    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6861683_6a87_42a1_9f74_e1722936d58a.slice/crio-d91d52e795b70ef08c3fdfd00b39a7c87a1e1842b7bbad37a22257e2234d820d WatchSource:0}: Error finding container d91d52e795b70ef08c3fdfd00b39a7c87a1e1842b7bbad37a22257e2234d820d: Status 404 returned error can't find the container with id d91d52e795b70ef08c3fdfd00b39a7c87a1e1842b7bbad37a22257e2234d820d
Jul 20 05:00:10.858638 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:10.858615    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rq2k2"]
Jul 20 05:00:10.865982 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:00:10.865960    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d1f768_3baf_41e6_afbc_15c2b7856475.slice/crio-68ad2f9f68102a2b8751e59812ce73f173c4684fa83efa8830479cfc27f9a883 WatchSource:0}: Error finding container 68ad2f9f68102a2b8751e59812ce73f173c4684fa83efa8830479cfc27f9a883: Status 404 returned error can't find the container with id 68ad2f9f68102a2b8751e59812ce73f173c4684fa83efa8830479cfc27f9a883
Jul 20 05:00:10.936078 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:10.936047    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rq2k2" event={"ID":"d1d1f768-3baf-41e6-afbc-15c2b7856475","Type":"ContainerStarted","Data":"68ad2f9f68102a2b8751e59812ce73f173c4684fa83efa8830479cfc27f9a883"}
Jul 20 05:00:10.937112 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:10.937091    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-842kd" event={"ID":"f6861683-6a87-42a1-9f74-e1722936d58a","Type":"ContainerStarted","Data":"d91d52e795b70ef08c3fdfd00b39a7c87a1e1842b7bbad37a22257e2234d820d"}
Jul 20 05:00:11.327437 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:11.327402    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 05:00:11.327578 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:00:11.327531    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 05:00:11.327578 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:00:11.327544    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8bcd566-2mq6z: secret "image-registry-tls" not found
Jul 20 05:00:11.327669 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:00:11.327590    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls podName:09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46 nodeName:}" failed. No retries permitted until 2026-07-20 05:00:43.327577303 +0000 UTC m=+99.143071353 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls") pod "image-registry-7c8bcd566-2mq6z" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46") : secret "image-registry-tls" not found
Jul 20 05:00:11.428501 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:11.428454    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 05:00:11.428674 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:11.428528    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nddcd\" (UID: \"bab9155b-7f0f-49b7-bd95-bce008c0f322\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 05:00:11.428674 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:00:11.428604    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 05:00:11.428674 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:00:11.428626    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 05:00:11.428674 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:00:11.428670    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert podName:bab9155b-7f0f-49b7-bd95-bce008c0f322 nodeName:}" failed. No retries permitted until 2026-07-20 05:00:43.428658232 +0000 UTC m=+99.244152282 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nddcd" (UID: "bab9155b-7f0f-49b7-bd95-bce008c0f322") : secret "networking-console-plugin-cert" not found
Jul 20 05:00:11.428829 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:00:11.428682    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls podName:93ea7d70-7e2b-4be9-bec1-42e998a570a9 nodeName:}" failed. No retries permitted until 2026-07-20 05:00:43.428676903 +0000 UTC m=+99.244170953 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls") pod "dns-default-khcvq" (UID: "93ea7d70-7e2b-4be9-bec1-42e998a570a9") : secret "dns-default-metrics-tls" not found
Jul 20 05:00:16.953549 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:16.953511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rq2k2" event={"ID":"d1d1f768-3baf-41e6-afbc-15c2b7856475","Type":"ContainerStarted","Data":"a8c603b2c779dab1f2df6b2223f1601563356fd15d8e45d763ddecf3c9516137"}
Jul 20 05:00:16.955011 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:16.954988    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-842kd" event={"ID":"f6861683-6a87-42a1-9f74-e1722936d58a","Type":"ContainerStarted","Data":"dd5315ff3b4c5709f5c7159da0fcfc4256f33a434b151c333ee48d5da5a8a50b"}
Jul 20 05:00:16.955127 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:16.955115    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 05:00:16.980655 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:16.980611    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rq2k2" podStartSLOduration=65.68473085 podStartE2EDuration="1m10.980594041s" totalImagesPullingTime="5.295863191s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 04:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:00:16.967255612 +0000 UTC m=+72.782749684" watchObservedRunningTime="2026-07-20 05:00:16.980594041 +0000 UTC m=+72.796088114"
Jul 20 05:00:16.980797 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:16.980778    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-842kd" podStartSLOduration=66.668796947 podStartE2EDuration="1m11.98077282s" totalImagesPullingTime="5.311975873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:00:16.980436876 +0000 UTC m=+72.795930948" watchObservedRunningTime="2026-07-20 05:00:16.98077282 +0000 UTC m=+72.796266891"
Jul 20 05:00:43.353105 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:43.352994    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 05:00:43.353105 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:00:43.353099    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 05:00:43.353549 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:00:43.353111    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8bcd566-2mq6z: secret "image-registry-tls" not found
Jul 20 05:00:43.353549 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:00:43.353168    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls podName:09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46 nodeName:}" failed. No retries permitted until 2026-07-20 05:01:47.353152966 +0000 UTC m=+163.168647016 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls") pod "image-registry-7c8bcd566-2mq6z" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46") : secret "image-registry-tls" not found
Jul 20 05:00:43.453408 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:43.453359    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 05:00:43.453594 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:43.453439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nddcd\" (UID: \"bab9155b-7f0f-49b7-bd95-bce008c0f322\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 05:00:43.453594 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:00:43.453537    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 05:00:43.453594 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:00:43.453537    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 05:00:43.453692 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:00:43.453599    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert podName:bab9155b-7f0f-49b7-bd95-bce008c0f322 nodeName:}" failed. No retries permitted until 2026-07-20 05:01:47.453585266 +0000 UTC m=+163.269079316 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nddcd" (UID: "bab9155b-7f0f-49b7-bd95-bce008c0f322") : secret "networking-console-plugin-cert" not found
Jul 20 05:00:43.453692 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:00:43.453613    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls podName:93ea7d70-7e2b-4be9-bec1-42e998a570a9 nodeName:}" failed. No retries permitted until 2026-07-20 05:01:47.453606595 +0000 UTC m=+163.269100645 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls") pod "dns-default-khcvq" (UID: "93ea7d70-7e2b-4be9-bec1-42e998a570a9") : secret "dns-default-metrics-tls" not found
Jul 20 05:00:47.959941 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:00:47.959913    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-842kd"
Jul 20 05:01:12.548066 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.548033    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"]
Jul 20 05:01:12.550199 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.550183    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"
Jul 20 05:01:12.552506 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.552486    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 20 05:01:12.552653 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.552637    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 20 05:01:12.553831 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.553813    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 20 05:01:12.553831 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.553827    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 20 05:01:12.561049 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.561027    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"]
Jul 20 05:01:12.662232 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.662206    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab83a019-10c9-48eb-b445-ab2cbcb856ae-tmp\") pod \"klusterlet-addon-workmgr-66bfbdf9f4-s9d2s\" (UID: \"ab83a019-10c9-48eb-b445-ab2cbcb856ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"
Jul 20 05:01:12.662378 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.662262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ab83a019-10c9-48eb-b445-ab2cbcb856ae-klusterlet-config\") pod \"klusterlet-addon-workmgr-66bfbdf9f4-s9d2s\" (UID: \"ab83a019-10c9-48eb-b445-ab2cbcb856ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"
Jul 20 05:01:12.662378 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.662282    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw5tx\" (UniqueName: \"kubernetes.io/projected/ab83a019-10c9-48eb-b445-ab2cbcb856ae-kube-api-access-kw5tx\") pod \"klusterlet-addon-workmgr-66bfbdf9f4-s9d2s\" (UID: \"ab83a019-10c9-48eb-b445-ab2cbcb856ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"
Jul 20 05:01:12.763201 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.763169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab83a019-10c9-48eb-b445-ab2cbcb856ae-tmp\") pod \"klusterlet-addon-workmgr-66bfbdf9f4-s9d2s\" (UID: \"ab83a019-10c9-48eb-b445-ab2cbcb856ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"
Jul 20 05:01:12.763350 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.763236    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ab83a019-10c9-48eb-b445-ab2cbcb856ae-klusterlet-config\") pod \"klusterlet-addon-workmgr-66bfbdf9f4-s9d2s\" (UID: \"ab83a019-10c9-48eb-b445-ab2cbcb856ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"
Jul 20 05:01:12.763350 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.763272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw5tx\" (UniqueName: \"kubernetes.io/projected/ab83a019-10c9-48eb-b445-ab2cbcb856ae-kube-api-access-kw5tx\") pod \"klusterlet-addon-workmgr-66bfbdf9f4-s9d2s\" (UID: \"ab83a019-10c9-48eb-b445-ab2cbcb856ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"
Jul 20 05:01:12.763564 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.763546    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab83a019-10c9-48eb-b445-ab2cbcb856ae-tmp\") pod \"klusterlet-addon-workmgr-66bfbdf9f4-s9d2s\" (UID: \"ab83a019-10c9-48eb-b445-ab2cbcb856ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"
Jul 20 05:01:12.765676 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.765649    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ab83a019-10c9-48eb-b445-ab2cbcb856ae-klusterlet-config\") pod \"klusterlet-addon-workmgr-66bfbdf9f4-s9d2s\" (UID: \"ab83a019-10c9-48eb-b445-ab2cbcb856ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"
Jul 20 05:01:12.771595 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.771576    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw5tx\" (UniqueName: \"kubernetes.io/projected/ab83a019-10c9-48eb-b445-ab2cbcb856ae-kube-api-access-kw5tx\") pod \"klusterlet-addon-workmgr-66bfbdf9f4-s9d2s\" (UID: \"ab83a019-10c9-48eb-b445-ab2cbcb856ae\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"
Jul 20 05:01:12.859136 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.859030    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"
Jul 20 05:01:12.979722 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:12.979652    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"]
Jul 20 05:01:12.982146 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:01:12.982110    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab83a019_10c9_48eb_b445_ab2cbcb856ae.slice/crio-90b75d4ff14d6e0cf52acc08da7a98fe2ce90e2f572aaa1d6ed509d12a1ae7b3 WatchSource:0}: Error finding container 90b75d4ff14d6e0cf52acc08da7a98fe2ce90e2f572aaa1d6ed509d12a1ae7b3: Status 404 returned error can't find the container with id 90b75d4ff14d6e0cf52acc08da7a98fe2ce90e2f572aaa1d6ed509d12a1ae7b3
Jul 20 05:01:13.086516 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:13.086479    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s" event={"ID":"ab83a019-10c9-48eb-b445-ab2cbcb856ae","Type":"ContainerStarted","Data":"90b75d4ff14d6e0cf52acc08da7a98fe2ce90e2f572aaa1d6ed509d12a1ae7b3"}
Jul 20 05:01:14.578332 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:14.578298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs\") pod \"network-metrics-daemon-wcqzq\" (UID: \"00052a42-6eff-4102-b46e-67ee21d241f0\") " pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 05:01:14.578814 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:01:14.578443    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 05:01:14.578814 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:01:14.578513    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs podName:00052a42-6eff-4102-b46e-67ee21d241f0 nodeName:}" failed. No retries permitted until 2026-07-20 05:03:16.578492038 +0000 UTC m=+252.393986091 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs") pod "network-metrics-daemon-wcqzq" (UID: "00052a42-6eff-4102-b46e-67ee21d241f0") : secret "metrics-daemon-secret" not found
Jul 20 05:01:17.097521 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:17.097483    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s" event={"ID":"ab83a019-10c9-48eb-b445-ab2cbcb856ae","Type":"ContainerStarted","Data":"33298b1cddbdceaec94b3845e0691f341690f6479277ee4edbbf90c4bc29800c"}
Jul 20 05:01:17.097924 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:17.097632    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"
Jul 20 05:01:17.099228 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:17.099210    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"
Jul 20 05:01:17.113245 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:17.113196    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s" podStartSLOduration=1.518848863 podStartE2EDuration="5.113180322s" totalImagesPullingTime="3.594331459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:01:17.11156521 +0000 UTC m=+132.927059283" watchObservedRunningTime="2026-07-20 05:01:17.113180322 +0000 UTC m=+132.928674438"
Jul 20 05:01:42.510220 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:01:42.510180    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z" podUID="09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46"
Jul 20 05:01:42.539496 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:01:42.539457    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd" podUID="bab9155b-7f0f-49b7-bd95-bce008c0f322"
Jul 20 05:01:42.544608 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:01:42.544588    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-khcvq" podUID="93ea7d70-7e2b-4be9-bec1-42e998a570a9"
Jul 20 05:01:42.685830 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:01:42.685801    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 05:01:43.154666 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:43.154629    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-khcvq"
Jul 20 05:01:43.154666 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:43.154666    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 05:01:43.154956 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:43.154785    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 05:01:47.413196 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:47.413137    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 05:01:47.413684 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:01:47.413308    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 05:01:47.413684 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:01:47.413330    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c8bcd566-2mq6z: secret "image-registry-tls" not found
Jul 20 05:01:47.413684 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:01:47.413402    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls podName:09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46 nodeName:}" failed. No retries permitted until 2026-07-20 05:03:49.413382048 +0000 UTC m=+285.228876099 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls") pod "image-registry-7c8bcd566-2mq6z" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46") : secret "image-registry-tls" not found
Jul 20 05:01:47.514130 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:47.514093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nddcd\" (UID: \"bab9155b-7f0f-49b7-bd95-bce008c0f322\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 05:01:47.514285 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:47.514147    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 05:01:47.514285 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:01:47.514231    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 05:01:47.514356 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:01:47.514232    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 20 05:01:47.514356 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:01:47.514284    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls podName:93ea7d70-7e2b-4be9-bec1-42e998a570a9 nodeName:}" failed. No retries permitted until 2026-07-20 05:03:49.514270181 +0000 UTC m=+285.329764231 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls") pod "dns-default-khcvq" (UID: "93ea7d70-7e2b-4be9-bec1-42e998a570a9") : secret "dns-default-metrics-tls" not found
Jul 20 05:01:47.514356 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:01:47.514347    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert podName:bab9155b-7f0f-49b7-bd95-bce008c0f322 nodeName:}" failed. No retries permitted until 2026-07-20 05:03:49.51433235 +0000 UTC m=+285.329826403 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nddcd" (UID: "bab9155b-7f0f-49b7-bd95-bce008c0f322") : secret "networking-console-plugin-cert" not found
Jul 20 05:01:56.674719 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:01:56.674636    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 05:03:16.638558 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:16.638519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs\") pod \"network-metrics-daemon-wcqzq\" (UID: \"00052a42-6eff-4102-b46e-67ee21d241f0\") " pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 05:03:16.639065 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:16.638633    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 20 05:03:16.639065 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:16.638692    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs podName:00052a42-6eff-4102-b46e-67ee21d241f0 nodeName:}" failed. No retries permitted until 2026-07-20 05:05:18.638677209 +0000 UTC m=+374.454171259 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs") pod "network-metrics-daemon-wcqzq" (UID: "00052a42-6eff-4102-b46e-67ee21d241f0") : secret "metrics-daemon-secret" not found
Jul 20 05:03:17.098292 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:17.098247    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s" podUID="ab83a019-10c9-48eb-b445-ab2cbcb856ae" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused"
Jul 20 05:03:17.374093 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:17.374023    2576 generic.go:356] "Generic (PLEG): container finished" podID="ab83a019-10c9-48eb-b445-ab2cbcb856ae" containerID="33298b1cddbdceaec94b3845e0691f341690f6479277ee4edbbf90c4bc29800c" exitCode=1
Jul 20 05:03:17.374093 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:17.374083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s" event={"ID":"ab83a019-10c9-48eb-b445-ab2cbcb856ae","Type":"ContainerDied","Data":"33298b1cddbdceaec94b3845e0691f341690f6479277ee4edbbf90c4bc29800c"}
Jul 20 05:03:17.374406 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:17.374393    2576 scope.go:117] "RemoveContainer" containerID="33298b1cddbdceaec94b3845e0691f341690f6479277ee4edbbf90c4bc29800c"
Jul 20 05:03:18.378531 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:18.378494    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s" event={"ID":"ab83a019-10c9-48eb-b445-ab2cbcb856ae","Type":"ContainerStarted","Data":"41a2f773d6809f2badbbe098ec37b56bec705c7cb892af4b5b4cec94affb36f9"}
Jul 20 05:03:18.378949 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:18.378764    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"
Jul 20 05:03:18.379394 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:18.379376    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66bfbdf9f4-s9d2s"
Jul 20 05:03:25.700938 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.700903    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-9qgn8"]
Jul 20 05:03:25.703525 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.703510    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9qgn8"
Jul 20 05:03:25.705845 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.705819    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc"]
Jul 20 05:03:25.706676 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.706659    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7z9r5\""
Jul 20 05:03:25.708467 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.708453    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc"
Jul 20 05:03:25.711044 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.711027    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 20 05:03:25.711269 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.711254    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 20 05:03:25.711377 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.711296    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 20 05:03:25.711377 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.711301    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-khsrj\""
Jul 20 05:03:25.711377 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.711312    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 20 05:03:25.713575 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.713556    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-9qgn8"]
Jul 20 05:03:25.718615 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.718592    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc"]
Jul 20 05:03:25.798836 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.798772    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/592e503e-97d9-4011-9821-0a4320e1048e-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-2k7vc\" (UID: \"592e503e-97d9-4011-9821-0a4320e1048e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc"
Jul 20 05:03:25.798836 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.798806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/592e503e-97d9-4011-9821-0a4320e1048e-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-2k7vc\" (UID: \"592e503e-97d9-4011-9821-0a4320e1048e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc"
Jul 20 05:03:25.799029 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.798858    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqqqh\" (UniqueName: \"kubernetes.io/projected/592e503e-97d9-4011-9821-0a4320e1048e-kube-api-access-bqqqh\") pod \"kube-storage-version-migrator-operator-7658d9b749-2k7vc\" (UID: \"592e503e-97d9-4011-9821-0a4320e1048e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc"
Jul 20 05:03:25.799029 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.798903    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7scb\" (UniqueName: \"kubernetes.io/projected/7a22472e-1e07-41e2-b794-5d00f201a161-kube-api-access-z7scb\") pod \"network-check-source-7bc5b6bf85-9qgn8\" (UID: \"7a22472e-1e07-41e2-b794-5d00f201a161\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9qgn8"
Jul 20 05:03:25.900209 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.900185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/592e503e-97d9-4011-9821-0a4320e1048e-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-2k7vc\" (UID: \"592e503e-97d9-4011-9821-0a4320e1048e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc"
Jul 20 05:03:25.900369 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.900214    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/592e503e-97d9-4011-9821-0a4320e1048e-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-2k7vc\" (UID: \"592e503e-97d9-4011-9821-0a4320e1048e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc"
Jul 20 05:03:25.900369 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.900254    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqqqh\" (UniqueName: \"kubernetes.io/projected/592e503e-97d9-4011-9821-0a4320e1048e-kube-api-access-bqqqh\") pod \"kube-storage-version-migrator-operator-7658d9b749-2k7vc\" (UID: \"592e503e-97d9-4011-9821-0a4320e1048e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc"
Jul 20 05:03:25.900369 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.900292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7scb\" (UniqueName: \"kubernetes.io/projected/7a22472e-1e07-41e2-b794-5d00f201a161-kube-api-access-z7scb\") pod \"network-check-source-7bc5b6bf85-9qgn8\" (UID: \"7a22472e-1e07-41e2-b794-5d00f201a161\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9qgn8"
Jul 20 05:03:25.900694 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.900678    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/592e503e-97d9-4011-9821-0a4320e1048e-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-2k7vc\" (UID: \"592e503e-97d9-4011-9821-0a4320e1048e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc"
Jul 20 05:03:25.902463 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.902445    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/592e503e-97d9-4011-9821-0a4320e1048e-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-2k7vc\" (UID: \"592e503e-97d9-4011-9821-0a4320e1048e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc"
Jul 20 05:03:25.908341 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.908322    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqqqh\" (UniqueName: \"kubernetes.io/projected/592e503e-97d9-4011-9821-0a4320e1048e-kube-api-access-bqqqh\") pod \"kube-storage-version-migrator-operator-7658d9b749-2k7vc\" (UID: \"592e503e-97d9-4011-9821-0a4320e1048e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc"
Jul 20 05:03:25.908437 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:25.908368    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7scb\" (UniqueName: \"kubernetes.io/projected/7a22472e-1e07-41e2-b794-5d00f201a161-kube-api-access-z7scb\") pod \"network-check-source-7bc5b6bf85-9qgn8\" (UID: \"7a22472e-1e07-41e2-b794-5d00f201a161\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9qgn8"
Jul 20 05:03:26.014601 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:26.014523    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9qgn8"
Jul 20 05:03:26.020487 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:26.020471    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc"
Jul 20 05:03:26.148461 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:26.148298    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-9qgn8"]
Jul 20 05:03:26.151008 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:03:26.150982    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a22472e_1e07_41e2_b794_5d00f201a161.slice/crio-732467eb34d44c62179c17e12d034160d9e6450a108bd0a7aabfe8c30ac31efa WatchSource:0}: Error finding container 732467eb34d44c62179c17e12d034160d9e6450a108bd0a7aabfe8c30ac31efa: Status 404 returned error can't find the container with id 732467eb34d44c62179c17e12d034160d9e6450a108bd0a7aabfe8c30ac31efa
Jul 20 05:03:26.161299 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:26.161277    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc"]
Jul 20 05:03:26.165544 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:03:26.165523    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592e503e_97d9_4011_9821_0a4320e1048e.slice/crio-4470851da71719d70572857e9d3608530ad6f1c6661195c0fe5b12d3985088c7 WatchSource:0}: Error finding container 4470851da71719d70572857e9d3608530ad6f1c6661195c0fe5b12d3985088c7: Status 404 returned error can't find the container with id 4470851da71719d70572857e9d3608530ad6f1c6661195c0fe5b12d3985088c7
Jul 20 05:03:26.401266 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:26.401166    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9qgn8" event={"ID":"7a22472e-1e07-41e2-b794-5d00f201a161","Type":"ContainerStarted","Data":"7603a50d0d190eed0d49d5d165c2d001f73591011dd7af417802f86a39ba9558"}
Jul 20 05:03:26.401266 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:26.401225    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9qgn8" event={"ID":"7a22472e-1e07-41e2-b794-5d00f201a161","Type":"ContainerStarted","Data":"732467eb34d44c62179c17e12d034160d9e6450a108bd0a7aabfe8c30ac31efa"}
Jul 20 05:03:26.402337 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:26.402302    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc" event={"ID":"592e503e-97d9-4011-9821-0a4320e1048e","Type":"ContainerStarted","Data":"4470851da71719d70572857e9d3608530ad6f1c6661195c0fe5b12d3985088c7"}
Jul 20 05:03:26.416170 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:26.416127    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-9qgn8" podStartSLOduration=1.416113001 podStartE2EDuration="1.416113001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:03:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:03:26.415623386 +0000 UTC m=+262.231117476" watchObservedRunningTime="2026-07-20 05:03:26.416113001 +0000 UTC m=+262.231607098"
Jul 20 05:03:28.414153 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:28.414110    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc" event={"ID":"592e503e-97d9-4011-9821-0a4320e1048e","Type":"ContainerStarted","Data":"666caba6227aadfe2d676b4c8e7347e7a28f44284b7ed6dba272c81d54e5399c"}
Jul 20 05:03:28.429268 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:28.429213    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc" podStartSLOduration=1.332469541 podStartE2EDuration="3.429194941s" totalImagesPullingTime="2.0967254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:03:28.428137795 +0000 UTC m=+264.243631867" watchObservedRunningTime="2026-07-20 05:03:28.429194941 +0000 UTC m=+264.244689014"
Jul 20 05:03:29.704993 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:29.704960    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-vsk8f"]
Jul 20 05:03:29.708204 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:29.708179    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-vsk8f"
Jul 20 05:03:29.710629 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:29.710610    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 20 05:03:29.711374 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:29.711360    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-qcpf9\""
Jul 20 05:03:29.711918 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:29.711901    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 20 05:03:29.720032 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:29.720012    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-vsk8f"]
Jul 20 05:03:29.729285 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:29.729265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bss5z\" (UniqueName: \"kubernetes.io/projected/13349402-1257-4caf-983b-e7ea09f98f08-kube-api-access-bss5z\") pod \"migrator-7cc9c7ffd7-vsk8f\" (UID: \"13349402-1257-4caf-983b-e7ea09f98f08\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-vsk8f"
Jul 20 05:03:29.829992 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:29.829963    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bss5z\" (UniqueName: \"kubernetes.io/projected/13349402-1257-4caf-983b-e7ea09f98f08-kube-api-access-bss5z\") pod \"migrator-7cc9c7ffd7-vsk8f\" (UID: \"13349402-1257-4caf-983b-e7ea09f98f08\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-vsk8f"
Jul 20 05:03:29.837318 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:29.837294    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bss5z\" (UniqueName: \"kubernetes.io/projected/13349402-1257-4caf-983b-e7ea09f98f08-kube-api-access-bss5z\") pod \"migrator-7cc9c7ffd7-vsk8f\" (UID: \"13349402-1257-4caf-983b-e7ea09f98f08\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-vsk8f"
Jul 20 05:03:30.017028 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.016939    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-vsk8f"
Jul 20 05:03:30.136453 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.136431    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-vsk8f"]
Jul 20 05:03:30.138685 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:03:30.138662    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13349402_1257_4caf_983b_e7ea09f98f08.slice/crio-5c2db76e0ddda5ea23b5f9b5b003dc45fdda98140bcf5fdb55d575dc389fe0e1 WatchSource:0}: Error finding container 5c2db76e0ddda5ea23b5f9b5b003dc45fdda98140bcf5fdb55d575dc389fe0e1: Status 404 returned error can't find the container with id 5c2db76e0ddda5ea23b5f9b5b003dc45fdda98140bcf5fdb55d575dc389fe0e1
Jul 20 05:03:30.369833 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.369751    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7s2b2"]
Jul 20 05:03:30.374089 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.374071    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:30.376360 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.376339    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 05:03:30.376545 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.376529    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 05:03:30.376634 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.376533    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 05:03:30.376634 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.376581    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 05:03:30.377690 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.377673    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-28fj9\""
Jul 20 05:03:30.385196 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.385176    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7s2b2"]
Jul 20 05:03:30.421714 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.421686    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-vsk8f" event={"ID":"13349402-1257-4caf-983b-e7ea09f98f08","Type":"ContainerStarted","Data":"5c2db76e0ddda5ea23b5f9b5b003dc45fdda98140bcf5fdb55d575dc389fe0e1"}
Jul 20 05:03:30.434541 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.434513    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3294c4a-46ba-4831-98f2-a50a37b980ff-crio-socket\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:30.434636 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.434554    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3294c4a-46ba-4831-98f2-a50a37b980ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:30.434687 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.434653    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9cph\" (UniqueName: \"kubernetes.io/projected/c3294c4a-46ba-4831-98f2-a50a37b980ff-kube-api-access-k9cph\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:30.434739 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.434690    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3294c4a-46ba-4831-98f2-a50a37b980ff-data-volume\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:30.434739 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.434717    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:30.536002 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.535974    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3294c4a-46ba-4831-98f2-a50a37b980ff-crio-socket\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:30.536121 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.536008    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3294c4a-46ba-4831-98f2-a50a37b980ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:30.536121 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.536042    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9cph\" (UniqueName: \"kubernetes.io/projected/c3294c4a-46ba-4831-98f2-a50a37b980ff-kube-api-access-k9cph\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:30.536121 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.536067    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3294c4a-46ba-4831-98f2-a50a37b980ff-data-volume\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:30.536121 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:30.536107    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 05:03:30.536306 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.536101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3294c4a-46ba-4831-98f2-a50a37b980ff-crio-socket\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:30.536306 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:30.536163    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3294c4a-46ba-4831-98f2-a50a37b980ff-kube-rbac-proxy-cm podName:c3294c4a-46ba-4831-98f2-a50a37b980ff nodeName:}" failed. No retries permitted until 2026-07-20 05:03:31.036148948 +0000 UTC m=+266.851642998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c3294c4a-46ba-4831-98f2-a50a37b980ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7s2b2" (UID: "c3294c4a-46ba-4831-98f2-a50a37b980ff") : configmap "kube-rbac-proxy" not found
Jul 20 05:03:30.536306 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.536184    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:30.536306 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:30.536296    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 05:03:30.536494 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:30.536330    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls podName:c3294c4a-46ba-4831-98f2-a50a37b980ff nodeName:}" failed. No retries permitted until 2026-07-20 05:03:31.03632072 +0000 UTC m=+266.851814769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7s2b2" (UID: "c3294c4a-46ba-4831-98f2-a50a37b980ff") : secret "insights-runtime-extractor-tls" not found
Jul 20 05:03:30.536494 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.536297    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3294c4a-46ba-4831-98f2-a50a37b980ff-data-volume\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:30.546367 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:30.546348    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9cph\" (UniqueName: \"kubernetes.io/projected/c3294c4a-46ba-4831-98f2-a50a37b980ff-kube-api-access-k9cph\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:31.040490 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:31.040459    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:31.040865 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:31.040522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3294c4a-46ba-4831-98f2-a50a37b980ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:31.040865 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:31.040622    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 05:03:31.040865 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:31.040693    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls podName:c3294c4a-46ba-4831-98f2-a50a37b980ff nodeName:}" failed. No retries permitted until 2026-07-20 05:03:32.040678319 +0000 UTC m=+267.856172369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7s2b2" (UID: "c3294c4a-46ba-4831-98f2-a50a37b980ff") : secret "insights-runtime-extractor-tls" not found
Jul 20 05:03:31.041008 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:31.040956    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3294c4a-46ba-4831-98f2-a50a37b980ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:31.426752 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:31.426726    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-vsk8f" event={"ID":"13349402-1257-4caf-983b-e7ea09f98f08","Type":"ContainerStarted","Data":"bbc8850bc667d1a79375595757708cad05346592cb0416639dee3728168bdf85"}
Jul 20 05:03:32.047071 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:32.047023    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:32.047454 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:32.047181    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 05:03:32.047454 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:32.047255    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls podName:c3294c4a-46ba-4831-98f2-a50a37b980ff nodeName:}" failed. No retries permitted until 2026-07-20 05:03:34.047236166 +0000 UTC m=+269.862730216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7s2b2" (UID: "c3294c4a-46ba-4831-98f2-a50a37b980ff") : secret "insights-runtime-extractor-tls" not found
Jul 20 05:03:32.430840 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:32.430759    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-vsk8f" event={"ID":"13349402-1257-4caf-983b-e7ea09f98f08","Type":"ContainerStarted","Data":"86f65f653cdb78897c4a996c8f4353ec17d34d93ef309e127a213d0a95212122"}
Jul 20 05:03:32.445363 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:32.445319    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-vsk8f" podStartSLOduration=2.2369719630000002 podStartE2EDuration="3.445304491s" totalImagesPullingTime="1.208332528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:03:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:03:32.444968275 +0000 UTC m=+268.260462370" watchObservedRunningTime="2026-07-20 05:03:32.445304491 +0000 UTC m=+268.260798562"
Jul 20 05:03:32.965717 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:32.965690    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7q97q_e5c87251-66a3-49c9-ae5f-8ed4e6ac4075/dns-node-resolver/0.log"
Jul 20 05:03:34.062670 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:34.062628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:34.063036 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:34.062790    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 05:03:34.063036 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:34.062864    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls podName:c3294c4a-46ba-4831-98f2-a50a37b980ff nodeName:}" failed. No retries permitted until 2026-07-20 05:03:38.062846132 +0000 UTC m=+273.878340181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7s2b2" (UID: "c3294c4a-46ba-4831-98f2-a50a37b980ff") : secret "insights-runtime-extractor-tls" not found
Jul 20 05:03:34.366570 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:34.366502    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qqt42_7aeacaeb-c51d-4a2c-962a-cc69281308f9/node-ca/0.log"
Jul 20 05:03:35.165611 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:35.165566    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sq92c_d085e9fe-4517-4144-90fa-7e3b024db7f5/serve-healthcheck-canary/0.log"
Jul 20 05:03:35.365566 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:35.365541    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-vsk8f_13349402-1257-4caf-983b-e7ea09f98f08/migrator/0.log"
Jul 20 05:03:35.565778 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:35.565751    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-vsk8f_13349402-1257-4caf-983b-e7ea09f98f08/graceful-termination/0.log"
Jul 20 05:03:35.766601 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:35.766570    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-2k7vc_592e503e-97d9-4011-9821-0a4320e1048e/kube-storage-version-migrator-operator/0.log"
Jul 20 05:03:38.092761 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:38.092721    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:38.093186 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:38.092846    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 05:03:38.093186 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:38.092915    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls podName:c3294c4a-46ba-4831-98f2-a50a37b980ff nodeName:}" failed. No retries permitted until 2026-07-20 05:03:46.092902358 +0000 UTC m=+281.908396409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7s2b2" (UID: "c3294c4a-46ba-4831-98f2-a50a37b980ff") : secret "insights-runtime-extractor-tls" not found
Jul 20 05:03:46.153174 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:46.153136    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:46.155458 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:46.155432    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-khcvq" podUID="93ea7d70-7e2b-4be9-bec1-42e998a570a9"
Jul 20 05:03:46.155542 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:46.155470    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd" podUID="bab9155b-7f0f-49b7-bd95-bce008c0f322"
Jul 20 05:03:46.155542 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:46.155502    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z" podUID="09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46"
Jul 20 05:03:46.155625 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:46.155548    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3294c4a-46ba-4831-98f2-a50a37b980ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7s2b2\" (UID: \"c3294c4a-46ba-4831-98f2-a50a37b980ff\") " pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:46.283034 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:46.283002    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7s2b2"
Jul 20 05:03:46.403506 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:46.403444    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7s2b2"]
Jul 20 05:03:46.406128 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:03:46.406094    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3294c4a_46ba_4831_98f2_a50a37b980ff.slice/crio-f45378fb58a86cd1a8a37c539b891d125e3466427ca83e00ccae2aa720ccde62 WatchSource:0}: Error finding container f45378fb58a86cd1a8a37c539b891d125e3466427ca83e00ccae2aa720ccde62: Status 404 returned error can't find the container with id f45378fb58a86cd1a8a37c539b891d125e3466427ca83e00ccae2aa720ccde62
Jul 20 05:03:46.470233 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:46.470210    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 05:03:46.470373 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:46.470247    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-khcvq"
Jul 20 05:03:46.470373 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:46.470248    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7s2b2" event={"ID":"c3294c4a-46ba-4831-98f2-a50a37b980ff","Type":"ContainerStarted","Data":"f45378fb58a86cd1a8a37c539b891d125e3466427ca83e00ccae2aa720ccde62"}
Jul 20 05:03:46.470512 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:46.470496    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 05:03:49.480516 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:49.480479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 05:03:49.483376 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:49.483342    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls\") pod \"image-registry-7c8bcd566-2mq6z\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") " pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 05:03:49.581935 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:49.581868    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 05:03:49.582117 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:49.581982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nddcd\" (UID: \"bab9155b-7f0f-49b7-bd95-bce008c0f322\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 05:03:49.584751 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:49.584723    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bab9155b-7f0f-49b7-bd95-bce008c0f322-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nddcd\" (UID: \"bab9155b-7f0f-49b7-bd95-bce008c0f322\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 05:03:49.584897 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:49.584726    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/93ea7d70-7e2b-4be9-bec1-42e998a570a9-metrics-tls\") pod \"dns-default-khcvq\" (UID: \"93ea7d70-7e2b-4be9-bec1-42e998a570a9\") " pod="openshift-dns/dns-default-khcvq"
Jul 20 05:03:49.774774 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:49.774693    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jlw9p\""
Jul 20 05:03:49.774774 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:49.774698    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-96pw8\""
Jul 20 05:03:49.774997 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:49.774777    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vkwrd\""
Jul 20 05:03:49.781924 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:49.781893    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-khcvq"
Jul 20 05:03:49.782069 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:49.781961    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 05:03:49.782069 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:49.781997    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"
Jul 20 05:03:51.290157 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:51.290088    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd"]
Jul 20 05:03:51.293198 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:03:51.293142    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbab9155b_7f0f_49b7_bd95_bce008c0f322.slice/crio-128e3207ada6013b47569995f058dee424be0109d999619a5fb23c50f2afd30d WatchSource:0}: Error finding container 128e3207ada6013b47569995f058dee424be0109d999619a5fb23c50f2afd30d: Status 404 returned error can't find the container with id 128e3207ada6013b47569995f058dee424be0109d999619a5fb23c50f2afd30d
Jul 20 05:03:51.311517 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:51.311487    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c8bcd566-2mq6z"]
Jul 20 05:03:51.314611 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:03:51.314584    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e2bf5f_7ee1_48c9_bbb7_8bf7053bae46.slice/crio-12d2a264c9220f46fe628584f20462a0b9bb620b758e639aa59536e7f771399c WatchSource:0}: Error finding container 12d2a264c9220f46fe628584f20462a0b9bb620b758e639aa59536e7f771399c: Status 404 returned error can't find the container with id 12d2a264c9220f46fe628584f20462a0b9bb620b758e639aa59536e7f771399c
Jul 20 05:03:51.327098 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:51.327078    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-khcvq"]
Jul 20 05:03:51.329590 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:03:51.329568    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93ea7d70_7e2b_4be9_bec1_42e998a570a9.slice/crio-5681a242874a210320fed18d1821a8584bd33a88ee8f2afde90ff1fc600950ca WatchSource:0}: Error finding container 5681a242874a210320fed18d1821a8584bd33a88ee8f2afde90ff1fc600950ca: Status 404 returned error can't find the container with id 5681a242874a210320fed18d1821a8584bd33a88ee8f2afde90ff1fc600950ca
Jul 20 05:03:51.487446 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:51.487414    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-khcvq" event={"ID":"93ea7d70-7e2b-4be9-bec1-42e998a570a9","Type":"ContainerStarted","Data":"5681a242874a210320fed18d1821a8584bd33a88ee8f2afde90ff1fc600950ca"}
Jul 20 05:03:51.488556 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:51.488530    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd" event={"ID":"bab9155b-7f0f-49b7-bd95-bce008c0f322","Type":"ContainerStarted","Data":"128e3207ada6013b47569995f058dee424be0109d999619a5fb23c50f2afd30d"}
Jul 20 05:03:51.490076 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:51.490054    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7s2b2" event={"ID":"c3294c4a-46ba-4831-98f2-a50a37b980ff","Type":"ContainerStarted","Data":"514102f9cea4b6603cf59a72618c3d1475054631e47c8703ed45823d9f0f45f7"}
Jul 20 05:03:51.491378 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:51.491361    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z" event={"ID":"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46","Type":"ContainerStarted","Data":"9ef1d0df1ac401230801cba674c332c2c021aeeb6007ec9bc0ba0d412249e8b7"}
Jul 20 05:03:51.491450 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:51.491392    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z" event={"ID":"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46","Type":"ContainerStarted","Data":"12d2a264c9220f46fe628584f20462a0b9bb620b758e639aa59536e7f771399c"}
Jul 20 05:03:51.491502 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:51.491489    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 05:03:51.510452 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:51.510377    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z" podStartSLOduration=285.510357551 podStartE2EDuration="4m45.510357551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:59:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:03:51.509192483 +0000 UTC m=+287.324686554" watchObservedRunningTime="2026-07-20 05:03:51.510357551 +0000 UTC m=+287.325851628"
Jul 20 05:03:55.508036 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:55.507945    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-khcvq" event={"ID":"93ea7d70-7e2b-4be9-bec1-42e998a570a9","Type":"ContainerStarted","Data":"c70bee0fe6235a75f63d918c7c445c971fdaa212ea2280a31dd7172c97f5e27f"}
Jul 20 05:03:55.508036 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:55.507997    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-khcvq" event={"ID":"93ea7d70-7e2b-4be9-bec1-42e998a570a9","Type":"ContainerStarted","Data":"e64ffc2dbd709892af0cb46c271b9be1ffc2891b72b5982aeeb060cf98ab2fa9"}
Jul 20 05:03:55.508036 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:55.508019    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-khcvq"
Jul 20 05:03:55.509369 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:55.509339    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd" event={"ID":"bab9155b-7f0f-49b7-bd95-bce008c0f322","Type":"ContainerStarted","Data":"7b404efcfa76a79abb53a2300383b65c6461b0e7cc103def343036e5a6686ccf"}
Jul 20 05:03:55.510936 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:55.510910    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7s2b2" event={"ID":"c3294c4a-46ba-4831-98f2-a50a37b980ff","Type":"ContainerStarted","Data":"2d9fd546f4a90a6fd56fcb4c526f414b1d922963c30784d8d8c7ae9cc0fd2a48"}
Jul 20 05:03:55.524547 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:55.524510    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-khcvq" podStartSLOduration=252.65670754 podStartE2EDuration="4m16.52449811s" totalImagesPullingTime="3.86779057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:03:55.524020356 +0000 UTC m=+291.339514428" watchObservedRunningTime="2026-07-20 05:03:55.52449811 +0000 UTC m=+291.339992182"
Jul 20 05:03:55.540329 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:55.540287    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nddcd" podStartSLOduration=268.636528373 podStartE2EDuration="4m32.54027101s" totalImagesPullingTime="3.903742637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:59:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:03:55.539702664 +0000 UTC m=+291.355196737" watchObservedRunningTime="2026-07-20 05:03:55.54027101 +0000 UTC m=+291.355765081"
Jul 20 05:03:59.526694 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:59.526661    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7s2b2" event={"ID":"c3294c4a-46ba-4831-98f2-a50a37b980ff","Type":"ContainerStarted","Data":"32f75a51bdc6aaa49ddc027cf12fed4139bf48d9b177bfab09b00df6f573641d"}
Jul 20 05:03:59.544154 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:03:59.544103    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7s2b2" podStartSLOduration=17.320103742 podStartE2EDuration="29.544085234s" totalImagesPullingTime="12.223981492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 05:03:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:03:59.542409592 +0000 UTC m=+295.357903665" watchObservedRunningTime="2026-07-20 05:03:59.544085234 +0000 UTC m=+295.359579306"
Jul 20 05:03:59.675785 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:03:59.675738    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wcqzq" podUID="00052a42-6eff-4102-b46e-67ee21d241f0"
Jul 20 05:04:01.885528 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.885483    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55f5bf4579-58cws"]
Jul 20 05:04:01.888552 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.888537    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:01.891706 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.891685    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 05:04:01.892368 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.892350    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 05:04:01.892475 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.892367    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 05:04:01.892475 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.892410    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-25rk9\""
Jul 20 05:04:01.892475 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.892414    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 05:04:01.892475 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.892427    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 05:04:01.892475 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.892469    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 05:04:01.892669 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.892575    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 05:04:01.897542 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.897522    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 05:04:01.898580 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.898562    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f5bf4579-58cws"]
Jul 20 05:04:01.984682 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.984650    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-serving-cert\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:01.984682 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.984685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-oauth-config\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:01.984917 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.984708    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7cq6\" (UniqueName: \"kubernetes.io/projected/6c3837ab-39db-4e71-ae5d-366b45d551fa-kube-api-access-g7cq6\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:01.984917 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.984732    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-service-ca\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:01.984917 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.984808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-trusted-ca-bundle\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:01.984917 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.984839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-config\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:01.984917 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:01.984859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-oauth-serving-cert\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:02.086248 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.086210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-service-ca\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:02.086248 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.086251    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-trusted-ca-bundle\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:02.086447 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.086274    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-config\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:02.086447 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.086290    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-oauth-serving-cert\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:02.086447 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.086347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-serving-cert\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:02.086447 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.086387    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-oauth-config\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:02.086447 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.086421    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7cq6\" (UniqueName: \"kubernetes.io/projected/6c3837ab-39db-4e71-ae5d-366b45d551fa-kube-api-access-g7cq6\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:02.087267 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.087170    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-oauth-serving-cert\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:02.087267 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.087175    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-service-ca\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:02.087267 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.087253    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-config\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:02.087621 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.087601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-trusted-ca-bundle\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:02.088997 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.088980    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-oauth-config\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:02.089206 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.089188    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-serving-cert\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:02.094160 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.094118    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7cq6\" (UniqueName: \"kubernetes.io/projected/6c3837ab-39db-4e71-ae5d-366b45d551fa-kube-api-access-g7cq6\") pod \"console-55f5bf4579-58cws\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") " pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:02.197712 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.197673    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:02.347853 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.347821    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f5bf4579-58cws"]
Jul 20 05:04:02.350815 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:04:02.350789    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3837ab_39db_4e71_ae5d_366b45d551fa.slice/crio-a9737cb8c62dfaf434ac18d192f466b3f4bea5cff93e05da1df29ad4953042a2 WatchSource:0}: Error finding container a9737cb8c62dfaf434ac18d192f466b3f4bea5cff93e05da1df29ad4953042a2: Status 404 returned error can't find the container with id a9737cb8c62dfaf434ac18d192f466b3f4bea5cff93e05da1df29ad4953042a2
Jul 20 05:04:02.537430 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:02.537350    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f5bf4579-58cws" event={"ID":"6c3837ab-39db-4e71-ae5d-366b45d551fa","Type":"ContainerStarted","Data":"a9737cb8c62dfaf434ac18d192f466b3f4bea5cff93e05da1df29ad4953042a2"}
Jul 20 05:04:05.072609 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:05.072586    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 05:04:05.516786 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:05.516762    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-khcvq"
Jul 20 05:04:05.549634 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:05.549596    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f5bf4579-58cws" event={"ID":"6c3837ab-39db-4e71-ae5d-366b45d551fa","Type":"ContainerStarted","Data":"db04f5a00b9f17bc438d218225d27cf7482b85de72f60981630375a260416026"}
Jul 20 05:04:05.566509 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:05.566460    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55f5bf4579-58cws" podStartSLOduration=1.523795171 podStartE2EDuration="4.566440518s" totalImagesPullingTime="3.042645347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:04:05.565174696 +0000 UTC m=+301.380668770" watchObservedRunningTime="2026-07-20 05:04:05.566440518 +0000 UTC m=+301.381934593"
Jul 20 05:04:06.455625 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.455589    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"]
Jul 20 05:04:06.499184 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.499156    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"]
Jul 20 05:04:06.499321 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.499267    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"
Jul 20 05:04:06.502063 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.502016    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 20 05:04:06.502063 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.502060    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 20 05:04:06.502377 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.502349    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 05:04:06.503268 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.503244    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 05:04:06.503449 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.503436    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6lx8j\""
Jul 20 05:04:06.503525 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.503502    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 05:04:06.626836 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.626796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b8317ee-3758-445b-8c6c-0490c71fce22-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-mm4xt\" (UID: \"3b8317ee-3758-445b-8c6c-0490c71fce22\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"
Jul 20 05:04:06.626836 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.626834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b8317ee-3758-445b-8c6c-0490c71fce22-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-mm4xt\" (UID: \"3b8317ee-3758-445b-8c6c-0490c71fce22\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"
Jul 20 05:04:06.627069 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.626860    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b8317ee-3758-445b-8c6c-0490c71fce22-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-mm4xt\" (UID: \"3b8317ee-3758-445b-8c6c-0490c71fce22\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"
Jul 20 05:04:06.627069 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.626903    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8sb7\" (UniqueName: \"kubernetes.io/projected/3b8317ee-3758-445b-8c6c-0490c71fce22-kube-api-access-h8sb7\") pod \"prometheus-operator-5945b5cfd-mm4xt\" (UID: \"3b8317ee-3758-445b-8c6c-0490c71fce22\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"
Jul 20 05:04:06.727843 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.727755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b8317ee-3758-445b-8c6c-0490c71fce22-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-mm4xt\" (UID: \"3b8317ee-3758-445b-8c6c-0490c71fce22\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"
Jul 20 05:04:06.727843 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.727797    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b8317ee-3758-445b-8c6c-0490c71fce22-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-mm4xt\" (UID: \"3b8317ee-3758-445b-8c6c-0490c71fce22\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"
Jul 20 05:04:06.727843 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.727839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b8317ee-3758-445b-8c6c-0490c71fce22-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-mm4xt\" (UID: \"3b8317ee-3758-445b-8c6c-0490c71fce22\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"
Jul 20 05:04:06.728147 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.727899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8sb7\" (UniqueName: \"kubernetes.io/projected/3b8317ee-3758-445b-8c6c-0490c71fce22-kube-api-access-h8sb7\") pod \"prometheus-operator-5945b5cfd-mm4xt\" (UID: \"3b8317ee-3758-445b-8c6c-0490c71fce22\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"
Jul 20 05:04:06.728501 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.728477    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b8317ee-3758-445b-8c6c-0490c71fce22-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-mm4xt\" (UID: \"3b8317ee-3758-445b-8c6c-0490c71fce22\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"
Jul 20 05:04:06.730550 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.730527    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b8317ee-3758-445b-8c6c-0490c71fce22-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-mm4xt\" (UID: \"3b8317ee-3758-445b-8c6c-0490c71fce22\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"
Jul 20 05:04:06.730635 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.730531    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b8317ee-3758-445b-8c6c-0490c71fce22-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-mm4xt\" (UID: \"3b8317ee-3758-445b-8c6c-0490c71fce22\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"
Jul 20 05:04:06.735069 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.735043    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8sb7\" (UniqueName: \"kubernetes.io/projected/3b8317ee-3758-445b-8c6c-0490c71fce22-kube-api-access-h8sb7\") pod \"prometheus-operator-5945b5cfd-mm4xt\" (UID: \"3b8317ee-3758-445b-8c6c-0490c71fce22\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"
Jul 20 05:04:06.808472 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.808437    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"
Jul 20 05:04:06.988480 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.988413    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt"]
Jul 20 05:04:06.995088 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:06.995069    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 05:04:07.557656 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:07.557628    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt" event={"ID":"3b8317ee-3758-445b-8c6c-0490c71fce22","Type":"ContainerStarted","Data":"6dbdf913207325fca8f90501612908f1d9b88563dca80d3386ed2831efd451d4"}
Jul 20 05:04:09.566027 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:09.565993    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt" event={"ID":"3b8317ee-3758-445b-8c6c-0490c71fce22","Type":"ContainerStarted","Data":"619a935d7e91bef18440ccd19de97063fc5be861c8c10543932807dbfd03b16b"}
Jul 20 05:04:09.566452 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:09.566043    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt" event={"ID":"3b8317ee-3758-445b-8c6c-0490c71fce22","Type":"ContainerStarted","Data":"831d5a25caf89b6c369211134bf4c9342ffe29bcd0b0adfb3ec32efeeff59f99"}
Jul 20 05:04:09.582412 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:09.582369    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-mm4xt" podStartSLOduration=1.712243701 podStartE2EDuration="3.582353618s" totalImagesPullingTime="1.870109917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:04:09.581167257 +0000 UTC m=+305.396661344" watchObservedRunningTime="2026-07-20 05:04:09.582353618 +0000 UTC m=+305.397847689"
Jul 20 05:04:09.786820 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:09.786770    2576 patch_prober.go:28] interesting pod/image-registry-7c8bcd566-2mq6z container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 20 05:04:09.787018 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:09.786829    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z" podUID="09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 05:04:11.806346 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:11.806310    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gvglj"]
Jul 20 05:04:11.808518 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:11.808498    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:11.810984 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:11.810963    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wkpjg\""
Jul 20 05:04:11.811102 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:11.810966    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 05:04:11.811102 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:11.811021    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 05:04:11.811102 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:11.811083    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 05:04:11.970669 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:11.970632    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-metrics-client-ca\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:11.970859 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:11.970718    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:11.970859 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:11.970738    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djmcb\" (UniqueName: \"kubernetes.io/projected/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-kube-api-access-djmcb\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:11.970859 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:11.970764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-sys\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:11.970859 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:11.970780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-tls\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:11.971026 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:11.970859    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-wtmp\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:11.971026 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:11.970921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-textfile\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:11.971026 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:11.970939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-accelerators-collector-config\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:11.971026 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:11.970956    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-root\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.072176 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.072087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.072176 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.072124    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djmcb\" (UniqueName: \"kubernetes.io/projected/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-kube-api-access-djmcb\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.072176 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.072147    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-sys\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.072176 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.072169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-tls\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.072487 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.072199    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-wtmp\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.072487 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.072230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-textfile\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.072487 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.072241    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-sys\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.072487 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.072252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-accelerators-collector-config\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.072487 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:04:12.072294    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 20 05:04:12.072487 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.072312    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-root\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.072487 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.072347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-metrics-client-ca\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.072487 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.072356    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-wtmp\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.072487 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:04:12.072365    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-tls podName:56bc4d30-7a21-4f9b-88fb-5a6d84c4b022 nodeName:}" failed. No retries permitted until 2026-07-20 05:04:12.572348072 +0000 UTC m=+308.387842125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-tls") pod "node-exporter-gvglj" (UID: "56bc4d30-7a21-4f9b-88fb-5a6d84c4b022") : secret "node-exporter-tls" not found
Jul 20 05:04:12.072487 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.072427    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-root\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.072859 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.072630    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-textfile\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.072859 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.072837    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-metrics-client-ca\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.072955 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.072859    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-accelerators-collector-config\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.074564 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.074542    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.079793 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.079773    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djmcb\" (UniqueName: \"kubernetes.io/projected/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-kube-api-access-djmcb\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.198504 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.198472    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:12.198655 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.198532    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:12.203034 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.203012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:12.500837 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.500807    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 05:04:12.577263 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.577231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-tls\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.580165 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.580143    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56bc4d30-7a21-4f9b-88fb-5a6d84c4b022-node-exporter-tls\") pod \"node-exporter-gvglj\" (UID: \"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022\") " pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.585796 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.585780    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:12.675203 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.675170    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 05:04:12.717628 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:12.717603    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gvglj"
Jul 20 05:04:12.727122 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:04:12.727098    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56bc4d30_7a21_4f9b_88fb_5a6d84c4b022.slice/crio-cf0bb960c8439b475210f915fdc1f1dcbf419f700595a8073f1c2463910cc13b WatchSource:0}: Error finding container cf0bb960c8439b475210f915fdc1f1dcbf419f700595a8073f1c2463910cc13b: Status 404 returned error can't find the container with id cf0bb960c8439b475210f915fdc1f1dcbf419f700595a8073f1c2463910cc13b
Jul 20 05:04:13.587470 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:13.587439    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gvglj" event={"ID":"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022","Type":"ContainerStarted","Data":"cf0bb960c8439b475210f915fdc1f1dcbf419f700595a8073f1c2463910cc13b"}
Jul 20 05:04:14.592532 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:14.592496    2576 generic.go:356] "Generic (PLEG): container finished" podID="56bc4d30-7a21-4f9b-88fb-5a6d84c4b022" containerID="b06a0c5c0b0f2117cfdd72f64f5e0419c4efc1f0a81e100c7265ad57908b022c" exitCode=0
Jul 20 05:04:14.592994 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:14.592583    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gvglj" event={"ID":"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022","Type":"ContainerDied","Data":"b06a0c5c0b0f2117cfdd72f64f5e0419c4efc1f0a81e100c7265ad57908b022c"}
Jul 20 05:04:15.598460 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:15.598426    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gvglj" event={"ID":"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022","Type":"ContainerStarted","Data":"a5ca031557ff58b55f76bc4057ad9e679bdfd5a7ef89b59b2759682440fe73c1"}
Jul 20 05:04:15.598838 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:15.598505    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gvglj" event={"ID":"56bc4d30-7a21-4f9b-88fb-5a6d84c4b022","Type":"ContainerStarted","Data":"12f68872531641ce909b1ce44ba0dc0e728a9050b3ccd0e37c3393e468abdfec"}
Jul 20 05:04:15.617555 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:15.617512    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gvglj" podStartSLOduration=3.488020294 podStartE2EDuration="4.617496365s" totalImagesPullingTime="1.058706121s" totalInitContainerRuntime="70.76995ms" isStatefulPod=true podCreationTimestamp="2026-07-20 05:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:04:15.616337616 +0000 UTC m=+311.431831713" watchObservedRunningTime="2026-07-20 05:04:15.617496365 +0000 UTC m=+311.432990458"
Jul 20 05:04:16.607436 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.607406    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dbfc44594-2m2cz"]
Jul 20 05:04:16.609288 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.609269    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.620749 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.620730    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dbfc44594-2m2cz"]
Jul 20 05:04:16.650146 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.650121    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c8bcd566-2mq6z"]
Jul 20 05:04:16.709628 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.709593    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84a8eaea-3a98-4433-a078-b584e424da44-console-oauth-config\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.709793 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.709644    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99g8g\" (UniqueName: \"kubernetes.io/projected/84a8eaea-3a98-4433-a078-b584e424da44-kube-api-access-99g8g\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.709793 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.709666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84a8eaea-3a98-4433-a078-b584e424da44-console-serving-cert\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.709944 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.709797    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-trusted-ca-bundle\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.709944 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.709923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-console-config\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.710057 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.709964    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-service-ca\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.710057 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.709990    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-oauth-serving-cert\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.810650 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.810623    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-service-ca\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.810650 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.810653    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-oauth-serving-cert\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.810903 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.810672    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84a8eaea-3a98-4433-a078-b584e424da44-console-oauth-config\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.810903 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.810696    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99g8g\" (UniqueName: \"kubernetes.io/projected/84a8eaea-3a98-4433-a078-b584e424da44-kube-api-access-99g8g\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.810903 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.810730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84a8eaea-3a98-4433-a078-b584e424da44-console-serving-cert\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.810903 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.810766    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-trusted-ca-bundle\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.810903 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.810838    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-console-config\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.811541 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.811443    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-service-ca\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.811541 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.811481    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-oauth-serving-cert\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.811541 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.811490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-console-config\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.811985 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.811958    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-trusted-ca-bundle\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.813311 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.813284    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84a8eaea-3a98-4433-a078-b584e424da44-console-oauth-config\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.813455 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.813434    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84a8eaea-3a98-4433-a078-b584e424da44-console-serving-cert\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.818327 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.818308    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99g8g\" (UniqueName: \"kubernetes.io/projected/84a8eaea-3a98-4433-a078-b584e424da44-kube-api-access-99g8g\") pod \"console-6dbfc44594-2m2cz\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") " pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.918385 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.918305    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:16.999399 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:16.999374    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"]
Jul 20 05:04:17.001925 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.001908    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.004702 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.004675    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 20 05:04:17.006102 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.006082    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 20 05:04:17.006312 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.006292    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 20 05:04:17.006574 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.006555    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cfrjv\""
Jul 20 05:04:17.006720 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.006700    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 20 05:04:17.006850 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.006831    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 20 05:04:17.011693 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.011675    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e5bba51e-5a32-4e8c-98cc-d393af156522-secret-telemeter-client\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.011794 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.011702    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5bba51e-5a32-4e8c-98cc-d393af156522-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.011794 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.011724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5bba51e-5a32-4e8c-98cc-d393af156522-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.011794 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.011741    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e5bba51e-5a32-4e8c-98cc-d393af156522-telemeter-client-tls\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.011794 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.011766    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5bba51e-5a32-4e8c-98cc-d393af156522-metrics-client-ca\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.011794 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.011781    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjw55\" (UniqueName: \"kubernetes.io/projected/e5bba51e-5a32-4e8c-98cc-d393af156522-kube-api-access-mjw55\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.012085 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.012062    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5bba51e-5a32-4e8c-98cc-d393af156522-serving-certs-ca-bundle\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.012151 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.012137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e5bba51e-5a32-4e8c-98cc-d393af156522-federate-client-tls\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.013129 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.013105    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 20 05:04:17.017699 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.017678    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"]
Jul 20 05:04:17.052213 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.052191    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dbfc44594-2m2cz"]
Jul 20 05:04:17.054757 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:04:17.054734    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84a8eaea_3a98_4433_a078_b584e424da44.slice/crio-6c0217677b89f61d56602dd121c81c553aff1ae6ead0a3afc4508d5af5f6f8c5 WatchSource:0}: Error finding container 6c0217677b89f61d56602dd121c81c553aff1ae6ead0a3afc4508d5af5f6f8c5: Status 404 returned error can't find the container with id 6c0217677b89f61d56602dd121c81c553aff1ae6ead0a3afc4508d5af5f6f8c5
Jul 20 05:04:17.113326 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.113306    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5bba51e-5a32-4e8c-98cc-d393af156522-serving-certs-ca-bundle\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.113431 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.113348    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e5bba51e-5a32-4e8c-98cc-d393af156522-federate-client-tls\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.113431 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.113383    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e5bba51e-5a32-4e8c-98cc-d393af156522-secret-telemeter-client\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.113431 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.113400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5bba51e-5a32-4e8c-98cc-d393af156522-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.113431 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.113423    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5bba51e-5a32-4e8c-98cc-d393af156522-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.113630 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.113449    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e5bba51e-5a32-4e8c-98cc-d393af156522-telemeter-client-tls\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.113630 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.113477    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5bba51e-5a32-4e8c-98cc-d393af156522-metrics-client-ca\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.113630 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.113503    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjw55\" (UniqueName: \"kubernetes.io/projected/e5bba51e-5a32-4e8c-98cc-d393af156522-kube-api-access-mjw55\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.114102 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.114074    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5bba51e-5a32-4e8c-98cc-d393af156522-serving-certs-ca-bundle\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.114260 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.114239    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5bba51e-5a32-4e8c-98cc-d393af156522-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.114596 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.114576    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5bba51e-5a32-4e8c-98cc-d393af156522-metrics-client-ca\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.116581 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.116556    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e5bba51e-5a32-4e8c-98cc-d393af156522-federate-client-tls\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.116662 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.116617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5bba51e-5a32-4e8c-98cc-d393af156522-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.116699 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.116663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e5bba51e-5a32-4e8c-98cc-d393af156522-telemeter-client-tls\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.116699 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.116674    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e5bba51e-5a32-4e8c-98cc-d393af156522-secret-telemeter-client\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.121088 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.121070    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjw55\" (UniqueName: \"kubernetes.io/projected/e5bba51e-5a32-4e8c-98cc-d393af156522-kube-api-access-mjw55\") pod \"telemeter-client-7dff8f57f5-mnlrm\" (UID: \"e5bba51e-5a32-4e8c-98cc-d393af156522\") " pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.313803 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.313770    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"
Jul 20 05:04:17.442917 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.442864    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm"]
Jul 20 05:04:17.445496 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:04:17.445468    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5bba51e_5a32_4e8c_98cc_d393af156522.slice/crio-ac7109e8b6cd8faa5171fef5e5a9dde6a34418b31099826400f27551aab33302 WatchSource:0}: Error finding container ac7109e8b6cd8faa5171fef5e5a9dde6a34418b31099826400f27551aab33302: Status 404 returned error can't find the container with id ac7109e8b6cd8faa5171fef5e5a9dde6a34418b31099826400f27551aab33302
Jul 20 05:04:17.606933 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.606820    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm" event={"ID":"e5bba51e-5a32-4e8c-98cc-d393af156522","Type":"ContainerStarted","Data":"ac7109e8b6cd8faa5171fef5e5a9dde6a34418b31099826400f27551aab33302"}
Jul 20 05:04:17.608296 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.608276    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbfc44594-2m2cz" event={"ID":"84a8eaea-3a98-4433-a078-b584e424da44","Type":"ContainerStarted","Data":"d7606284000a063548e67cefc935a7b5bc97d9322283e6416a1210a6ad8eb929"}
Jul 20 05:04:17.608607 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.608310    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbfc44594-2m2cz" event={"ID":"84a8eaea-3a98-4433-a078-b584e424da44","Type":"ContainerStarted","Data":"6c0217677b89f61d56602dd121c81c553aff1ae6ead0a3afc4508d5af5f6f8c5"}
Jul 20 05:04:17.626148 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.626105    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dbfc44594-2m2cz" podStartSLOduration=1.626091772 podStartE2EDuration="1.626091772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:04:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:04:17.624774579 +0000 UTC m=+313.440268650" watchObservedRunningTime="2026-07-20 05:04:17.626091772 +0000 UTC m=+313.441585843"
Jul 20 05:04:17.981470 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.981435    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 05:04:17.985274 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.985251    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:17.987730 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.987711    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 20 05:04:17.988153 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.988130    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 20 05:04:17.988293 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.988272    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 20 05:04:17.988375 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.988319    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 20 05:04:17.988375 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.988343    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 20 05:04:17.988480 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.988397    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 20 05:04:17.988480 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.988416    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 20 05:04:17.988567 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.988544    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5l3gpsrvggrd5\""
Jul 20 05:04:17.989646 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.989622    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 20 05:04:17.989646 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.989631    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 20 05:04:17.989802 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.989687    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 20 05:04:17.989802 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.989703    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 20 05:04:17.990045 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.990025    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-84w6g\""
Jul 20 05:04:17.990285 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.990266    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 20 05:04:17.990374 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.990359    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 20 05:04:17.990501 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.990483    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 20 05:04:17.992709 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:17.992691    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 20 05:04:18.000051 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.000030    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 05:04:18.019841 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.019816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f627c787-0db2-4607-b9dd-ecde8e76922f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020014 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.019848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020014 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.019868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020014 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.019939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f627c787-0db2-4607-b9dd-ecde8e76922f-config-out\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020014 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.019959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020014 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.019973    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020248 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.020064    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f627c787-0db2-4607-b9dd-ecde8e76922f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020248 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.020099    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhsqb\" (UniqueName: \"kubernetes.io/projected/f627c787-0db2-4607-b9dd-ecde8e76922f-kube-api-access-qhsqb\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020248 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.020143    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020248 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.020199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020248 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.020221    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020447 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.020254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-config\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020447 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.020274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020447 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.020308    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020447 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.020330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-web-config\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020447 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.020344    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020447 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.020362    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020447 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.020382    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020447 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.020409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.020447 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.020441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.121260 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.121224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.121260 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.121259    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.121488 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.121285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f627c787-0db2-4607-b9dd-ecde8e76922f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.121488 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.121408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhsqb\" (UniqueName: \"kubernetes.io/projected/f627c787-0db2-4607-b9dd-ecde8e76922f-kube-api-access-qhsqb\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.121488 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.121456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.121488 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.121487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.121685 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.121600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.121685 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.121638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-config\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.121685 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.121666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.121685 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.121679    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f627c787-0db2-4607-b9dd-ecde8e76922f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.121907 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.121701    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.122157 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.122132    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.122245 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.122159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-web-config\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.122245 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.122195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.122245 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.122227    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.122399 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.122252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.122399 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.122277    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.122399 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.122307    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.122399 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.122363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f627c787-0db2-4607-b9dd-ecde8e76922f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.122399 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.122390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.122627 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.122416    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.122627 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.122479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f627c787-0db2-4607-b9dd-ecde8e76922f-config-out\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.122730 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.122636    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.122840 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.122809    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.123167 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.123142    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.123577 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.123258    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.123577 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.123283    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.125825 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.125799    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-config\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.126139 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.126115    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.126805 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.126769    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-web-config\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.126912 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.126859    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.126912 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.126865    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f627c787-0db2-4607-b9dd-ecde8e76922f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.127484 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.127462    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.127594 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.127558    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.127594 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.127578    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.127690 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.127605    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.127778 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.127762    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f627c787-0db2-4607-b9dd-ecde8e76922f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.127990 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.127974    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f627c787-0db2-4607-b9dd-ecde8e76922f-config-out\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.128635 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.128617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f627c787-0db2-4607-b9dd-ecde8e76922f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.129887 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.129860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhsqb\" (UniqueName: \"kubernetes.io/projected/f627c787-0db2-4607-b9dd-ecde8e76922f-kube-api-access-qhsqb\") pod \"prometheus-k8s-0\" (UID: \"f627c787-0db2-4607-b9dd-ecde8e76922f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.297716 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.297640    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:18.460946 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.460703    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 20 05:04:18.462550 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:04:18.462524    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf627c787_0db2_4607_b9dd_ecde8e76922f.slice/crio-faa281397e8a4ad441a99d9ea7ed69c3125ea3e37fa3db29c49abb7767dc03de WatchSource:0}: Error finding container faa281397e8a4ad441a99d9ea7ed69c3125ea3e37fa3db29c49abb7767dc03de: Status 404 returned error can't find the container with id faa281397e8a4ad441a99d9ea7ed69c3125ea3e37fa3db29c49abb7767dc03de
Jul 20 05:04:18.613811 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:18.613723    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f627c787-0db2-4607-b9dd-ecde8e76922f","Type":"ContainerStarted","Data":"faa281397e8a4ad441a99d9ea7ed69c3125ea3e37fa3db29c49abb7767dc03de"}
Jul 20 05:04:20.624357 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:20.624278    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm" event={"ID":"e5bba51e-5a32-4e8c-98cc-d393af156522","Type":"ContainerStarted","Data":"9c3781b28afa01fc8c084e0a4eed640511e1c75276f94077d9171d28c5953ffc"}
Jul 20 05:04:20.624816 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:20.624384    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm" event={"ID":"e5bba51e-5a32-4e8c-98cc-d393af156522","Type":"ContainerStarted","Data":"6865d83cd9fc2adaf57556dbd8c0882440492b9da2addccadc1ff109bd378779"}
Jul 20 05:04:20.624816 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:20.624407    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm" event={"ID":"e5bba51e-5a32-4e8c-98cc-d393af156522","Type":"ContainerStarted","Data":"6d57f44516c480d96df25dc79a4b3a90c64ee065339df58cc09cfeb527a8def7"}
Jul 20 05:04:20.625931 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:20.625863    2576 generic.go:356] "Generic (PLEG): container finished" podID="f627c787-0db2-4607-b9dd-ecde8e76922f" containerID="17550e9a75849d4559f6b4bd1f972c90cde70ab69b9aea29a779f85ff9622e41" exitCode=0
Jul 20 05:04:20.626065 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:20.625911    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f627c787-0db2-4607-b9dd-ecde8e76922f","Type":"ContainerDied","Data":"17550e9a75849d4559f6b4bd1f972c90cde70ab69b9aea29a779f85ff9622e41"}
Jul 20 05:04:20.647555 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:20.647497    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7dff8f57f5-mnlrm" podStartSLOduration=2.4763229 podStartE2EDuration="4.647478963s" totalImagesPullingTime="2.171156063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:04:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:04:20.646409412 +0000 UTC m=+316.461903485" watchObservedRunningTime="2026-07-20 05:04:20.647478963 +0000 UTC m=+316.462973036"
Jul 20 05:04:21.337484 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:21.337442    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dbfc44594-2m2cz"]
Jul 20 05:04:24.646901 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:24.646843    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f627c787-0db2-4607-b9dd-ecde8e76922f","Type":"ContainerStarted","Data":"99a473d3f85468894df603c7982677ee80fd32d11419a2ccdabb6805b367662a"}
Jul 20 05:04:24.647340 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:24.646985    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f627c787-0db2-4607-b9dd-ecde8e76922f","Type":"ContainerStarted","Data":"15bd0391c8e70450cc2b0e1b1ce026dcd05a6f34f4ca46b4c324f8c0f4d3d3ed"}
Jul 20 05:04:25.654395 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:25.654360    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f627c787-0db2-4607-b9dd-ecde8e76922f","Type":"ContainerStarted","Data":"94219ca0465966e34f7b1b5cca3261cf8f18751bd312651ddbc15eeebc93264e"}
Jul 20 05:04:26.661446 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:26.661416    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f627c787-0db2-4607-b9dd-ecde8e76922f","Type":"ContainerStarted","Data":"c8a005c8da6fdc3837ba787bc0e08e954ed93f4fa140f41ef3ac53112ddc5b78"}
Jul 20 05:04:26.661942 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:26.661488    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f627c787-0db2-4607-b9dd-ecde8e76922f","Type":"ContainerStarted","Data":"0b0025b986d9e2290cf7cd2fb69957e7aacdb6a7215c3bcd4527feb819658b39"}
Jul 20 05:04:26.661942 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:26.661524    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f627c787-0db2-4607-b9dd-ecde8e76922f","Type":"ContainerStarted","Data":"3adef51d2092937d34fc1a7a74d9c6ec0f447c61fc0da4ce968bd492911ed413"}
Jul 20 05:04:26.689733 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:26.689676    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.698785063 podStartE2EDuration="9.689655831s" totalImagesPullingTime="5.96792794s" totalInitContainerRuntime="22.942828ms" isStatefulPod=false podCreationTimestamp="2026-07-20 05:04:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:04:26.687300432 +0000 UTC m=+322.502794501" watchObservedRunningTime="2026-07-20 05:04:26.689655831 +0000 UTC m=+322.505149904"
Jul 20 05:04:26.918963 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:26.918863    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:28.297951 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:28.297914    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:04:31.856292 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:31.856261    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f5bf4579-58cws"]
Jul 20 05:04:41.676573 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:41.676508    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z" podUID="09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46" containerName="registry" containerID="cri-o://9ef1d0df1ac401230801cba674c332c2c021aeeb6007ec9bc0ba0d412249e8b7" gracePeriod=30
Jul 20 05:04:41.930978 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:41.930924    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 05:04:42.041081 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.041049    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-image-registry-private-configuration\") pod \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") "
Jul 20 05:04:42.041247 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.041102    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-ca-trust-extracted\") pod \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") "
Jul 20 05:04:42.041247 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.041122    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls\") pod \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") "
Jul 20 05:04:42.041247 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.041170    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-certificates\") pod \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") "
Jul 20 05:04:42.041247 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.041200    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-bound-sa-token\") pod \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") "
Jul 20 05:04:42.041247 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.041244    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-trusted-ca\") pod \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") "
Jul 20 05:04:42.041500 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.041279    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxsc9\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-kube-api-access-vxsc9\") pod \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") "
Jul 20 05:04:42.041500 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.041305    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-installation-pull-secrets\") pod \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\" (UID: \"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46\") "
Jul 20 05:04:42.041753 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.041683    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:04:42.041925 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.041795    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:04:42.044045 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.044016    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:04:42.044141 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.044066    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:04:42.044216 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.044187    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-kube-api-access-vxsc9" (OuterVolumeSpecName: "kube-api-access-vxsc9") pod "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46"). InnerVolumeSpecName "kube-api-access-vxsc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:04:42.044268 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.044193    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:04:42.044362 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.044337    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:04:42.051488 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.051467    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46" (UID: "09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:04:42.142617 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.142576    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-ca-trust-extracted\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:42.142617 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.142612    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-tls\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:42.142617 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.142622    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-registry-certificates\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:42.142617 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.142632    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-bound-sa-token\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:42.142839 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.142640    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-trusted-ca\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:42.142839 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.142648    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxsc9\" (UniqueName: \"kubernetes.io/projected/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-kube-api-access-vxsc9\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:42.142839 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.142657    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-installation-pull-secrets\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:42.142839 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.142665    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46-image-registry-private-configuration\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:42.719821 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.719795    2576 generic.go:356] "Generic (PLEG): container finished" podID="09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46" containerID="9ef1d0df1ac401230801cba674c332c2c021aeeb6007ec9bc0ba0d412249e8b7" exitCode=0
Jul 20 05:04:42.720248 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.719831    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z" event={"ID":"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46","Type":"ContainerDied","Data":"9ef1d0df1ac401230801cba674c332c2c021aeeb6007ec9bc0ba0d412249e8b7"}
Jul 20 05:04:42.720248 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.719849    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z"
Jul 20 05:04:42.720248 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.719864    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c8bcd566-2mq6z" event={"ID":"09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46","Type":"ContainerDied","Data":"12d2a264c9220f46fe628584f20462a0b9bb620b758e639aa59536e7f771399c"}
Jul 20 05:04:42.720248 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.719912    2576 scope.go:117] "RemoveContainer" containerID="9ef1d0df1ac401230801cba674c332c2c021aeeb6007ec9bc0ba0d412249e8b7"
Jul 20 05:04:42.728804 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.728781    2576 scope.go:117] "RemoveContainer" containerID="9ef1d0df1ac401230801cba674c332c2c021aeeb6007ec9bc0ba0d412249e8b7"
Jul 20 05:04:42.729091 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:04:42.729072    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ef1d0df1ac401230801cba674c332c2c021aeeb6007ec9bc0ba0d412249e8b7\": container with ID starting with 9ef1d0df1ac401230801cba674c332c2c021aeeb6007ec9bc0ba0d412249e8b7 not found: ID does not exist" containerID="9ef1d0df1ac401230801cba674c332c2c021aeeb6007ec9bc0ba0d412249e8b7"
Jul 20 05:04:42.729165 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.729100    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ef1d0df1ac401230801cba674c332c2c021aeeb6007ec9bc0ba0d412249e8b7"} err="failed to get container status \"9ef1d0df1ac401230801cba674c332c2c021aeeb6007ec9bc0ba0d412249e8b7\": rpc error: code = NotFound desc = could not find container \"9ef1d0df1ac401230801cba674c332c2c021aeeb6007ec9bc0ba0d412249e8b7\": container with ID starting with 9ef1d0df1ac401230801cba674c332c2c021aeeb6007ec9bc0ba0d412249e8b7 not found: ID does not exist"
Jul 20 05:04:42.736274 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.736254    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c8bcd566-2mq6z"]
Jul 20 05:04:42.739952 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:42.739934    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c8bcd566-2mq6z"]
Jul 20 05:04:44.679826 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:44.679794    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46" path="/var/lib/kubelet/pods/09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46/volumes"
Jul 20 05:04:46.365001 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.364942    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6dbfc44594-2m2cz" podUID="84a8eaea-3a98-4433-a078-b584e424da44" containerName="console" containerID="cri-o://d7606284000a063548e67cefc935a7b5bc97d9322283e6416a1210a6ad8eb929" gracePeriod=15
Jul 20 05:04:46.609549 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.609528    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:46.679245 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.679171    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84a8eaea-3a98-4433-a078-b584e424da44-console-oauth-config\") pod \"84a8eaea-3a98-4433-a078-b584e424da44\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") "
Jul 20 05:04:46.679245 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.679205    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99g8g\" (UniqueName: \"kubernetes.io/projected/84a8eaea-3a98-4433-a078-b584e424da44-kube-api-access-99g8g\") pod \"84a8eaea-3a98-4433-a078-b584e424da44\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") "
Jul 20 05:04:46.679245 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.679242    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-trusted-ca-bundle\") pod \"84a8eaea-3a98-4433-a078-b584e424da44\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") "
Jul 20 05:04:46.679497 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.679269    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-console-config\") pod \"84a8eaea-3a98-4433-a078-b584e424da44\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") "
Jul 20 05:04:46.679497 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.679301    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-service-ca\") pod \"84a8eaea-3a98-4433-a078-b584e424da44\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") "
Jul 20 05:04:46.679497 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.679333    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84a8eaea-3a98-4433-a078-b584e424da44-console-serving-cert\") pod \"84a8eaea-3a98-4433-a078-b584e424da44\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") "
Jul 20 05:04:46.679497 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.679397    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-oauth-serving-cert\") pod \"84a8eaea-3a98-4433-a078-b584e424da44\" (UID: \"84a8eaea-3a98-4433-a078-b584e424da44\") "
Jul 20 05:04:46.679870 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.679738    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-service-ca" (OuterVolumeSpecName: "service-ca") pod "84a8eaea-3a98-4433-a078-b584e424da44" (UID: "84a8eaea-3a98-4433-a078-b584e424da44"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:04:46.679870 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.679862    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-console-config" (OuterVolumeSpecName: "console-config") pod "84a8eaea-3a98-4433-a078-b584e424da44" (UID: "84a8eaea-3a98-4433-a078-b584e424da44"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:04:46.680088 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.679943    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "84a8eaea-3a98-4433-a078-b584e424da44" (UID: "84a8eaea-3a98-4433-a078-b584e424da44"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:04:46.680088 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.679940    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "84a8eaea-3a98-4433-a078-b584e424da44" (UID: "84a8eaea-3a98-4433-a078-b584e424da44"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:04:46.681827 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.681804    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a8eaea-3a98-4433-a078-b584e424da44-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "84a8eaea-3a98-4433-a078-b584e424da44" (UID: "84a8eaea-3a98-4433-a078-b584e424da44"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:04:46.682051 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.682029    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a8eaea-3a98-4433-a078-b584e424da44-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "84a8eaea-3a98-4433-a078-b584e424da44" (UID: "84a8eaea-3a98-4433-a078-b584e424da44"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:04:46.682051 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.682037    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84a8eaea-3a98-4433-a078-b584e424da44-kube-api-access-99g8g" (OuterVolumeSpecName: "kube-api-access-99g8g") pod "84a8eaea-3a98-4433-a078-b584e424da44" (UID: "84a8eaea-3a98-4433-a078-b584e424da44"). InnerVolumeSpecName "kube-api-access-99g8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:04:46.735449 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.735416    2576 generic.go:356] "Generic (PLEG): container finished" podID="84a8eaea-3a98-4433-a078-b584e424da44" containerID="d7606284000a063548e67cefc935a7b5bc97d9322283e6416a1210a6ad8eb929" exitCode=0
Jul 20 05:04:46.735611 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.735463    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbfc44594-2m2cz"
Jul 20 05:04:46.735611 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.735493    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbfc44594-2m2cz" event={"ID":"84a8eaea-3a98-4433-a078-b584e424da44","Type":"ContainerDied","Data":"d7606284000a063548e67cefc935a7b5bc97d9322283e6416a1210a6ad8eb929"}
Jul 20 05:04:46.735611 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.735530    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbfc44594-2m2cz" event={"ID":"84a8eaea-3a98-4433-a078-b584e424da44","Type":"ContainerDied","Data":"6c0217677b89f61d56602dd121c81c553aff1ae6ead0a3afc4508d5af5f6f8c5"}
Jul 20 05:04:46.735611 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.735549    2576 scope.go:117] "RemoveContainer" containerID="d7606284000a063548e67cefc935a7b5bc97d9322283e6416a1210a6ad8eb929"
Jul 20 05:04:46.744649 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.744628    2576 scope.go:117] "RemoveContainer" containerID="d7606284000a063548e67cefc935a7b5bc97d9322283e6416a1210a6ad8eb929"
Jul 20 05:04:46.745683 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:04:46.745655    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7606284000a063548e67cefc935a7b5bc97d9322283e6416a1210a6ad8eb929\": container with ID starting with d7606284000a063548e67cefc935a7b5bc97d9322283e6416a1210a6ad8eb929 not found: ID does not exist" containerID="d7606284000a063548e67cefc935a7b5bc97d9322283e6416a1210a6ad8eb929"
Jul 20 05:04:46.745774 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.745695    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7606284000a063548e67cefc935a7b5bc97d9322283e6416a1210a6ad8eb929"} err="failed to get container status \"d7606284000a063548e67cefc935a7b5bc97d9322283e6416a1210a6ad8eb929\": rpc error: code = NotFound desc = could not find container \"d7606284000a063548e67cefc935a7b5bc97d9322283e6416a1210a6ad8eb929\": container with ID starting with d7606284000a063548e67cefc935a7b5bc97d9322283e6416a1210a6ad8eb929 not found: ID does not exist"
Jul 20 05:04:46.755046 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.755025    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dbfc44594-2m2cz"]
Jul 20 05:04:46.758344 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.758323    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dbfc44594-2m2cz"]
Jul 20 05:04:46.780520 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.780499    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-service-ca\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:46.780596 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.780522    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84a8eaea-3a98-4433-a078-b584e424da44-console-serving-cert\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:46.780596 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.780533    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-oauth-serving-cert\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:46.780596 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.780544    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84a8eaea-3a98-4433-a078-b584e424da44-console-oauth-config\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:46.780596 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.780553    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99g8g\" (UniqueName: \"kubernetes.io/projected/84a8eaea-3a98-4433-a078-b584e424da44-kube-api-access-99g8g\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:46.780596 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.780564    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-trusted-ca-bundle\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:46.780596 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:46.780572    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84a8eaea-3a98-4433-a078-b584e424da44-console-config\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:48.679308 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:48.679274    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84a8eaea-3a98-4433-a078-b584e424da44" path="/var/lib/kubelet/pods/84a8eaea-3a98-4433-a078-b584e424da44/volumes"
Jul 20 05:04:56.876794 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:56.876711    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55f5bf4579-58cws" podUID="6c3837ab-39db-4e71-ae5d-366b45d551fa" containerName="console" containerID="cri-o://db04f5a00b9f17bc438d218225d27cf7482b85de72f60981630375a260416026" gracePeriod=15
Jul 20 05:04:57.145264 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.145235    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:57.272171 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.272131    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-trusted-ca-bundle\") pod \"6c3837ab-39db-4e71-ae5d-366b45d551fa\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") "
Jul 20 05:04:57.272349 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.272271    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-oauth-config\") pod \"6c3837ab-39db-4e71-ae5d-366b45d551fa\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") "
Jul 20 05:04:57.272349 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.272313    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7cq6\" (UniqueName: \"kubernetes.io/projected/6c3837ab-39db-4e71-ae5d-366b45d551fa-kube-api-access-g7cq6\") pod \"6c3837ab-39db-4e71-ae5d-366b45d551fa\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") "
Jul 20 05:04:57.272465 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.272360    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-config\") pod \"6c3837ab-39db-4e71-ae5d-366b45d551fa\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") "
Jul 20 05:04:57.273328 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.272655    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-oauth-serving-cert\") pod \"6c3837ab-39db-4e71-ae5d-366b45d551fa\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") "
Jul 20 05:04:57.273328 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.272670    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6c3837ab-39db-4e71-ae5d-366b45d551fa" (UID: "6c3837ab-39db-4e71-ae5d-366b45d551fa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:04:57.273328 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.272710    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-service-ca\") pod \"6c3837ab-39db-4e71-ae5d-366b45d551fa\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") "
Jul 20 05:04:57.273328 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.272769    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-serving-cert\") pod \"6c3837ab-39db-4e71-ae5d-366b45d551fa\" (UID: \"6c3837ab-39db-4e71-ae5d-366b45d551fa\") "
Jul 20 05:04:57.273328 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.272820    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-config" (OuterVolumeSpecName: "console-config") pod "6c3837ab-39db-4e71-ae5d-366b45d551fa" (UID: "6c3837ab-39db-4e71-ae5d-366b45d551fa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:04:57.273328 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.272959    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6c3837ab-39db-4e71-ae5d-366b45d551fa" (UID: "6c3837ab-39db-4e71-ae5d-366b45d551fa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:04:57.273328 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.273052    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-service-ca" (OuterVolumeSpecName: "service-ca") pod "6c3837ab-39db-4e71-ae5d-366b45d551fa" (UID: "6c3837ab-39db-4e71-ae5d-366b45d551fa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:04:57.273328 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.273250    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-config\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:57.273328 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.273271    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-oauth-serving-cert\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:57.273328 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.273286    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-service-ca\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:57.273328 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.273300    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c3837ab-39db-4e71-ae5d-366b45d551fa-trusted-ca-bundle\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:57.274793 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.274742    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6c3837ab-39db-4e71-ae5d-366b45d551fa" (UID: "6c3837ab-39db-4e71-ae5d-366b45d551fa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:04:57.275070 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.275043    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6c3837ab-39db-4e71-ae5d-366b45d551fa" (UID: "6c3837ab-39db-4e71-ae5d-366b45d551fa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:04:57.275226 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.275206    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c3837ab-39db-4e71-ae5d-366b45d551fa-kube-api-access-g7cq6" (OuterVolumeSpecName: "kube-api-access-g7cq6") pod "6c3837ab-39db-4e71-ae5d-366b45d551fa" (UID: "6c3837ab-39db-4e71-ae5d-366b45d551fa"). InnerVolumeSpecName "kube-api-access-g7cq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:04:57.374015 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.373973    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-oauth-config\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:57.374015 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.374012    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7cq6\" (UniqueName: \"kubernetes.io/projected/6c3837ab-39db-4e71-ae5d-366b45d551fa-kube-api-access-g7cq6\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:57.374264 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.374027    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3837ab-39db-4e71-ae5d-366b45d551fa-console-serving-cert\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:04:57.777705 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.777674    2576 generic.go:356] "Generic (PLEG): container finished" podID="6c3837ab-39db-4e71-ae5d-366b45d551fa" containerID="db04f5a00b9f17bc438d218225d27cf7482b85de72f60981630375a260416026" exitCode=0
Jul 20 05:04:57.777980 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.777718    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f5bf4579-58cws"
Jul 20 05:04:57.777980 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.777757    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f5bf4579-58cws" event={"ID":"6c3837ab-39db-4e71-ae5d-366b45d551fa","Type":"ContainerDied","Data":"db04f5a00b9f17bc438d218225d27cf7482b85de72f60981630375a260416026"}
Jul 20 05:04:57.777980 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.777803    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f5bf4579-58cws" event={"ID":"6c3837ab-39db-4e71-ae5d-366b45d551fa","Type":"ContainerDied","Data":"a9737cb8c62dfaf434ac18d192f466b3f4bea5cff93e05da1df29ad4953042a2"}
Jul 20 05:04:57.777980 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.777824    2576 scope.go:117] "RemoveContainer" containerID="db04f5a00b9f17bc438d218225d27cf7482b85de72f60981630375a260416026"
Jul 20 05:04:57.789215 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.789194    2576 scope.go:117] "RemoveContainer" containerID="db04f5a00b9f17bc438d218225d27cf7482b85de72f60981630375a260416026"
Jul 20 05:04:57.789484 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:04:57.789464    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db04f5a00b9f17bc438d218225d27cf7482b85de72f60981630375a260416026\": container with ID starting with db04f5a00b9f17bc438d218225d27cf7482b85de72f60981630375a260416026 not found: ID does not exist" containerID="db04f5a00b9f17bc438d218225d27cf7482b85de72f60981630375a260416026"
Jul 20 05:04:57.789538 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.789491    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db04f5a00b9f17bc438d218225d27cf7482b85de72f60981630375a260416026"} err="failed to get container status \"db04f5a00b9f17bc438d218225d27cf7482b85de72f60981630375a260416026\": rpc error: code = NotFound desc = could not find container \"db04f5a00b9f17bc438d218225d27cf7482b85de72f60981630375a260416026\": container with ID starting with db04f5a00b9f17bc438d218225d27cf7482b85de72f60981630375a260416026 not found: ID does not exist"
Jul 20 05:04:57.800516 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.800493    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f5bf4579-58cws"]
Jul 20 05:04:57.804256 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:57.804238    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55f5bf4579-58cws"]
Jul 20 05:04:58.679590 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:58.679560    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c3837ab-39db-4e71-ae5d-366b45d551fa" path="/var/lib/kubelet/pods/6c3837ab-39db-4e71-ae5d-366b45d551fa/volumes"
Jul 20 05:04:59.787351 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:59.787317    2576 generic.go:356] "Generic (PLEG): container finished" podID="592e503e-97d9-4011-9821-0a4320e1048e" containerID="666caba6227aadfe2d676b4c8e7347e7a28f44284b7ed6dba272c81d54e5399c" exitCode=0
Jul 20 05:04:59.787351 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:59.787350    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc" event={"ID":"592e503e-97d9-4011-9821-0a4320e1048e","Type":"ContainerDied","Data":"666caba6227aadfe2d676b4c8e7347e7a28f44284b7ed6dba272c81d54e5399c"}
Jul 20 05:04:59.787745 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:04:59.787649    2576 scope.go:117] "RemoveContainer" containerID="666caba6227aadfe2d676b4c8e7347e7a28f44284b7ed6dba272c81d54e5399c"
Jul 20 05:05:00.793153 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:05:00.793118    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-2k7vc" event={"ID":"592e503e-97d9-4011-9821-0a4320e1048e","Type":"ContainerStarted","Data":"cfd4112914666a3c7b7f294d54d6236a3b09d87240c6904d8ffa6de7a417d9be"}
Jul 20 05:05:18.298215 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:05:18.298176    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:05:18.316977 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:05:18.316954    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:05:18.650280 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:05:18.650188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs\") pod \"network-metrics-daemon-wcqzq\" (UID: \"00052a42-6eff-4102-b46e-67ee21d241f0\") " pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 05:05:18.652593 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:05:18.652566    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00052a42-6eff-4102-b46e-67ee21d241f0-metrics-certs\") pod \"network-metrics-daemon-wcqzq\" (UID: \"00052a42-6eff-4102-b46e-67ee21d241f0\") " pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 05:05:18.682492 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:05:18.682465    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z27sm\""
Jul 20 05:05:18.686549 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:05:18.686533    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcqzq"
Jul 20 05:05:18.810727 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:05:18.810696    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wcqzq"]
Jul 20 05:05:18.813596 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:05:18.813568    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00052a42_6eff_4102_b46e_67ee21d241f0.slice/crio-4d415f0abbffcf897f78336e87082d5b725a900e04212699f824fb657a6e6652 WatchSource:0}: Error finding container 4d415f0abbffcf897f78336e87082d5b725a900e04212699f824fb657a6e6652: Status 404 returned error can't find the container with id 4d415f0abbffcf897f78336e87082d5b725a900e04212699f824fb657a6e6652
Jul 20 05:05:18.866146 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:05:18.866115    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wcqzq" event={"ID":"00052a42-6eff-4102-b46e-67ee21d241f0","Type":"ContainerStarted","Data":"4d415f0abbffcf897f78336e87082d5b725a900e04212699f824fb657a6e6652"}
Jul 20 05:05:18.881468 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:05:18.881442    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 20 05:05:20.874617 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:05:20.874582    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wcqzq" event={"ID":"00052a42-6eff-4102-b46e-67ee21d241f0","Type":"ContainerStarted","Data":"5404a733b86b8c9d9894c7d8906aab7525a109f43be148f722b0d4aa128b2c16"}
Jul 20 05:05:20.874992 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:05:20.874640    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wcqzq" event={"ID":"00052a42-6eff-4102-b46e-67ee21d241f0","Type":"ContainerStarted","Data":"b3341cabb7abe3c01c0edb349c5ffafafe6537a91029671189ed7d07d425ff2e"}
Jul 20 05:05:20.891261 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:05:20.891213    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wcqzq" podStartSLOduration=374.806503125 podStartE2EDuration="6m15.891197994s" totalImagesPullingTime="1.084694869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 04:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:05:20.889030437 +0000 UTC m=+376.704524509" watchObservedRunningTime="2026-07-20 05:05:20.891197994 +0000 UTC m=+376.706692098"
Jul 20 05:06:51.028423 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.028386    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jws42"]
Jul 20 05:06:51.028850 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.028671    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46" containerName="registry"
Jul 20 05:06:51.028850 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.028682    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46" containerName="registry"
Jul 20 05:06:51.028850 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.028692    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a8eaea-3a98-4433-a078-b584e424da44" containerName="console"
Jul 20 05:06:51.028850 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.028697    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a8eaea-3a98-4433-a078-b584e424da44" containerName="console"
Jul 20 05:06:51.028850 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.028715    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c3837ab-39db-4e71-ae5d-366b45d551fa" containerName="console"
Jul 20 05:06:51.028850 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.028725    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c3837ab-39db-4e71-ae5d-366b45d551fa" containerName="console"
Jul 20 05:06:51.028850 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.028777    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="09e2bf5f-7ee1-48c9-bbb7-8bf7053bae46" containerName="registry"
Jul 20 05:06:51.028850 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.028784    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c3837ab-39db-4e71-ae5d-366b45d551fa" containerName="console"
Jul 20 05:06:51.028850 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.028792    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="84a8eaea-3a98-4433-a078-b584e424da44" containerName="console"
Jul 20 05:06:51.031617 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.031601    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jws42"
Jul 20 05:06:51.034119 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.034097    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 20 05:06:51.035079 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.035064    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-w5xq9\""
Jul 20 05:06:51.035151 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.035065    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 20 05:06:51.040069 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.040049    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jws42"]
Jul 20 05:06:51.154352 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.154314    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/233a7833-f994-49f5-bfbe-512b0b6c525a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jws42\" (UID: \"233a7833-f994-49f5-bfbe-512b0b6c525a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jws42"
Jul 20 05:06:51.154352 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.154355    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqbsx\" (UniqueName: \"kubernetes.io/projected/233a7833-f994-49f5-bfbe-512b0b6c525a-kube-api-access-vqbsx\") pod \"cert-manager-cainjector-559cdd8c87-jws42\" (UID: \"233a7833-f994-49f5-bfbe-512b0b6c525a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jws42"
Jul 20 05:06:51.255167 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.255134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/233a7833-f994-49f5-bfbe-512b0b6c525a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jws42\" (UID: \"233a7833-f994-49f5-bfbe-512b0b6c525a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jws42"
Jul 20 05:06:51.255351 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.255175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqbsx\" (UniqueName: \"kubernetes.io/projected/233a7833-f994-49f5-bfbe-512b0b6c525a-kube-api-access-vqbsx\") pod \"cert-manager-cainjector-559cdd8c87-jws42\" (UID: \"233a7833-f994-49f5-bfbe-512b0b6c525a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jws42"
Jul 20 05:06:51.262715 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.262691    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/233a7833-f994-49f5-bfbe-512b0b6c525a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jws42\" (UID: \"233a7833-f994-49f5-bfbe-512b0b6c525a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jws42"
Jul 20 05:06:51.262846 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.262830    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqbsx\" (UniqueName: \"kubernetes.io/projected/233a7833-f994-49f5-bfbe-512b0b6c525a-kube-api-access-vqbsx\") pod \"cert-manager-cainjector-559cdd8c87-jws42\" (UID: \"233a7833-f994-49f5-bfbe-512b0b6c525a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jws42"
Jul 20 05:06:51.359925 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.359809    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jws42"
Jul 20 05:06:51.484728 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:51.484696    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jws42"]
Jul 20 05:06:51.487844 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:06:51.487814    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod233a7833_f994_49f5_bfbe_512b0b6c525a.slice/crio-172354c6b5704d5433af4dda5bc1289b49cc062d8fb5ee9aa1b9827a011a10aa WatchSource:0}: Error finding container 172354c6b5704d5433af4dda5bc1289b49cc062d8fb5ee9aa1b9827a011a10aa: Status 404 returned error can't find the container with id 172354c6b5704d5433af4dda5bc1289b49cc062d8fb5ee9aa1b9827a011a10aa
Jul 20 05:06:52.194712 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:52.194633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jws42" event={"ID":"233a7833-f994-49f5-bfbe-512b0b6c525a","Type":"ContainerStarted","Data":"172354c6b5704d5433af4dda5bc1289b49cc062d8fb5ee9aa1b9827a011a10aa"}
Jul 20 05:06:55.209332 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:55.209299    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jws42" event={"ID":"233a7833-f994-49f5-bfbe-512b0b6c525a","Type":"ContainerStarted","Data":"df45190e040057b5e8978f8a9cc54208fe6f5446ea2afcf7c0836b5160b696ce"}
Jul 20 05:06:55.224329 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:06:55.224284    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jws42" podStartSLOduration=1.3095010120000001 podStartE2EDuration="4.224269656s" totalImagesPullingTime="2.914768644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:06:55.222998406 +0000 UTC m=+471.038492505" watchObservedRunningTime="2026-07-20 05:06:55.224269656 +0000 UTC m=+471.039763727"
Jul 20 05:07:31.283810 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.283777    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"]
Jul 20 05:07:31.287834 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.287813    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"
Jul 20 05:07:31.290737 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.290715    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 05:07:31.290863 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.290759    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 20 05:07:31.291860 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.291844    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 20 05:07:31.291992 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.291868    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 05:07:31.291992 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.291870    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 20 05:07:31.291992 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.291931    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-b7gl5\""
Jul 20 05:07:31.296760 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.296740    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"]
Jul 20 05:07:31.477556 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.477515    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnqzh\" (UniqueName: \"kubernetes.io/projected/4d1c8494-c70d-46a3-843a-de6bdf2f114d-kube-api-access-dnqzh\") pod \"lws-controller-manager-676c6f859f-fw2gg\" (UID: \"4d1c8494-c70d-46a3-843a-de6bdf2f114d\") " pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"
Jul 20 05:07:31.477744 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.477628    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d1c8494-c70d-46a3-843a-de6bdf2f114d-cert\") pod \"lws-controller-manager-676c6f859f-fw2gg\" (UID: \"4d1c8494-c70d-46a3-843a-de6bdf2f114d\") " pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"
Jul 20 05:07:31.477744 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.477660    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4d1c8494-c70d-46a3-843a-de6bdf2f114d-manager-config\") pod \"lws-controller-manager-676c6f859f-fw2gg\" (UID: \"4d1c8494-c70d-46a3-843a-de6bdf2f114d\") " pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"
Jul 20 05:07:31.477744 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.477691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d1c8494-c70d-46a3-843a-de6bdf2f114d-metrics-cert\") pod \"lws-controller-manager-676c6f859f-fw2gg\" (UID: \"4d1c8494-c70d-46a3-843a-de6bdf2f114d\") " pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"
Jul 20 05:07:31.578172 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.578081    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d1c8494-c70d-46a3-843a-de6bdf2f114d-cert\") pod \"lws-controller-manager-676c6f859f-fw2gg\" (UID: \"4d1c8494-c70d-46a3-843a-de6bdf2f114d\") " pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"
Jul 20 05:07:31.578172 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.578123    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4d1c8494-c70d-46a3-843a-de6bdf2f114d-manager-config\") pod \"lws-controller-manager-676c6f859f-fw2gg\" (UID: \"4d1c8494-c70d-46a3-843a-de6bdf2f114d\") " pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"
Jul 20 05:07:31.578172 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.578144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d1c8494-c70d-46a3-843a-de6bdf2f114d-metrics-cert\") pod \"lws-controller-manager-676c6f859f-fw2gg\" (UID: \"4d1c8494-c70d-46a3-843a-de6bdf2f114d\") " pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"
Jul 20 05:07:31.578438 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.578177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnqzh\" (UniqueName: \"kubernetes.io/projected/4d1c8494-c70d-46a3-843a-de6bdf2f114d-kube-api-access-dnqzh\") pod \"lws-controller-manager-676c6f859f-fw2gg\" (UID: \"4d1c8494-c70d-46a3-843a-de6bdf2f114d\") " pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"
Jul 20 05:07:31.578767 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.578745    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4d1c8494-c70d-46a3-843a-de6bdf2f114d-manager-config\") pod \"lws-controller-manager-676c6f859f-fw2gg\" (UID: \"4d1c8494-c70d-46a3-843a-de6bdf2f114d\") " pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"
Jul 20 05:07:31.580735 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.580708    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4d1c8494-c70d-46a3-843a-de6bdf2f114d-cert\") pod \"lws-controller-manager-676c6f859f-fw2gg\" (UID: \"4d1c8494-c70d-46a3-843a-de6bdf2f114d\") " pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"
Jul 20 05:07:31.580812 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.580750    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4d1c8494-c70d-46a3-843a-de6bdf2f114d-metrics-cert\") pod \"lws-controller-manager-676c6f859f-fw2gg\" (UID: \"4d1c8494-c70d-46a3-843a-de6bdf2f114d\") " pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"
Jul 20 05:07:31.601827 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.601804    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnqzh\" (UniqueName: \"kubernetes.io/projected/4d1c8494-c70d-46a3-843a-de6bdf2f114d-kube-api-access-dnqzh\") pod \"lws-controller-manager-676c6f859f-fw2gg\" (UID: \"4d1c8494-c70d-46a3-843a-de6bdf2f114d\") " pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"
Jul 20 05:07:31.897074 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:31.896992    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"
Jul 20 05:07:32.035135 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:32.035100    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"]
Jul 20 05:07:32.038118 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:07:32.038093    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1c8494_c70d_46a3_843a_de6bdf2f114d.slice/crio-63928b330d7410ebc8f165780507c03516623a167f80ccf4a1b62cc8241f62e8 WatchSource:0}: Error finding container 63928b330d7410ebc8f165780507c03516623a167f80ccf4a1b62cc8241f62e8: Status 404 returned error can't find the container with id 63928b330d7410ebc8f165780507c03516623a167f80ccf4a1b62cc8241f62e8
Jul 20 05:07:32.338384 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:32.338351    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg" event={"ID":"4d1c8494-c70d-46a3-843a-de6bdf2f114d","Type":"ContainerStarted","Data":"63928b330d7410ebc8f165780507c03516623a167f80ccf4a1b62cc8241f62e8"}
Jul 20 05:07:35.350561 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:35.350529    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg" event={"ID":"4d1c8494-c70d-46a3-843a-de6bdf2f114d","Type":"ContainerStarted","Data":"283d82bd8057cdf923710e4d7445cf6ab59601f543021820bc6f8f22e3ce28ce"}
Jul 20 05:07:35.350979 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:35.350649    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"
Jul 20 05:07:35.366473 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:35.366431    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg" podStartSLOduration=2.049052489 podStartE2EDuration="4.366415778s" totalImagesPullingTime="2.317363289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:07:35.365242454 +0000 UTC m=+511.180736539" watchObservedRunningTime="2026-07-20 05:07:35.366415778 +0000 UTC m=+511.181909849"
Jul 20 05:07:39.775696 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.775664    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"]
Jul 20 05:07:39.779217 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.779196    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:39.781917 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.781890    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 05:07:39.782028 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.781933    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 05:07:39.782028 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.782020    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5gbtj\""
Jul 20 05:07:39.782146 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.782051    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 05:07:39.782285 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.782265    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 05:07:39.797939 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.797918    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"]
Jul 20 05:07:39.843829 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.843796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjwpc\" (UniqueName: \"kubernetes.io/projected/d5d4c103-141a-46dc-85b6-b4845d5dee47-kube-api-access-hjwpc\") pod \"opendatahub-operator-controller-manager-54dff8fcf7-wj2md\" (UID: \"d5d4c103-141a-46dc-85b6-b4845d5dee47\") " pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:39.843997 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.843841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d5d4c103-141a-46dc-85b6-b4845d5dee47-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dff8fcf7-wj2md\" (UID: \"d5d4c103-141a-46dc-85b6-b4845d5dee47\") " pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:39.843997 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.843897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5d4c103-141a-46dc-85b6-b4845d5dee47-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dff8fcf7-wj2md\" (UID: \"d5d4c103-141a-46dc-85b6-b4845d5dee47\") " pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:39.843997 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.843932    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5d4c103-141a-46dc-85b6-b4845d5dee47-tmp\") pod \"opendatahub-operator-controller-manager-54dff8fcf7-wj2md\" (UID: \"d5d4c103-141a-46dc-85b6-b4845d5dee47\") " pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:39.843997 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.843968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d5d4c103-141a-46dc-85b6-b4845d5dee47-manifests\") pod \"opendatahub-operator-controller-manager-54dff8fcf7-wj2md\" (UID: \"d5d4c103-141a-46dc-85b6-b4845d5dee47\") " pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:39.945092 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.945062    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjwpc\" (UniqueName: \"kubernetes.io/projected/d5d4c103-141a-46dc-85b6-b4845d5dee47-kube-api-access-hjwpc\") pod \"opendatahub-operator-controller-manager-54dff8fcf7-wj2md\" (UID: \"d5d4c103-141a-46dc-85b6-b4845d5dee47\") " pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:39.945207 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.945097    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d5d4c103-141a-46dc-85b6-b4845d5dee47-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dff8fcf7-wj2md\" (UID: \"d5d4c103-141a-46dc-85b6-b4845d5dee47\") " pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:39.945207 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.945119    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5d4c103-141a-46dc-85b6-b4845d5dee47-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dff8fcf7-wj2md\" (UID: \"d5d4c103-141a-46dc-85b6-b4845d5dee47\") " pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:39.945330 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.945309    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5d4c103-141a-46dc-85b6-b4845d5dee47-tmp\") pod \"opendatahub-operator-controller-manager-54dff8fcf7-wj2md\" (UID: \"d5d4c103-141a-46dc-85b6-b4845d5dee47\") " pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:39.945388 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.945373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d5d4c103-141a-46dc-85b6-b4845d5dee47-manifests\") pod \"opendatahub-operator-controller-manager-54dff8fcf7-wj2md\" (UID: \"d5d4c103-141a-46dc-85b6-b4845d5dee47\") " pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:39.945720 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.945666    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d5d4c103-141a-46dc-85b6-b4845d5dee47-manifests\") pod \"opendatahub-operator-controller-manager-54dff8fcf7-wj2md\" (UID: \"d5d4c103-141a-46dc-85b6-b4845d5dee47\") " pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:39.947587 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.947567    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d5d4c103-141a-46dc-85b6-b4845d5dee47-tmp\") pod \"opendatahub-operator-controller-manager-54dff8fcf7-wj2md\" (UID: \"d5d4c103-141a-46dc-85b6-b4845d5dee47\") " pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:39.947690 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.947658    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d5d4c103-141a-46dc-85b6-b4845d5dee47-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dff8fcf7-wj2md\" (UID: \"d5d4c103-141a-46dc-85b6-b4845d5dee47\") " pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:39.947741 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.947706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d5d4c103-141a-46dc-85b6-b4845d5dee47-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dff8fcf7-wj2md\" (UID: \"d5d4c103-141a-46dc-85b6-b4845d5dee47\") " pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:39.952613 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:39.952594    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjwpc\" (UniqueName: \"kubernetes.io/projected/d5d4c103-141a-46dc-85b6-b4845d5dee47-kube-api-access-hjwpc\") pod \"opendatahub-operator-controller-manager-54dff8fcf7-wj2md\" (UID: \"d5d4c103-141a-46dc-85b6-b4845d5dee47\") " pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:40.090070 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:40.089986    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:40.219132 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:40.219104    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"]
Jul 20 05:07:40.221686 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:07:40.221664    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d4c103_141a_46dc_85b6_b4845d5dee47.slice/crio-0c7b51aca6435d59b3b384eba893edd1e7ba030b2983d4e2a39782f5aa30c1aa WatchSource:0}: Error finding container 0c7b51aca6435d59b3b384eba893edd1e7ba030b2983d4e2a39782f5aa30c1aa: Status 404 returned error can't find the container with id 0c7b51aca6435d59b3b384eba893edd1e7ba030b2983d4e2a39782f5aa30c1aa
Jul 20 05:07:40.369043 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:40.368956    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md" event={"ID":"d5d4c103-141a-46dc-85b6-b4845d5dee47","Type":"ContainerStarted","Data":"0c7b51aca6435d59b3b384eba893edd1e7ba030b2983d4e2a39782f5aa30c1aa"}
Jul 20 05:07:43.384522 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:43.384435    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md" event={"ID":"d5d4c103-141a-46dc-85b6-b4845d5dee47","Type":"ContainerStarted","Data":"a2c7971f0f98ac123628c4b97b2d271d3101c727e6c8e222753cba5349dd3fe0"}
Jul 20 05:07:44.389983 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:44.389949    2576 generic.go:356] "Generic (PLEG): container finished" podID="d5d4c103-141a-46dc-85b6-b4845d5dee47" containerID="a2c7971f0f98ac123628c4b97b2d271d3101c727e6c8e222753cba5349dd3fe0" exitCode=0
Jul 20 05:07:44.390418 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:44.390041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md" event={"ID":"d5d4c103-141a-46dc-85b6-b4845d5dee47","Type":"ContainerDied","Data":"a2c7971f0f98ac123628c4b97b2d271d3101c727e6c8e222753cba5349dd3fe0"}
Jul 20 05:07:45.395689 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:45.395655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md" event={"ID":"d5d4c103-141a-46dc-85b6-b4845d5dee47","Type":"ContainerStarted","Data":"9f4b71acf63b8fc2b75b57356f64ccc317706e81abf9abe8aaa9b45f6d46aaf6"}
Jul 20 05:07:45.396098 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:45.395804    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:07:45.417298 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:45.417255    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md" podStartSLOduration=2.060446149 podStartE2EDuration="6.417241556s" totalImagesPullingTime="3.29318949s" totalInitContainerRuntime="1.063605917s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:07:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:07:45.41531087 +0000 UTC m=+521.230804955" watchObservedRunningTime="2026-07-20 05:07:45.417241556 +0000 UTC m=+521.232735628"
Jul 20 05:07:46.356159 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:46.356134    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-676c6f859f-fw2gg"
Jul 20 05:07:56.401606 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:07:56.401528    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54dff8fcf7-wj2md"
Jul 20 05:08:09.280829 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.280788    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-bf9656866-bvrwg"]
Jul 20 05:08:09.288763 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.288734    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bf9656866-bvrwg"
Jul 20 05:08:09.292324 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.292304    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9tfgf\""
Jul 20 05:08:09.293192 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.293177    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 05:08:09.293270 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.293233    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 05:08:09.293322 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.293278    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 05:08:09.293322 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.293234    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 05:08:09.298313 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.298295    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bf9656866-bvrwg"]
Jul 20 05:08:09.388732 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.388695    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8540b031-6e84-4c15-bb7c-51160870c58b-tmp\") pod \"kube-auth-proxy-bf9656866-bvrwg\" (UID: \"8540b031-6e84-4c15-bb7c-51160870c58b\") " pod="openshift-ingress/kube-auth-proxy-bf9656866-bvrwg"
Jul 20 05:08:09.388910 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.388747    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q9k8\" (UniqueName: \"kubernetes.io/projected/8540b031-6e84-4c15-bb7c-51160870c58b-kube-api-access-9q9k8\") pod \"kube-auth-proxy-bf9656866-bvrwg\" (UID: \"8540b031-6e84-4c15-bb7c-51160870c58b\") " pod="openshift-ingress/kube-auth-proxy-bf9656866-bvrwg"
Jul 20 05:08:09.388910 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.388819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8540b031-6e84-4c15-bb7c-51160870c58b-tls-certs\") pod \"kube-auth-proxy-bf9656866-bvrwg\" (UID: \"8540b031-6e84-4c15-bb7c-51160870c58b\") " pod="openshift-ingress/kube-auth-proxy-bf9656866-bvrwg"
Jul 20 05:08:09.489765 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.489724    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8540b031-6e84-4c15-bb7c-51160870c58b-tmp\") pod \"kube-auth-proxy-bf9656866-bvrwg\" (UID: \"8540b031-6e84-4c15-bb7c-51160870c58b\") " pod="openshift-ingress/kube-auth-proxy-bf9656866-bvrwg"
Jul 20 05:08:09.489969 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.489794    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q9k8\" (UniqueName: \"kubernetes.io/projected/8540b031-6e84-4c15-bb7c-51160870c58b-kube-api-access-9q9k8\") pod \"kube-auth-proxy-bf9656866-bvrwg\" (UID: \"8540b031-6e84-4c15-bb7c-51160870c58b\") " pod="openshift-ingress/kube-auth-proxy-bf9656866-bvrwg"
Jul 20 05:08:09.489969 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.489844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8540b031-6e84-4c15-bb7c-51160870c58b-tls-certs\") pod \"kube-auth-proxy-bf9656866-bvrwg\" (UID: \"8540b031-6e84-4c15-bb7c-51160870c58b\") " pod="openshift-ingress/kube-auth-proxy-bf9656866-bvrwg"
Jul 20 05:08:09.492284 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.492252    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8540b031-6e84-4c15-bb7c-51160870c58b-tmp\") pod \"kube-auth-proxy-bf9656866-bvrwg\" (UID: \"8540b031-6e84-4c15-bb7c-51160870c58b\") " pod="openshift-ingress/kube-auth-proxy-bf9656866-bvrwg"
Jul 20 05:08:09.492416 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.492356    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8540b031-6e84-4c15-bb7c-51160870c58b-tls-certs\") pod \"kube-auth-proxy-bf9656866-bvrwg\" (UID: \"8540b031-6e84-4c15-bb7c-51160870c58b\") " pod="openshift-ingress/kube-auth-proxy-bf9656866-bvrwg"
Jul 20 05:08:09.498531 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.498506    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q9k8\" (UniqueName: \"kubernetes.io/projected/8540b031-6e84-4c15-bb7c-51160870c58b-kube-api-access-9q9k8\") pod \"kube-auth-proxy-bf9656866-bvrwg\" (UID: \"8540b031-6e84-4c15-bb7c-51160870c58b\") " pod="openshift-ingress/kube-auth-proxy-bf9656866-bvrwg"
Jul 20 05:08:09.598731 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.598652    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-bf9656866-bvrwg"
Jul 20 05:08:09.741819 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:09.741796    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-bf9656866-bvrwg"]
Jul 20 05:08:09.743573 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:08:09.743532    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8540b031_6e84_4c15_bb7c_51160870c58b.slice/crio-2dfd5dba68c1a3b9c7d2b6f3b9abefc4ff8eab1658d5c78fb5c2dece0217e9a6 WatchSource:0}: Error finding container 2dfd5dba68c1a3b9c7d2b6f3b9abefc4ff8eab1658d5c78fb5c2dece0217e9a6: Status 404 returned error can't find the container with id 2dfd5dba68c1a3b9c7d2b6f3b9abefc4ff8eab1658d5c78fb5c2dece0217e9a6
Jul 20 05:08:10.496922 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:10.496864    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bf9656866-bvrwg" event={"ID":"8540b031-6e84-4c15-bb7c-51160870c58b","Type":"ContainerStarted","Data":"2dfd5dba68c1a3b9c7d2b6f3b9abefc4ff8eab1658d5c78fb5c2dece0217e9a6"}
Jul 20 05:08:12.507023 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:12.506991    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-bf9656866-bvrwg" event={"ID":"8540b031-6e84-4c15-bb7c-51160870c58b","Type":"ContainerStarted","Data":"a5ba3f5c7d566b08db100d3dfd42e1aa1cdc426862c5374b38baa4eee6d451c5"}
Jul 20 05:08:12.522940 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:08:12.522897    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-bf9656866-bvrwg" podStartSLOduration=0.953158974 podStartE2EDuration="3.52286173s" totalImagesPullingTime="2.569702756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:08:12.521765871 +0000 UTC m=+548.337259953" watchObservedRunningTime="2026-07-20 05:08:12.52286173 +0000 UTC m=+548.338355792"
Jul 20 05:09:38.984678 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:38.984639    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"]
Jul 20 05:09:38.987744 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:38.987728    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"
Jul 20 05:09:38.990228 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:38.990208    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-znz8d\""
Jul 20 05:09:38.990346 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:38.990270    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 05:09:38.991171 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:38.991157    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 05:09:38.997332 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:38.997312    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"]
Jul 20 05:09:39.022226 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:39.022199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgnlw\" (UniqueName: \"kubernetes.io/projected/85f0a311-e429-4c7a-a5ea-9461c1e9fdac-kube-api-access-sgnlw\") pod \"limitador-operator-controller-manager-859d7b78bd-wjflm\" (UID: \"85f0a311-e429-4c7a-a5ea-9461c1e9fdac\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"
Jul 20 05:09:39.122841 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:39.122807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgnlw\" (UniqueName: \"kubernetes.io/projected/85f0a311-e429-4c7a-a5ea-9461c1e9fdac-kube-api-access-sgnlw\") pod \"limitador-operator-controller-manager-859d7b78bd-wjflm\" (UID: \"85f0a311-e429-4c7a-a5ea-9461c1e9fdac\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"
Jul 20 05:09:39.130636 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:39.130612    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgnlw\" (UniqueName: \"kubernetes.io/projected/85f0a311-e429-4c7a-a5ea-9461c1e9fdac-kube-api-access-sgnlw\") pod \"limitador-operator-controller-manager-859d7b78bd-wjflm\" (UID: \"85f0a311-e429-4c7a-a5ea-9461c1e9fdac\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"
Jul 20 05:09:39.299321 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:39.299224    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"
Jul 20 05:09:39.428929 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:39.428763    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"]
Jul 20 05:09:39.431625 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:09:39.431595    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f0a311_e429_4c7a_a5ea_9461c1e9fdac.slice/crio-104261b30b503aa0b690ee2f0e8a88cc1ccef95950eb84e0b4a7790fa5ac9de0 WatchSource:0}: Error finding container 104261b30b503aa0b690ee2f0e8a88cc1ccef95950eb84e0b4a7790fa5ac9de0: Status 404 returned error can't find the container with id 104261b30b503aa0b690ee2f0e8a88cc1ccef95950eb84e0b4a7790fa5ac9de0
Jul 20 05:09:39.433549 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:39.433531    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 05:09:39.852444 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:39.852405    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm" event={"ID":"85f0a311-e429-4c7a-a5ea-9461c1e9fdac","Type":"ContainerStarted","Data":"104261b30b503aa0b690ee2f0e8a88cc1ccef95950eb84e0b4a7790fa5ac9de0"}
Jul 20 05:09:41.863602 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:41.863566    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm" event={"ID":"85f0a311-e429-4c7a-a5ea-9461c1e9fdac","Type":"ContainerStarted","Data":"578ab16481dee2ac4c57afa579be57f69dc91a52ff67d35e28b1736fbf888399"}
Jul 20 05:09:41.864020 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:41.863706    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"
Jul 20 05:09:41.881501 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:41.881450    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm" podStartSLOduration=2.258033288 podStartE2EDuration="3.881434191s" totalImagesPullingTime="1.623400903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:09:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:09:41.879995297 +0000 UTC m=+637.695489369" watchObservedRunningTime="2026-07-20 05:09:41.881434191 +0000 UTC m=+637.696928264"
Jul 20 05:09:52.869577 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:09:52.869546    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"
Jul 20 05:10:02.152709 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.152674    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"]
Jul 20 05:10:02.153230 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.152874    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm" podUID="85f0a311-e429-4c7a-a5ea-9461c1e9fdac" containerName="manager" containerID="cri-o://578ab16481dee2ac4c57afa579be57f69dc91a52ff67d35e28b1736fbf888399" gracePeriod=2
Jul 20 05:10:02.163344 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.163317    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"]
Jul 20 05:10:02.167759 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:10:02.167720    2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"85f0a311-e429-4c7a-a5ea-9461c1e9fdac\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-wjflm\": pods \"limitador-operator-controller-manager-859d7b78bd-wjflm\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"
Jul 20 05:10:02.176368 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.176342    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqf4w"]
Jul 20 05:10:02.176800 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.176786    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85f0a311-e429-4c7a-a5ea-9461c1e9fdac" containerName="manager"
Jul 20 05:10:02.176846 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.176804    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="85f0a311-e429-4c7a-a5ea-9461c1e9fdac" containerName="manager"
Jul 20 05:10:02.176910 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.176899    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="85f0a311-e429-4c7a-a5ea-9461c1e9fdac" containerName="manager"
Jul 20 05:10:02.180221 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.180202    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqf4w"
Jul 20 05:10:02.182678 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:10:02.182647    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wjflm\" is forbidden: User \"system:node:ip-10-0-135-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-196.ec2.internal' and this object" podUID="85f0a311-e429-4c7a-a5ea-9461c1e9fdac" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"
Jul 20 05:10:02.189869 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.189844    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqf4w"]
Jul 20 05:10:02.320442 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.320391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxd96\" (UniqueName: \"kubernetes.io/projected/678468a3-c0a6-4631-ad9a-80a7e8a6d250-kube-api-access-rxd96\") pod \"limitador-operator-controller-manager-859d7b78bd-cqf4w\" (UID: \"678468a3-c0a6-4631-ad9a-80a7e8a6d250\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqf4w"
Jul 20 05:10:02.387296 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.387273    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"
Jul 20 05:10:02.389575 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:10:02.389548    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wjflm\" is forbidden: User \"system:node:ip-10-0-135-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-196.ec2.internal' and this object" podUID="85f0a311-e429-4c7a-a5ea-9461c1e9fdac" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"
Jul 20 05:10:02.420986 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.420901    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxd96\" (UniqueName: \"kubernetes.io/projected/678468a3-c0a6-4631-ad9a-80a7e8a6d250-kube-api-access-rxd96\") pod \"limitador-operator-controller-manager-859d7b78bd-cqf4w\" (UID: \"678468a3-c0a6-4631-ad9a-80a7e8a6d250\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqf4w"
Jul 20 05:10:02.434465 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.434434    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxd96\" (UniqueName: \"kubernetes.io/projected/678468a3-c0a6-4631-ad9a-80a7e8a6d250-kube-api-access-rxd96\") pod \"limitador-operator-controller-manager-859d7b78bd-cqf4w\" (UID: \"678468a3-c0a6-4631-ad9a-80a7e8a6d250\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqf4w"
Jul 20 05:10:02.521767 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.521733    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgnlw\" (UniqueName: \"kubernetes.io/projected/85f0a311-e429-4c7a-a5ea-9461c1e9fdac-kube-api-access-sgnlw\") pod \"85f0a311-e429-4c7a-a5ea-9461c1e9fdac\" (UID: \"85f0a311-e429-4c7a-a5ea-9461c1e9fdac\") "
Jul 20 05:10:02.524082 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.524057    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85f0a311-e429-4c7a-a5ea-9461c1e9fdac-kube-api-access-sgnlw" (OuterVolumeSpecName: "kube-api-access-sgnlw") pod "85f0a311-e429-4c7a-a5ea-9461c1e9fdac" (UID: "85f0a311-e429-4c7a-a5ea-9461c1e9fdac"). InnerVolumeSpecName "kube-api-access-sgnlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:10:02.532853 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.532833    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqf4w"
Jul 20 05:10:02.622347 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.622317    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgnlw\" (UniqueName: \"kubernetes.io/projected/85f0a311-e429-4c7a-a5ea-9461c1e9fdac-kube-api-access-sgnlw\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:10:02.667039 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.667015    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqf4w"]
Jul 20 05:10:02.668956 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:10:02.668921    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod678468a3_c0a6_4631_ad9a_80a7e8a6d250.slice/crio-0eca8cef76b8095ab63d83b1272d9cb0e7607f00ac84e9c6e71149821ba11599 WatchSource:0}: Error finding container 0eca8cef76b8095ab63d83b1272d9cb0e7607f00ac84e9c6e71149821ba11599: Status 404 returned error can't find the container with id 0eca8cef76b8095ab63d83b1272d9cb0e7607f00ac84e9c6e71149821ba11599
Jul 20 05:10:02.679672 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.679647    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85f0a311-e429-4c7a-a5ea-9461c1e9fdac" path="/var/lib/kubelet/pods/85f0a311-e429-4c7a-a5ea-9461c1e9fdac/volumes"
Jul 20 05:10:02.958922 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.958895    2576 generic.go:356] "Generic (PLEG): container finished" podID="85f0a311-e429-4c7a-a5ea-9461c1e9fdac" containerID="578ab16481dee2ac4c57afa579be57f69dc91a52ff67d35e28b1736fbf888399" exitCode=0
Jul 20 05:10:02.959084 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.958928    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wjflm"
Jul 20 05:10:02.959084 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.958997    2576 scope.go:117] "RemoveContainer" containerID="578ab16481dee2ac4c57afa579be57f69dc91a52ff67d35e28b1736fbf888399"
Jul 20 05:10:02.960688 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.960666    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqf4w" event={"ID":"678468a3-c0a6-4631-ad9a-80a7e8a6d250","Type":"ContainerStarted","Data":"bcf90b6369d40fdb665202234ce9e3c03e649b464eba274c44d6bc16c5fa0451"}
Jul 20 05:10:02.960808 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.960719    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqf4w" event={"ID":"678468a3-c0a6-4631-ad9a-80a7e8a6d250","Type":"ContainerStarted","Data":"0eca8cef76b8095ab63d83b1272d9cb0e7607f00ac84e9c6e71149821ba11599"}
Jul 20 05:10:02.961219 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.961015    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqf4w"
Jul 20 05:10:02.967315 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.967296    2576 scope.go:117] "RemoveContainer" containerID="578ab16481dee2ac4c57afa579be57f69dc91a52ff67d35e28b1736fbf888399"
Jul 20 05:10:02.967543 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:10:02.967526    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"578ab16481dee2ac4c57afa579be57f69dc91a52ff67d35e28b1736fbf888399\": container with ID starting with 578ab16481dee2ac4c57afa579be57f69dc91a52ff67d35e28b1736fbf888399 not found: ID does not exist" containerID="578ab16481dee2ac4c57afa579be57f69dc91a52ff67d35e28b1736fbf888399"
Jul 20 05:10:02.967593 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.967552    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"578ab16481dee2ac4c57afa579be57f69dc91a52ff67d35e28b1736fbf888399"} err="failed to get container status \"578ab16481dee2ac4c57afa579be57f69dc91a52ff67d35e28b1736fbf888399\": rpc error: code = NotFound desc = could not find container \"578ab16481dee2ac4c57afa579be57f69dc91a52ff67d35e28b1736fbf888399\": container with ID starting with 578ab16481dee2ac4c57afa579be57f69dc91a52ff67d35e28b1736fbf888399 not found: ID does not exist"
Jul 20 05:10:02.979785 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:02.979747    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqf4w" podStartSLOduration=0.979732149 podStartE2EDuration="979.732149ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:10:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:10:02.978681234 +0000 UTC m=+658.794175338" watchObservedRunningTime="2026-07-20 05:10:02.979732149 +0000 UTC m=+658.795226222"
Jul 20 05:10:13.968568 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:13.968540    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cqf4w"
Jul 20 05:10:53.012483 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.012450    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-2ppn6"]
Jul 20 05:10:53.015662 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.015647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2ppn6"
Jul 20 05:10:53.018250 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.018227    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sfdpf\""
Jul 20 05:10:53.023095 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.023075    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-2ppn6"]
Jul 20 05:10:53.108998 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.108953    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9qx7\" (UniqueName: \"kubernetes.io/projected/3dc6b063-0985-4a59-a45d-329aafeaa9aa-kube-api-access-m9qx7\") pod \"authorino-58cd955675-2ppn6\" (UID: \"3dc6b063-0985-4a59-a45d-329aafeaa9aa\") " pod="kuadrant-system/authorino-58cd955675-2ppn6"
Jul 20 05:10:53.126391 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.126366    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvxdp"]
Jul 20 05:10:53.129479 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.129465    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bvxdp"
Jul 20 05:10:53.134149 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.134128    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvxdp"]
Jul 20 05:10:53.210372 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.210345    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9qx7\" (UniqueName: \"kubernetes.io/projected/3dc6b063-0985-4a59-a45d-329aafeaa9aa-kube-api-access-m9qx7\") pod \"authorino-58cd955675-2ppn6\" (UID: \"3dc6b063-0985-4a59-a45d-329aafeaa9aa\") " pod="kuadrant-system/authorino-58cd955675-2ppn6"
Jul 20 05:10:53.210528 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.210411    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl62m\" (UniqueName: \"kubernetes.io/projected/f0e63fec-6182-4eb8-8108-e02e85618711-kube-api-access-hl62m\") pod \"authorino-75d556bd77-bvxdp\" (UID: \"f0e63fec-6182-4eb8-8108-e02e85618711\") " pod="kuadrant-system/authorino-75d556bd77-bvxdp"
Jul 20 05:10:53.218196 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.218162    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9qx7\" (UniqueName: \"kubernetes.io/projected/3dc6b063-0985-4a59-a45d-329aafeaa9aa-kube-api-access-m9qx7\") pod \"authorino-58cd955675-2ppn6\" (UID: \"3dc6b063-0985-4a59-a45d-329aafeaa9aa\") " pod="kuadrant-system/authorino-58cd955675-2ppn6"
Jul 20 05:10:53.311228 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.311134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl62m\" (UniqueName: \"kubernetes.io/projected/f0e63fec-6182-4eb8-8108-e02e85618711-kube-api-access-hl62m\") pod \"authorino-75d556bd77-bvxdp\" (UID: \"f0e63fec-6182-4eb8-8108-e02e85618711\") " pod="kuadrant-system/authorino-75d556bd77-bvxdp"
Jul 20 05:10:53.319088 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.319058    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl62m\" (UniqueName: \"kubernetes.io/projected/f0e63fec-6182-4eb8-8108-e02e85618711-kube-api-access-hl62m\") pod \"authorino-75d556bd77-bvxdp\" (UID: \"f0e63fec-6182-4eb8-8108-e02e85618711\") " pod="kuadrant-system/authorino-75d556bd77-bvxdp"
Jul 20 05:10:53.325425 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.325401    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2ppn6"
Jul 20 05:10:53.439278 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.439250    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bvxdp"
Jul 20 05:10:53.454786 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.454763    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-2ppn6"]
Jul 20 05:10:53.457205 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:10:53.457179    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3dc6b063_0985_4a59_a45d_329aafeaa9aa.slice/crio-30596fad94586575e4ef8fae027f74fb032782827e70e4db5eeb7b355651bb46 WatchSource:0}: Error finding container 30596fad94586575e4ef8fae027f74fb032782827e70e4db5eeb7b355651bb46: Status 404 returned error can't find the container with id 30596fad94586575e4ef8fae027f74fb032782827e70e4db5eeb7b355651bb46
Jul 20 05:10:53.569277 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:53.569252    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvxdp"]
Jul 20 05:10:53.571750 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:10:53.571722    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0e63fec_6182_4eb8_8108_e02e85618711.slice/crio-4c2160a0c4f09e16653540e1200ab9c6a6a976fdebadedc054b7423d0a3a4ebb WatchSource:0}: Error finding container 4c2160a0c4f09e16653540e1200ab9c6a6a976fdebadedc054b7423d0a3a4ebb: Status 404 returned error can't find the container with id 4c2160a0c4f09e16653540e1200ab9c6a6a976fdebadedc054b7423d0a3a4ebb
Jul 20 05:10:54.173617 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:54.173492    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bvxdp" event={"ID":"f0e63fec-6182-4eb8-8108-e02e85618711","Type":"ContainerStarted","Data":"4c2160a0c4f09e16653540e1200ab9c6a6a976fdebadedc054b7423d0a3a4ebb"}
Jul 20 05:10:54.176898 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:54.176818    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2ppn6" event={"ID":"3dc6b063-0985-4a59-a45d-329aafeaa9aa","Type":"ContainerStarted","Data":"30596fad94586575e4ef8fae027f74fb032782827e70e4db5eeb7b355651bb46"}
Jul 20 05:10:57.192920 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:57.192852    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bvxdp" event={"ID":"f0e63fec-6182-4eb8-8108-e02e85618711","Type":"ContainerStarted","Data":"0f677218856e7d97c248192049df53d7f59aec90c587789a2eb973b340f445a1"}
Jul 20 05:10:57.194350 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:57.194324    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2ppn6" event={"ID":"3dc6b063-0985-4a59-a45d-329aafeaa9aa","Type":"ContainerStarted","Data":"4e1e66a7e307db7ebe0c1be9cbb09337d98effcb03f083e52fbcf0a11b654616"}
Jul 20 05:10:57.207797 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:57.207753    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-bvxdp" podStartSLOduration=0.817790747 podStartE2EDuration="4.20773913s" totalImagesPullingTime="3.389948383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:10:57.207096166 +0000 UTC m=+713.022590241" watchObservedRunningTime="2026-07-20 05:10:57.20773913 +0000 UTC m=+713.023233247"
Jul 20 05:10:57.221930 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:57.221814    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-2ppn6" podStartSLOduration=0.706824564 podStartE2EDuration="4.221793461s" totalImagesPullingTime="3.514968897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:10:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:10:57.219834506 +0000 UTC m=+713.035328578" watchObservedRunningTime="2026-07-20 05:10:57.221793461 +0000 UTC m=+713.037287533"
Jul 20 05:10:57.242693 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:57.242658    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-2ppn6"]
Jul 20 05:10:59.203955 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:59.203911    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-2ppn6" podUID="3dc6b063-0985-4a59-a45d-329aafeaa9aa" containerName="authorino" containerID="cri-o://4e1e66a7e307db7ebe0c1be9cbb09337d98effcb03f083e52fbcf0a11b654616" gracePeriod=30
Jul 20 05:10:59.452494 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:59.452471    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2ppn6"
Jul 20 05:10:59.573654 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:59.573552    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9qx7\" (UniqueName: \"kubernetes.io/projected/3dc6b063-0985-4a59-a45d-329aafeaa9aa-kube-api-access-m9qx7\") pod \"3dc6b063-0985-4a59-a45d-329aafeaa9aa\" (UID: \"3dc6b063-0985-4a59-a45d-329aafeaa9aa\") "
Jul 20 05:10:59.575748 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:59.575724    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dc6b063-0985-4a59-a45d-329aafeaa9aa-kube-api-access-m9qx7" (OuterVolumeSpecName: "kube-api-access-m9qx7") pod "3dc6b063-0985-4a59-a45d-329aafeaa9aa" (UID: "3dc6b063-0985-4a59-a45d-329aafeaa9aa"). InnerVolumeSpecName "kube-api-access-m9qx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:10:59.674414 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:10:59.674378    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9qx7\" (UniqueName: \"kubernetes.io/projected/3dc6b063-0985-4a59-a45d-329aafeaa9aa-kube-api-access-m9qx7\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:11:00.209182 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:00.209145    2576 generic.go:356] "Generic (PLEG): container finished" podID="3dc6b063-0985-4a59-a45d-329aafeaa9aa" containerID="4e1e66a7e307db7ebe0c1be9cbb09337d98effcb03f083e52fbcf0a11b654616" exitCode=0
Jul 20 05:11:00.209558 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:00.209187    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2ppn6"
Jul 20 05:11:00.209558 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:00.209235    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2ppn6" event={"ID":"3dc6b063-0985-4a59-a45d-329aafeaa9aa","Type":"ContainerDied","Data":"4e1e66a7e307db7ebe0c1be9cbb09337d98effcb03f083e52fbcf0a11b654616"}
Jul 20 05:11:00.209558 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:00.209271    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2ppn6" event={"ID":"3dc6b063-0985-4a59-a45d-329aafeaa9aa","Type":"ContainerDied","Data":"30596fad94586575e4ef8fae027f74fb032782827e70e4db5eeb7b355651bb46"}
Jul 20 05:11:00.209558 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:00.209287    2576 scope.go:117] "RemoveContainer" containerID="4e1e66a7e307db7ebe0c1be9cbb09337d98effcb03f083e52fbcf0a11b654616"
Jul 20 05:11:00.217779 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:00.217762    2576 scope.go:117] "RemoveContainer" containerID="4e1e66a7e307db7ebe0c1be9cbb09337d98effcb03f083e52fbcf0a11b654616"
Jul 20 05:11:00.218042 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:11:00.218023    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e1e66a7e307db7ebe0c1be9cbb09337d98effcb03f083e52fbcf0a11b654616\": container with ID starting with 4e1e66a7e307db7ebe0c1be9cbb09337d98effcb03f083e52fbcf0a11b654616 not found: ID does not exist" containerID="4e1e66a7e307db7ebe0c1be9cbb09337d98effcb03f083e52fbcf0a11b654616"
Jul 20 05:11:00.218124 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:00.218054    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1e66a7e307db7ebe0c1be9cbb09337d98effcb03f083e52fbcf0a11b654616"} err="failed to get container status \"4e1e66a7e307db7ebe0c1be9cbb09337d98effcb03f083e52fbcf0a11b654616\": rpc error: code = NotFound desc = could not find container \"4e1e66a7e307db7ebe0c1be9cbb09337d98effcb03f083e52fbcf0a11b654616\": container with ID starting with 4e1e66a7e307db7ebe0c1be9cbb09337d98effcb03f083e52fbcf0a11b654616 not found: ID does not exist"
Jul 20 05:11:00.228917 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:00.228894    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-2ppn6"]
Jul 20 05:11:00.232110 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:00.232088    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-2ppn6"]
Jul 20 05:11:00.684761 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:00.684687    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3dc6b063-0985-4a59-a45d-329aafeaa9aa" path="/var/lib/kubelet/pods/3dc6b063-0985-4a59-a45d-329aafeaa9aa/volumes"
Jul 20 05:11:25.506234 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.506204    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8fp6s"]
Jul 20 05:11:25.506632 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.506541    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dc6b063-0985-4a59-a45d-329aafeaa9aa" containerName="authorino"
Jul 20 05:11:25.506632 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.506556    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dc6b063-0985-4a59-a45d-329aafeaa9aa" containerName="authorino"
Jul 20 05:11:25.506632 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.506621    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dc6b063-0985-4a59-a45d-329aafeaa9aa" containerName="authorino"
Jul 20 05:11:25.510858 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.510842    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8fp6s"
Jul 20 05:11:25.515934 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.515908    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8fp6s"]
Jul 20 05:11:25.593818 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.593783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmz5k\" (UniqueName: \"kubernetes.io/projected/305fd838-04d8-4679-a55f-944b407e6178-kube-api-access-bmz5k\") pod \"authorino-5d4b67c446-8fp6s\" (UID: \"305fd838-04d8-4679-a55f-944b407e6178\") " pod="kuadrant-system/authorino-5d4b67c446-8fp6s"
Jul 20 05:11:25.694427 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.694391    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmz5k\" (UniqueName: \"kubernetes.io/projected/305fd838-04d8-4679-a55f-944b407e6178-kube-api-access-bmz5k\") pod \"authorino-5d4b67c446-8fp6s\" (UID: \"305fd838-04d8-4679-a55f-944b407e6178\") " pod="kuadrant-system/authorino-5d4b67c446-8fp6s"
Jul 20 05:11:25.702209 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.702176    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmz5k\" (UniqueName: \"kubernetes.io/projected/305fd838-04d8-4679-a55f-944b407e6178-kube-api-access-bmz5k\") pod \"authorino-5d4b67c446-8fp6s\" (UID: \"305fd838-04d8-4679-a55f-944b407e6178\") " pod="kuadrant-system/authorino-5d4b67c446-8fp6s"
Jul 20 05:11:25.734673 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.734638    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8fp6s"]
Jul 20 05:11:25.734915 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.734900    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8fp6s"
Jul 20 05:11:25.766377 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.766300    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59786d6bf8-8bfj9"]
Jul 20 05:11:25.769624 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.769608    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59786d6bf8-8bfj9"
Jul 20 05:11:25.776456 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.776434    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59786d6bf8-8bfj9"]
Jul 20 05:11:25.795095 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.795069    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p25xf\" (UniqueName: \"kubernetes.io/projected/b731fc2d-e323-49c0-8f24-0a58fdb193c0-kube-api-access-p25xf\") pod \"authorino-59786d6bf8-8bfj9\" (UID: \"b731fc2d-e323-49c0-8f24-0a58fdb193c0\") " pod="kuadrant-system/authorino-59786d6bf8-8bfj9"
Jul 20 05:11:25.864292 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.864261    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8fp6s"]
Jul 20 05:11:25.866817 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.866792    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59786d6bf8-8bfj9"]
Jul 20 05:11:25.867088 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:11:25.867060    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-p25xf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-59786d6bf8-8bfj9" podUID="b731fc2d-e323-49c0-8f24-0a58fdb193c0"
Jul 20 05:11:25.867514 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:11:25.867488    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod305fd838_04d8_4679_a55f_944b407e6178.slice/crio-755b927f287ac5d52c28cf966275fb89c0f03efdf006d56682a1baafe0182c74 WatchSource:0}: Error finding container 755b927f287ac5d52c28cf966275fb89c0f03efdf006d56682a1baafe0182c74: Status 404 returned error can't find the container with id 755b927f287ac5d52c28cf966275fb89c0f03efdf006d56682a1baafe0182c74
Jul 20 05:11:25.892600 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.892576    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78fd4cb654-h4trx"]
Jul 20 05:11:25.895768 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.895748    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78fd4cb654-h4trx"
Jul 20 05:11:25.896030 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.896008    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p25xf\" (UniqueName: \"kubernetes.io/projected/b731fc2d-e323-49c0-8f24-0a58fdb193c0-kube-api-access-p25xf\") pod \"authorino-59786d6bf8-8bfj9\" (UID: \"b731fc2d-e323-49c0-8f24-0a58fdb193c0\") " pod="kuadrant-system/authorino-59786d6bf8-8bfj9"
Jul 20 05:11:25.898280 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.898262    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 20 05:11:25.901891 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.901850    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78fd4cb654-h4trx"]
Jul 20 05:11:25.907256 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.907235    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p25xf\" (UniqueName: \"kubernetes.io/projected/b731fc2d-e323-49c0-8f24-0a58fdb193c0-kube-api-access-p25xf\") pod \"authorino-59786d6bf8-8bfj9\" (UID: \"b731fc2d-e323-49c0-8f24-0a58fdb193c0\") " pod="kuadrant-system/authorino-59786d6bf8-8bfj9"
Jul 20 05:11:25.996651 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.996613    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbkvx\" (UniqueName: \"kubernetes.io/projected/623b4e55-91bf-4da4-a5aa-b9a3ac520c82-kube-api-access-vbkvx\") pod \"authorino-78fd4cb654-h4trx\" (UID: \"623b4e55-91bf-4da4-a5aa-b9a3ac520c82\") " pod="kuadrant-system/authorino-78fd4cb654-h4trx"
Jul 20 05:11:25.996827 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:25.996660    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/623b4e55-91bf-4da4-a5aa-b9a3ac520c82-tls-cert\") pod \"authorino-78fd4cb654-h4trx\" (UID: \"623b4e55-91bf-4da4-a5aa-b9a3ac520c82\") " pod="kuadrant-system/authorino-78fd4cb654-h4trx"
Jul 20 05:11:26.097525 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.097440    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbkvx\" (UniqueName: \"kubernetes.io/projected/623b4e55-91bf-4da4-a5aa-b9a3ac520c82-kube-api-access-vbkvx\") pod \"authorino-78fd4cb654-h4trx\" (UID: \"623b4e55-91bf-4da4-a5aa-b9a3ac520c82\") " pod="kuadrant-system/authorino-78fd4cb654-h4trx"
Jul 20 05:11:26.097525 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.097494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/623b4e55-91bf-4da4-a5aa-b9a3ac520c82-tls-cert\") pod \"authorino-78fd4cb654-h4trx\" (UID: \"623b4e55-91bf-4da4-a5aa-b9a3ac520c82\") " pod="kuadrant-system/authorino-78fd4cb654-h4trx"
Jul 20 05:11:26.100031 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.100014    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/623b4e55-91bf-4da4-a5aa-b9a3ac520c82-tls-cert\") pod \"authorino-78fd4cb654-h4trx\" (UID: \"623b4e55-91bf-4da4-a5aa-b9a3ac520c82\") " pod="kuadrant-system/authorino-78fd4cb654-h4trx"
Jul 20 05:11:26.106091 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.106071    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbkvx\" (UniqueName: \"kubernetes.io/projected/623b4e55-91bf-4da4-a5aa-b9a3ac520c82-kube-api-access-vbkvx\") pod \"authorino-78fd4cb654-h4trx\" (UID: \"623b4e55-91bf-4da4-a5aa-b9a3ac520c82\") " pod="kuadrant-system/authorino-78fd4cb654-h4trx"
Jul 20 05:11:26.205676 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.205650    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78fd4cb654-h4trx"
Jul 20 05:11:26.322913 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.322857    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59786d6bf8-8bfj9"
Jul 20 05:11:26.323782 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.323633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8fp6s" event={"ID":"305fd838-04d8-4679-a55f-944b407e6178","Type":"ContainerStarted","Data":"84f4361b9d2aaad70e26a2754216b989d8c43c96ff6aaac7b3577c6efaae658e"}
Jul 20 05:11:26.323782 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.323700    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8fp6s" event={"ID":"305fd838-04d8-4679-a55f-944b407e6178","Type":"ContainerStarted","Data":"755b927f287ac5d52c28cf966275fb89c0f03efdf006d56682a1baafe0182c74"}
Jul 20 05:11:26.323782 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.323718    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-8fp6s" podUID="305fd838-04d8-4679-a55f-944b407e6178" containerName="authorino" containerID="cri-o://84f4361b9d2aaad70e26a2754216b989d8c43c96ff6aaac7b3577c6efaae658e" gracePeriod=30
Jul 20 05:11:26.332027 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.332005    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59786d6bf8-8bfj9"
Jul 20 05:11:26.353447 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.353349    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-8fp6s" podStartSLOduration=1.047330009 podStartE2EDuration="1.353332282s" totalImagesPullingTime="306.002273ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:11:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:11:26.352221823 +0000 UTC m=+742.167715907" watchObservedRunningTime="2026-07-20 05:11:26.353332282 +0000 UTC m=+742.168826354"
Jul 20 05:11:26.357197 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.357172    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78fd4cb654-h4trx"]
Jul 20 05:11:26.379737 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:11:26.379706    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod623b4e55_91bf_4da4_a5aa_b9a3ac520c82.slice/crio-4c436329c5ddbd863bf24c84e4ebc90a00f661ebc770d10c91c103c49e81e4ff WatchSource:0}: Error finding container 4c436329c5ddbd863bf24c84e4ebc90a00f661ebc770d10c91c103c49e81e4ff: Status 404 returned error can't find the container with id 4c436329c5ddbd863bf24c84e4ebc90a00f661ebc770d10c91c103c49e81e4ff
Jul 20 05:11:26.400972 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.400942    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p25xf\" (UniqueName: \"kubernetes.io/projected/b731fc2d-e323-49c0-8f24-0a58fdb193c0-kube-api-access-p25xf\") pod \"b731fc2d-e323-49c0-8f24-0a58fdb193c0\" (UID: \"b731fc2d-e323-49c0-8f24-0a58fdb193c0\") "
Jul 20 05:11:26.403257 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.403227    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b731fc2d-e323-49c0-8f24-0a58fdb193c0-kube-api-access-p25xf" (OuterVolumeSpecName: "kube-api-access-p25xf") pod "b731fc2d-e323-49c0-8f24-0a58fdb193c0" (UID: "b731fc2d-e323-49c0-8f24-0a58fdb193c0"). InnerVolumeSpecName "kube-api-access-p25xf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:11:26.502437 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.502407    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p25xf\" (UniqueName: \"kubernetes.io/projected/b731fc2d-e323-49c0-8f24-0a58fdb193c0-kube-api-access-p25xf\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:11:26.555271 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.555243    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8fp6s"
Jul 20 05:11:26.603750 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.603665    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmz5k\" (UniqueName: \"kubernetes.io/projected/305fd838-04d8-4679-a55f-944b407e6178-kube-api-access-bmz5k\") pod \"305fd838-04d8-4679-a55f-944b407e6178\" (UID: \"305fd838-04d8-4679-a55f-944b407e6178\") "
Jul 20 05:11:26.605841 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.605812    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/305fd838-04d8-4679-a55f-944b407e6178-kube-api-access-bmz5k" (OuterVolumeSpecName: "kube-api-access-bmz5k") pod "305fd838-04d8-4679-a55f-944b407e6178" (UID: "305fd838-04d8-4679-a55f-944b407e6178"). InnerVolumeSpecName "kube-api-access-bmz5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:11:26.704317 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:26.704282    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmz5k\" (UniqueName: \"kubernetes.io/projected/305fd838-04d8-4679-a55f-944b407e6178-kube-api-access-bmz5k\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:11:27.328591 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.328549    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78fd4cb654-h4trx" event={"ID":"623b4e55-91bf-4da4-a5aa-b9a3ac520c82","Type":"ContainerStarted","Data":"3f0b04751244c13fa4f6e7bf47ac21af9f0d06c2617ccfa7dddf95577670631c"}
Jul 20 05:11:27.328800 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.328610    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78fd4cb654-h4trx" event={"ID":"623b4e55-91bf-4da4-a5aa-b9a3ac520c82","Type":"ContainerStarted","Data":"4c436329c5ddbd863bf24c84e4ebc90a00f661ebc770d10c91c103c49e81e4ff"}
Jul 20 05:11:27.329800 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.329776    2576 generic.go:356] "Generic (PLEG): container finished" podID="305fd838-04d8-4679-a55f-944b407e6178" containerID="84f4361b9d2aaad70e26a2754216b989d8c43c96ff6aaac7b3577c6efaae658e" exitCode=0
Jul 20 05:11:27.329910 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.329809    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-8fp6s"
Jul 20 05:11:27.329910 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.329839    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8fp6s" event={"ID":"305fd838-04d8-4679-a55f-944b407e6178","Type":"ContainerDied","Data":"84f4361b9d2aaad70e26a2754216b989d8c43c96ff6aaac7b3577c6efaae658e"}
Jul 20 05:11:27.329910 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.329867    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-8fp6s" event={"ID":"305fd838-04d8-4679-a55f-944b407e6178","Type":"ContainerDied","Data":"755b927f287ac5d52c28cf966275fb89c0f03efdf006d56682a1baafe0182c74"}
Jul 20 05:11:27.329910 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.329899    2576 scope.go:117] "RemoveContainer" containerID="84f4361b9d2aaad70e26a2754216b989d8c43c96ff6aaac7b3577c6efaae658e"
Jul 20 05:11:27.330063 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.330018    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59786d6bf8-8bfj9"
Jul 20 05:11:27.338139 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.338123    2576 scope.go:117] "RemoveContainer" containerID="84f4361b9d2aaad70e26a2754216b989d8c43c96ff6aaac7b3577c6efaae658e"
Jul 20 05:11:27.338401 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:11:27.338382    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84f4361b9d2aaad70e26a2754216b989d8c43c96ff6aaac7b3577c6efaae658e\": container with ID starting with 84f4361b9d2aaad70e26a2754216b989d8c43c96ff6aaac7b3577c6efaae658e not found: ID does not exist" containerID="84f4361b9d2aaad70e26a2754216b989d8c43c96ff6aaac7b3577c6efaae658e"
Jul 20 05:11:27.338456 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.338414    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84f4361b9d2aaad70e26a2754216b989d8c43c96ff6aaac7b3577c6efaae658e"} err="failed to get container status \"84f4361b9d2aaad70e26a2754216b989d8c43c96ff6aaac7b3577c6efaae658e\": rpc error: code = NotFound desc = could not find container \"84f4361b9d2aaad70e26a2754216b989d8c43c96ff6aaac7b3577c6efaae658e\": container with ID starting with 84f4361b9d2aaad70e26a2754216b989d8c43c96ff6aaac7b3577c6efaae658e not found: ID does not exist"
Jul 20 05:11:27.344693 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.344654    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-78fd4cb654-h4trx" podStartSLOduration=2.020504583 podStartE2EDuration="2.344641981s" totalImagesPullingTime="324.137398ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:11:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:11:27.34406447 +0000 UTC m=+743.159558543" watchObservedRunningTime="2026-07-20 05:11:27.344641981 +0000 UTC m=+743.160136053"
Jul 20 05:11:27.357230 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.357205    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8fp6s"]
Jul 20 05:11:27.362368 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.362343    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-8fp6s"]
Jul 20 05:11:27.367800 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.367777    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvxdp"]
Jul 20 05:11:27.368026 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.368001    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-bvxdp" podUID="f0e63fec-6182-4eb8-8108-e02e85618711" containerName="authorino" containerID="cri-o://0f677218856e7d97c248192049df53d7f59aec90c587789a2eb973b340f445a1" gracePeriod=30
Jul 20 05:11:27.391749 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.391726    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59786d6bf8-8bfj9"]
Jul 20 05:11:27.394389 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.394368    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59786d6bf8-8bfj9"]
Jul 20 05:11:27.608365 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.608342    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bvxdp"
Jul 20 05:11:27.712401 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.712378    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl62m\" (UniqueName: \"kubernetes.io/projected/f0e63fec-6182-4eb8-8108-e02e85618711-kube-api-access-hl62m\") pod \"f0e63fec-6182-4eb8-8108-e02e85618711\" (UID: \"f0e63fec-6182-4eb8-8108-e02e85618711\") "
Jul 20 05:11:27.714514 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.714493    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0e63fec-6182-4eb8-8108-e02e85618711-kube-api-access-hl62m" (OuterVolumeSpecName: "kube-api-access-hl62m") pod "f0e63fec-6182-4eb8-8108-e02e85618711" (UID: "f0e63fec-6182-4eb8-8108-e02e85618711"). InnerVolumeSpecName "kube-api-access-hl62m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:11:27.813693 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:27.813657    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl62m\" (UniqueName: \"kubernetes.io/projected/f0e63fec-6182-4eb8-8108-e02e85618711-kube-api-access-hl62m\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:11:28.336954 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:28.336922    2576 generic.go:356] "Generic (PLEG): container finished" podID="f0e63fec-6182-4eb8-8108-e02e85618711" containerID="0f677218856e7d97c248192049df53d7f59aec90c587789a2eb973b340f445a1" exitCode=0
Jul 20 05:11:28.337159 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:28.336965    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bvxdp"
Jul 20 05:11:28.337159 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:28.337009    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bvxdp" event={"ID":"f0e63fec-6182-4eb8-8108-e02e85618711","Type":"ContainerDied","Data":"0f677218856e7d97c248192049df53d7f59aec90c587789a2eb973b340f445a1"}
Jul 20 05:11:28.337159 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:28.337048    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bvxdp" event={"ID":"f0e63fec-6182-4eb8-8108-e02e85618711","Type":"ContainerDied","Data":"4c2160a0c4f09e16653540e1200ab9c6a6a976fdebadedc054b7423d0a3a4ebb"}
Jul 20 05:11:28.337159 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:28.337067    2576 scope.go:117] "RemoveContainer" containerID="0f677218856e7d97c248192049df53d7f59aec90c587789a2eb973b340f445a1"
Jul 20 05:11:28.346025 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:28.346010    2576 scope.go:117] "RemoveContainer" containerID="0f677218856e7d97c248192049df53d7f59aec90c587789a2eb973b340f445a1"
Jul 20 05:11:28.346264 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:11:28.346248    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f677218856e7d97c248192049df53d7f59aec90c587789a2eb973b340f445a1\": container with ID starting with 0f677218856e7d97c248192049df53d7f59aec90c587789a2eb973b340f445a1 not found: ID does not exist" containerID="0f677218856e7d97c248192049df53d7f59aec90c587789a2eb973b340f445a1"
Jul 20 05:11:28.346306 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:28.346272    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f677218856e7d97c248192049df53d7f59aec90c587789a2eb973b340f445a1"} err="failed to get container status \"0f677218856e7d97c248192049df53d7f59aec90c587789a2eb973b340f445a1\": rpc error: code = NotFound desc = could not find container \"0f677218856e7d97c248192049df53d7f59aec90c587789a2eb973b340f445a1\": container with ID starting with 0f677218856e7d97c248192049df53d7f59aec90c587789a2eb973b340f445a1 not found: ID does not exist"
Jul 20 05:11:28.356925 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:28.356905    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvxdp"]
Jul 20 05:11:28.360537 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:28.360517    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bvxdp"]
Jul 20 05:11:28.680451 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:28.680381    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="305fd838-04d8-4679-a55f-944b407e6178" path="/var/lib/kubelet/pods/305fd838-04d8-4679-a55f-944b407e6178/volumes"
Jul 20 05:11:28.680777 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:28.680669    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b731fc2d-e323-49c0-8f24-0a58fdb193c0" path="/var/lib/kubelet/pods/b731fc2d-e323-49c0-8f24-0a58fdb193c0/volumes"
Jul 20 05:11:28.680851 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:11:28.680839    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0e63fec-6182-4eb8-8108-e02e85618711" path="/var/lib/kubelet/pods/f0e63fec-6182-4eb8-8108-e02e85618711/volumes"
Jul 20 05:12:08.486628 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.486593    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"]
Jul 20 05:12:08.487056 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.486918    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="305fd838-04d8-4679-a55f-944b407e6178" containerName="authorino"
Jul 20 05:12:08.487056 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.486929    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="305fd838-04d8-4679-a55f-944b407e6178" containerName="authorino"
Jul 20 05:12:08.487056 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.486949    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0e63fec-6182-4eb8-8108-e02e85618711" containerName="authorino"
Jul 20 05:12:08.487056 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.486954    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0e63fec-6182-4eb8-8108-e02e85618711" containerName="authorino"
Jul 20 05:12:08.487056 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.487037    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0e63fec-6182-4eb8-8108-e02e85618711" containerName="authorino"
Jul 20 05:12:08.487056 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.487044    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="305fd838-04d8-4679-a55f-944b407e6178" containerName="authorino"
Jul 20 05:12:08.489594 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.489579    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"
Jul 20 05:12:08.492309 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.492288    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 20 05:12:08.493368 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.493352    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 05:12:08.493368 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.493362    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2f45g\""
Jul 20 05:12:08.493500 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.493362    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 20 05:12:08.500646 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.500622    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"]
Jul 20 05:12:08.554508 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.554477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec945dd-909d-4615-ad40-40dad3887f48-openshift-service-ca\") pod \"maas-api-547448bff5-9wx7b\" (UID: \"7ec945dd-909d-4615-ad40-40dad3887f48\") " pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"
Jul 20 05:12:08.554682 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.554522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7df2\" (UniqueName: \"kubernetes.io/projected/7ec945dd-909d-4615-ad40-40dad3887f48-kube-api-access-k7df2\") pod \"maas-api-547448bff5-9wx7b\" (UID: \"7ec945dd-909d-4615-ad40-40dad3887f48\") " pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"
Jul 20 05:12:08.554682 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.554537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ec945dd-909d-4615-ad40-40dad3887f48-maas-api-tls\") pod \"maas-api-547448bff5-9wx7b\" (UID: \"7ec945dd-909d-4615-ad40-40dad3887f48\") " pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"
Jul 20 05:12:08.655405 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.655375    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec945dd-909d-4615-ad40-40dad3887f48-openshift-service-ca\") pod \"maas-api-547448bff5-9wx7b\" (UID: \"7ec945dd-909d-4615-ad40-40dad3887f48\") " pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"
Jul 20 05:12:08.655542 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.655425    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7df2\" (UniqueName: \"kubernetes.io/projected/7ec945dd-909d-4615-ad40-40dad3887f48-kube-api-access-k7df2\") pod \"maas-api-547448bff5-9wx7b\" (UID: \"7ec945dd-909d-4615-ad40-40dad3887f48\") " pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"
Jul 20 05:12:08.655542 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.655446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ec945dd-909d-4615-ad40-40dad3887f48-maas-api-tls\") pod \"maas-api-547448bff5-9wx7b\" (UID: \"7ec945dd-909d-4615-ad40-40dad3887f48\") " pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"
Jul 20 05:12:08.655617 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:12:08.655549    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 20 05:12:08.655617 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:12:08.655610    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec945dd-909d-4615-ad40-40dad3887f48-maas-api-tls podName:7ec945dd-909d-4615-ad40-40dad3887f48 nodeName:}" failed. No retries permitted until 2026-07-20 05:12:09.155594106 +0000 UTC m=+784.971088156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7ec945dd-909d-4615-ad40-40dad3887f48-maas-api-tls") pod "maas-api-547448bff5-9wx7b" (UID: "7ec945dd-909d-4615-ad40-40dad3887f48") : secret "maas-api-serving-cert" not found
Jul 20 05:12:08.656102 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.656083    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec945dd-909d-4615-ad40-40dad3887f48-openshift-service-ca\") pod \"maas-api-547448bff5-9wx7b\" (UID: \"7ec945dd-909d-4615-ad40-40dad3887f48\") " pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"
Jul 20 05:12:08.665849 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:08.665817    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7df2\" (UniqueName: \"kubernetes.io/projected/7ec945dd-909d-4615-ad40-40dad3887f48-kube-api-access-k7df2\") pod \"maas-api-547448bff5-9wx7b\" (UID: \"7ec945dd-909d-4615-ad40-40dad3887f48\") " pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"
Jul 20 05:12:09.159370 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:09.159325    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ec945dd-909d-4615-ad40-40dad3887f48-maas-api-tls\") pod \"maas-api-547448bff5-9wx7b\" (UID: \"7ec945dd-909d-4615-ad40-40dad3887f48\") " pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"
Jul 20 05:12:09.159575 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:12:09.159489    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 20 05:12:09.159652 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:12:09.159577    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ec945dd-909d-4615-ad40-40dad3887f48-maas-api-tls podName:7ec945dd-909d-4615-ad40-40dad3887f48 nodeName:}" failed. No retries permitted until 2026-07-20 05:12:10.159556065 +0000 UTC m=+785.975050129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7ec945dd-909d-4615-ad40-40dad3887f48-maas-api-tls") pod "maas-api-547448bff5-9wx7b" (UID: "7ec945dd-909d-4615-ad40-40dad3887f48") : secret "maas-api-serving-cert" not found
Jul 20 05:12:10.167841 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:10.167803    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ec945dd-909d-4615-ad40-40dad3887f48-maas-api-tls\") pod \"maas-api-547448bff5-9wx7b\" (UID: \"7ec945dd-909d-4615-ad40-40dad3887f48\") " pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"
Jul 20 05:12:10.170390 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:10.170372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ec945dd-909d-4615-ad40-40dad3887f48-maas-api-tls\") pod \"maas-api-547448bff5-9wx7b\" (UID: \"7ec945dd-909d-4615-ad40-40dad3887f48\") " pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"
Jul 20 05:12:10.300444 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:10.300391    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"
Jul 20 05:12:10.427635 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:10.427611    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"]
Jul 20 05:12:10.430047 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:12:10.430019    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec945dd_909d_4615_ad40_40dad3887f48.slice/crio-b008b6afbc80ab42435e53b87225e8d038f5e49eba5803caf4ace1542e1bf775 WatchSource:0}: Error finding container b008b6afbc80ab42435e53b87225e8d038f5e49eba5803caf4ace1542e1bf775: Status 404 returned error can't find the container with id b008b6afbc80ab42435e53b87225e8d038f5e49eba5803caf4ace1542e1bf775
Jul 20 05:12:10.516896 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:10.516855    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b" event={"ID":"7ec945dd-909d-4615-ad40-40dad3887f48","Type":"ContainerStarted","Data":"b008b6afbc80ab42435e53b87225e8d038f5e49eba5803caf4ace1542e1bf775"}
Jul 20 05:12:13.534722 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:13.534680    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b" event={"ID":"7ec945dd-909d-4615-ad40-40dad3887f48","Type":"ContainerStarted","Data":"1f8fcdff107486e97a4cf1de3f70764c6275d735cd3e44f64586024d1ce73d6d"}
Jul 20 05:12:13.535131 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:13.534771    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"
Jul 20 05:12:13.551314 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:13.551265    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b" podStartSLOduration=3.301436391 podStartE2EDuration="5.551248772s" totalImagesPullingTime="2.249812381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:12:13.549647037 +0000 UTC m=+789.365141109" watchObservedRunningTime="2026-07-20 05:12:13.551248772 +0000 UTC m=+789.366742888"
Jul 20 05:12:19.545002 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:19.544969    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-547448bff5-9wx7b"
Jul 20 05:12:46.817036 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:46.817006    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"]
Jul 20 05:12:46.824774 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:46.824753    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:46.827736 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:46.827584    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pg8cj\""
Jul 20 05:12:46.827736 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:46.827602    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 05:12:46.828333 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:46.828308    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 05:12:46.828333 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:46.828323    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 20 05:12:46.829269 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:46.829247    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"]
Jul 20 05:12:46.984821 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:46.984787    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2003f6ab-73a9-4c0f-a332-8413e49b96c3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:46.984821 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:46.984816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2003f6ab-73a9-4c0f-a332-8413e49b96c3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:46.985046 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:46.984870    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwr2q\" (UniqueName: \"kubernetes.io/projected/2003f6ab-73a9-4c0f-a332-8413e49b96c3-kube-api-access-xwr2q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:46.985046 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:46.984909    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2003f6ab-73a9-4c0f-a332-8413e49b96c3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:46.985046 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:46.984924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2003f6ab-73a9-4c0f-a332-8413e49b96c3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:46.985046 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:46.984938    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2003f6ab-73a9-4c0f-a332-8413e49b96c3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:47.086016 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:47.085942    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2003f6ab-73a9-4c0f-a332-8413e49b96c3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:47.086016 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:47.085972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2003f6ab-73a9-4c0f-a332-8413e49b96c3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:47.086167 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:47.086035    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2003f6ab-73a9-4c0f-a332-8413e49b96c3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:47.086167 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:47.086057    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2003f6ab-73a9-4c0f-a332-8413e49b96c3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:47.086167 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:47.086113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwr2q\" (UniqueName: \"kubernetes.io/projected/2003f6ab-73a9-4c0f-a332-8413e49b96c3-kube-api-access-xwr2q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:47.086167 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:47.086140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2003f6ab-73a9-4c0f-a332-8413e49b96c3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:47.086467 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:47.086438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2003f6ab-73a9-4c0f-a332-8413e49b96c3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:47.086569 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:47.086551    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2003f6ab-73a9-4c0f-a332-8413e49b96c3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:47.086612 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:47.086551    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2003f6ab-73a9-4c0f-a332-8413e49b96c3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:47.088465 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:47.088429    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2003f6ab-73a9-4c0f-a332-8413e49b96c3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:47.088614 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:47.088596    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2003f6ab-73a9-4c0f-a332-8413e49b96c3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:47.093673 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:47.093650    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwr2q\" (UniqueName: \"kubernetes.io/projected/2003f6ab-73a9-4c0f-a332-8413e49b96c3-kube-api-access-xwr2q\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wljgc\" (UID: \"2003f6ab-73a9-4c0f-a332-8413e49b96c3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:47.135944 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:47.135916    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:47.265902 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:47.265856    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"]
Jul 20 05:12:47.268236 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:12:47.268190    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2003f6ab_73a9_4c0f_a332_8413e49b96c3.slice/crio-53f516c31be203c5feffdd5e9ed38782e0418766b9493b31a970125bc35f7db4 WatchSource:0}: Error finding container 53f516c31be203c5feffdd5e9ed38782e0418766b9493b31a970125bc35f7db4: Status 404 returned error can't find the container with id 53f516c31be203c5feffdd5e9ed38782e0418766b9493b31a970125bc35f7db4
Jul 20 05:12:47.690469 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:47.690428    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc" event={"ID":"2003f6ab-73a9-4c0f-a332-8413e49b96c3","Type":"ContainerStarted","Data":"53f516c31be203c5feffdd5e9ed38782e0418766b9493b31a970125bc35f7db4"}
Jul 20 05:12:48.696170 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:48.696138    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc" event={"ID":"2003f6ab-73a9-4c0f-a332-8413e49b96c3","Type":"ContainerStarted","Data":"baf0a9e87d7dd64a6c11156f1ffce64a5422fdfd66431d1d9d6f75d4e36c5412"}
Jul 20 05:12:48.713896 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:48.713828    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc" podStartSLOduration=1.617088512 podStartE2EDuration="2.71381355s" totalImagesPullingTime="1.096725038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:12:48.712073154 +0000 UTC m=+824.527567251" watchObservedRunningTime="2026-07-20 05:12:48.71381355 +0000 UTC m=+824.529307622"
Jul 20 05:12:57.136661 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:57.136625    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:57.137141 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:57.136693    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:57.149104 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:57.149082    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:57.743780 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:57.743745    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wljgc"
Jul 20 05:12:59.118974 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.118941    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"]
Jul 20 05:12:59.122308 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.122285    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.124686 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.124668    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 20 05:12:59.131267 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.131244    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"]
Jul 20 05:12:59.184816 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.184782    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1397342c-95e4-47b2-9110-d2f98ff67560-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.184816 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.184819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1397342c-95e4-47b2-9110-d2f98ff67560-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.185059 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.184840    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5grt\" (UniqueName: \"kubernetes.io/projected/1397342c-95e4-47b2-9110-d2f98ff67560-kube-api-access-f5grt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.185059 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.184949    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1397342c-95e4-47b2-9110-d2f98ff67560-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.185059 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.184991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1397342c-95e4-47b2-9110-d2f98ff67560-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.185059 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.185044    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1397342c-95e4-47b2-9110-d2f98ff67560-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.285615 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.285581    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1397342c-95e4-47b2-9110-d2f98ff67560-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.285615 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.285618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1397342c-95e4-47b2-9110-d2f98ff67560-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.285866 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.285638    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5grt\" (UniqueName: \"kubernetes.io/projected/1397342c-95e4-47b2-9110-d2f98ff67560-kube-api-access-f5grt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.285866 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.285664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1397342c-95e4-47b2-9110-d2f98ff67560-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.285866 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.285691    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1397342c-95e4-47b2-9110-d2f98ff67560-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.285866 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.285740    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1397342c-95e4-47b2-9110-d2f98ff67560-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.286129 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.286110    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1397342c-95e4-47b2-9110-d2f98ff67560-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.286178 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.286143    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1397342c-95e4-47b2-9110-d2f98ff67560-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.286178 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.286169    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1397342c-95e4-47b2-9110-d2f98ff67560-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.288213 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.288196    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1397342c-95e4-47b2-9110-d2f98ff67560-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.288495 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.288476    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1397342c-95e4-47b2-9110-d2f98ff67560-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.292918 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.292901    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5grt\" (UniqueName: \"kubernetes.io/projected/1397342c-95e4-47b2-9110-d2f98ff67560-kube-api-access-f5grt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-8kwdv\" (UID: \"1397342c-95e4-47b2-9110-d2f98ff67560\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.432810 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.432724    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:12:59.559092 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.559068    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"]
Jul 20 05:12:59.560815 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:12:59.560792    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1397342c_95e4_47b2_9110_d2f98ff67560.slice/crio-23296698c5b1e6ea79f279b6abeabe259df14eb7dd39118c9950c51af2bbd01a WatchSource:0}: Error finding container 23296698c5b1e6ea79f279b6abeabe259df14eb7dd39118c9950c51af2bbd01a: Status 404 returned error can't find the container with id 23296698c5b1e6ea79f279b6abeabe259df14eb7dd39118c9950c51af2bbd01a
Jul 20 05:12:59.740869 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:12:59.740845    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv" event={"ID":"1397342c-95e4-47b2-9110-d2f98ff67560","Type":"ContainerStarted","Data":"23296698c5b1e6ea79f279b6abeabe259df14eb7dd39118c9950c51af2bbd01a"}
Jul 20 05:13:00.748632 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:00.748590    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv" event={"ID":"1397342c-95e4-47b2-9110-d2f98ff67560","Type":"ContainerStarted","Data":"0687bb779f9bda9c7774e930d1168c2020db4cf87c0637c2ce2de208abfd3a67"}
Jul 20 05:13:00.764861 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:00.764797    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv" podStartSLOduration=1.593272926 podStartE2EDuration="1.764776887s" totalImagesPullingTime="171.503961ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:12:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:13:00.763809677 +0000 UTC m=+836.579303750" watchObservedRunningTime="2026-07-20 05:13:00.764776887 +0000 UTC m=+836.580270960"
Jul 20 05:13:09.433267 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:09.433227    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:13:09.433733 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:09.433386    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:13:09.445754 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:09.445730    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:13:09.800277 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:09.800252    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-8kwdv"
Jul 20 05:13:50.527842 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.527805    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"]
Jul 20 05:13:50.531331 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.531311    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.533813 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.533794    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 20 05:13:50.541394 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.541374    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"]
Jul 20 05:13:50.621292 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.621269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.621396 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.621307    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.621396 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.621365    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25jfg\" (UniqueName: \"kubernetes.io/projected/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-kube-api-access-25jfg\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.621465 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.621408    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.621465 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.621428    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.621465 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.621461    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.722009 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.721983    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.722118 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.722024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25jfg\" (UniqueName: \"kubernetes.io/projected/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-kube-api-access-25jfg\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.722118 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.722048    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.722118 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.722071    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.722118 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.722112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.722282 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.722165    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.722497 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.722473    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.722564 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.722506    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.722564 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.722541    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.724355 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.724336    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.724464 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.724447    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.729139 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.729117    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25jfg\" (UniqueName: \"kubernetes.io/projected/b5fb42c9-ac7c-43d4-a55a-055af9490c6f-kube-api-access-25jfg\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ct82c\" (UID: \"b5fb42c9-ac7c-43d4-a55a-055af9490c6f\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.858529 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.858463    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:13:50.989492 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:50.989448    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"]
Jul 20 05:13:50.991668 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:13:50.991645    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5fb42c9_ac7c_43d4_a55a_055af9490c6f.slice/crio-55ddd091bcbe91cdc086c743e6bf58b3e3bc80d81b4cc506c610c7f0a225fc32 WatchSource:0}: Error finding container 55ddd091bcbe91cdc086c743e6bf58b3e3bc80d81b4cc506c610c7f0a225fc32: Status 404 returned error can't find the container with id 55ddd091bcbe91cdc086c743e6bf58b3e3bc80d81b4cc506c610c7f0a225fc32
Jul 20 05:13:51.975161 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:51.975124    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c" event={"ID":"b5fb42c9-ac7c-43d4-a55a-055af9490c6f","Type":"ContainerStarted","Data":"c8330b12f78bae9344942bf8a977ed4bbdd22c2a034bf78c63019a48985c13d5"}
Jul 20 05:13:51.975161 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:51.975164    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c" event={"ID":"b5fb42c9-ac7c-43d4-a55a-055af9490c6f","Type":"ContainerStarted","Data":"55ddd091bcbe91cdc086c743e6bf58b3e3bc80d81b4cc506c610c7f0a225fc32"}
Jul 20 05:13:51.991405 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:13:51.991361    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c" podStartSLOduration=1.8215596330000001 podStartE2EDuration="1.991345978s" totalImagesPullingTime="169.786345ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:13:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:13:51.99025925 +0000 UTC m=+887.805753378" watchObservedRunningTime="2026-07-20 05:13:51.991345978 +0000 UTC m=+887.806840050"
Jul 20 05:14:00.859353 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:14:00.859271    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:14:00.859353 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:14:00.859331    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:14:00.871706 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:14:00.871677    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:14:01.027083 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:14:01.027057    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ct82c"
Jul 20 05:15:05.094969 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:05.094934    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-bb6b7f4c-qbff2"]
Jul 20 05:15:05.098131 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:05.098115    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bb6b7f4c-qbff2"
Jul 20 05:15:05.105871 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:05.105846    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bb6b7f4c-qbff2"]
Jul 20 05:15:05.149201 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:05.149171    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5ad934c-257c-4344-a3ec-0248d18312f7-tls-cert\") pod \"authorino-bb6b7f4c-qbff2\" (UID: \"a5ad934c-257c-4344-a3ec-0248d18312f7\") " pod="kuadrant-system/authorino-bb6b7f4c-qbff2"
Jul 20 05:15:05.149357 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:05.149252    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcxxb\" (UniqueName: \"kubernetes.io/projected/a5ad934c-257c-4344-a3ec-0248d18312f7-kube-api-access-tcxxb\") pod \"authorino-bb6b7f4c-qbff2\" (UID: \"a5ad934c-257c-4344-a3ec-0248d18312f7\") " pod="kuadrant-system/authorino-bb6b7f4c-qbff2"
Jul 20 05:15:05.250154 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:05.250118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5ad934c-257c-4344-a3ec-0248d18312f7-tls-cert\") pod \"authorino-bb6b7f4c-qbff2\" (UID: \"a5ad934c-257c-4344-a3ec-0248d18312f7\") " pod="kuadrant-system/authorino-bb6b7f4c-qbff2"
Jul 20 05:15:05.250291 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:05.250202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcxxb\" (UniqueName: \"kubernetes.io/projected/a5ad934c-257c-4344-a3ec-0248d18312f7-kube-api-access-tcxxb\") pod \"authorino-bb6b7f4c-qbff2\" (UID: \"a5ad934c-257c-4344-a3ec-0248d18312f7\") " pod="kuadrant-system/authorino-bb6b7f4c-qbff2"
Jul 20 05:15:05.252709 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:05.252680    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5ad934c-257c-4344-a3ec-0248d18312f7-tls-cert\") pod \"authorino-bb6b7f4c-qbff2\" (UID: \"a5ad934c-257c-4344-a3ec-0248d18312f7\") " pod="kuadrant-system/authorino-bb6b7f4c-qbff2"
Jul 20 05:15:05.257793 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:05.257771    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcxxb\" (UniqueName: \"kubernetes.io/projected/a5ad934c-257c-4344-a3ec-0248d18312f7-kube-api-access-tcxxb\") pod \"authorino-bb6b7f4c-qbff2\" (UID: \"a5ad934c-257c-4344-a3ec-0248d18312f7\") " pod="kuadrant-system/authorino-bb6b7f4c-qbff2"
Jul 20 05:15:05.407584 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:05.407492    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bb6b7f4c-qbff2"
Jul 20 05:15:05.534765 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:05.534732    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bb6b7f4c-qbff2"]
Jul 20 05:15:05.537636 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:15:05.537607    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5ad934c_257c_4344_a3ec_0248d18312f7.slice/crio-965d97a91f2d6b770cdaf2da54656181920c7764ccf85a3dcc3d30ea7291de71 WatchSource:0}: Error finding container 965d97a91f2d6b770cdaf2da54656181920c7764ccf85a3dcc3d30ea7291de71: Status 404 returned error can't find the container with id 965d97a91f2d6b770cdaf2da54656181920c7764ccf85a3dcc3d30ea7291de71
Jul 20 05:15:05.539094 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:05.539076    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 05:15:06.314700 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:06.314658    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bb6b7f4c-qbff2" event={"ID":"a5ad934c-257c-4344-a3ec-0248d18312f7","Type":"ContainerStarted","Data":"965d97a91f2d6b770cdaf2da54656181920c7764ccf85a3dcc3d30ea7291de71"}
Jul 20 05:15:07.320773 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:07.320731    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bb6b7f4c-qbff2" event={"ID":"a5ad934c-257c-4344-a3ec-0248d18312f7","Type":"ContainerStarted","Data":"8f4f96b03cb0ce612470efce71e491f2483cd90085523b2a9568615a69482e9d"}
Jul 20 05:15:07.337536 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:07.337483    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-bb6b7f4c-qbff2" podStartSLOduration=1.608650843 podStartE2EDuration="2.337468341s" totalImagesPullingTime="728.817498ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:15:07.336220298 +0000 UTC m=+963.151714372" watchObservedRunningTime="2026-07-20 05:15:07.337468341 +0000 UTC m=+963.152962415"
Jul 20 05:15:07.360317 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:07.360280    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78fd4cb654-h4trx"]
Jul 20 05:15:07.360532 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:07.360504    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-78fd4cb654-h4trx" podUID="623b4e55-91bf-4da4-a5aa-b9a3ac520c82" containerName="authorino" containerID="cri-o://3f0b04751244c13fa4f6e7bf47ac21af9f0d06c2617ccfa7dddf95577670631c" gracePeriod=30
Jul 20 05:15:07.605023 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:07.604992    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78fd4cb654-h4trx"
Jul 20 05:15:07.670722 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:07.670665    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbkvx\" (UniqueName: \"kubernetes.io/projected/623b4e55-91bf-4da4-a5aa-b9a3ac520c82-kube-api-access-vbkvx\") pod \"623b4e55-91bf-4da4-a5aa-b9a3ac520c82\" (UID: \"623b4e55-91bf-4da4-a5aa-b9a3ac520c82\") "
Jul 20 05:15:07.670984 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:07.670766    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/623b4e55-91bf-4da4-a5aa-b9a3ac520c82-tls-cert\") pod \"623b4e55-91bf-4da4-a5aa-b9a3ac520c82\" (UID: \"623b4e55-91bf-4da4-a5aa-b9a3ac520c82\") "
Jul 20 05:15:07.672947 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:07.672914    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/623b4e55-91bf-4da4-a5aa-b9a3ac520c82-kube-api-access-vbkvx" (OuterVolumeSpecName: "kube-api-access-vbkvx") pod "623b4e55-91bf-4da4-a5aa-b9a3ac520c82" (UID: "623b4e55-91bf-4da4-a5aa-b9a3ac520c82"). InnerVolumeSpecName "kube-api-access-vbkvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:15:07.681460 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:07.681427    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/623b4e55-91bf-4da4-a5aa-b9a3ac520c82-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "623b4e55-91bf-4da4-a5aa-b9a3ac520c82" (UID: "623b4e55-91bf-4da4-a5aa-b9a3ac520c82"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:15:07.771713 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:07.771680    2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/623b4e55-91bf-4da4-a5aa-b9a3ac520c82-tls-cert\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:15:07.771713 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:07.771708    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbkvx\" (UniqueName: \"kubernetes.io/projected/623b4e55-91bf-4da4-a5aa-b9a3ac520c82-kube-api-access-vbkvx\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:15:08.326957 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:08.326923    2576 generic.go:356] "Generic (PLEG): container finished" podID="623b4e55-91bf-4da4-a5aa-b9a3ac520c82" containerID="3f0b04751244c13fa4f6e7bf47ac21af9f0d06c2617ccfa7dddf95577670631c" exitCode=0
Jul 20 05:15:08.327421 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:08.326986    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78fd4cb654-h4trx"
Jul 20 05:15:08.327421 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:08.327012    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78fd4cb654-h4trx" event={"ID":"623b4e55-91bf-4da4-a5aa-b9a3ac520c82","Type":"ContainerDied","Data":"3f0b04751244c13fa4f6e7bf47ac21af9f0d06c2617ccfa7dddf95577670631c"}
Jul 20 05:15:08.327421 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:08.327049    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78fd4cb654-h4trx" event={"ID":"623b4e55-91bf-4da4-a5aa-b9a3ac520c82","Type":"ContainerDied","Data":"4c436329c5ddbd863bf24c84e4ebc90a00f661ebc770d10c91c103c49e81e4ff"}
Jul 20 05:15:08.327421 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:08.327066    2576 scope.go:117] "RemoveContainer" containerID="3f0b04751244c13fa4f6e7bf47ac21af9f0d06c2617ccfa7dddf95577670631c"
Jul 20 05:15:08.335938 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:08.335921    2576 scope.go:117] "RemoveContainer" containerID="3f0b04751244c13fa4f6e7bf47ac21af9f0d06c2617ccfa7dddf95577670631c"
Jul 20 05:15:08.336180 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:15:08.336161    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f0b04751244c13fa4f6e7bf47ac21af9f0d06c2617ccfa7dddf95577670631c\": container with ID starting with 3f0b04751244c13fa4f6e7bf47ac21af9f0d06c2617ccfa7dddf95577670631c not found: ID does not exist" containerID="3f0b04751244c13fa4f6e7bf47ac21af9f0d06c2617ccfa7dddf95577670631c"
Jul 20 05:15:08.336247 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:08.336188    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f0b04751244c13fa4f6e7bf47ac21af9f0d06c2617ccfa7dddf95577670631c"} err="failed to get container status \"3f0b04751244c13fa4f6e7bf47ac21af9f0d06c2617ccfa7dddf95577670631c\": rpc error: code = NotFound desc = could not find container \"3f0b04751244c13fa4f6e7bf47ac21af9f0d06c2617ccfa7dddf95577670631c\": container with ID starting with 3f0b04751244c13fa4f6e7bf47ac21af9f0d06c2617ccfa7dddf95577670631c not found: ID does not exist"
Jul 20 05:15:08.350486 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:08.350460    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78fd4cb654-h4trx"]
Jul 20 05:15:08.356637 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:08.356611    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78fd4cb654-h4trx"]
Jul 20 05:15:08.680854 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:15:08.680774    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="623b4e55-91bf-4da4-a5aa-b9a3ac520c82" path="/var/lib/kubelet/pods/623b4e55-91bf-4da4-a5aa-b9a3ac520c82/volumes"
Jul 20 05:26:17.222804 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.222766    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"]
Jul 20 05:26:17.223251 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.223110    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="623b4e55-91bf-4da4-a5aa-b9a3ac520c82" containerName="authorino"
Jul 20 05:26:17.223251 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.223122    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="623b4e55-91bf-4da4-a5aa-b9a3ac520c82" containerName="authorino"
Jul 20 05:26:17.223251 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.223193    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="623b4e55-91bf-4da4-a5aa-b9a3ac520c82" containerName="authorino"
Jul 20 05:26:17.226009 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.225991    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.228216 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.228194    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-203d8646-kserve-self-signed-certs\""
Jul 20 05:26:17.233119 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.233095    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"]
Jul 20 05:26:17.316446 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.316406    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l6s5\" (UniqueName: \"kubernetes.io/projected/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-kube-api-access-2l6s5\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.316606 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.316457    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-home\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.316606 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.316516    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-model-cache\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.316606 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.316577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-dshm\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.316709 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.316654    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-tls-certs\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.316747 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.316724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-tmp-dir\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.417494 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.417457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-home\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.417682 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.417502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-model-cache\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.417682 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.417533    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-dshm\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.417682 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.417593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-tls-certs\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.417682 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.417630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-tmp-dir\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.417682 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.417675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l6s5\" (UniqueName: \"kubernetes.io/projected/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-kube-api-access-2l6s5\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.417958 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.417936    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-home\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.418009 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.417970    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-model-cache\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.418062 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.418012    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-tmp-dir\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.419982 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.419958    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-dshm\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.420269 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.420246    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-tls-certs\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.425373 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.425345    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l6s5\" (UniqueName: \"kubernetes.io/projected/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-kube-api-access-2l6s5\") pod \"e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") " pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.536149 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.536068    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:17.670245 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:17.670212    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"]
Jul 20 05:26:17.673684 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:26:17.673660    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf539eea7_9853_4f6f_86ef_b3d8a27d25e8.slice/crio-f8a78e35be560e9457765d554940bc1adef7f052b4dd10fedbb55b552f4e8cf0 WatchSource:0}: Error finding container f8a78e35be560e9457765d554940bc1adef7f052b4dd10fedbb55b552f4e8cf0: Status 404 returned error can't find the container with id f8a78e35be560e9457765d554940bc1adef7f052b4dd10fedbb55b552f4e8cf0
Jul 20 05:26:18.305506 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:18.305472    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs" event={"ID":"f539eea7-9853-4f6f-86ef-b3d8a27d25e8","Type":"ContainerStarted","Data":"a3f18fee94b67c23ebaa32f9c8cdce3538de54ec08c2ea639e967918a6c74aab"}
Jul 20 05:26:18.305506 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:18.305511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs" event={"ID":"f539eea7-9853-4f6f-86ef-b3d8a27d25e8","Type":"ContainerStarted","Data":"f8a78e35be560e9457765d554940bc1adef7f052b4dd10fedbb55b552f4e8cf0"}
Jul 20 05:26:18.324868 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:18.324812    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs" podStartSLOduration=1.324795258 podStartE2EDuration="1.324795258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:26:18.323908344 +0000 UTC m=+1634.139402407" watchObservedRunningTime="2026-07-20 05:26:18.324795258 +0000 UTC m=+1634.140289329"
Jul 20 05:26:27.536596 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:27.536549    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:27.537086 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:27.536622    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:27.549690 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:27.549668    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:28.362484 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:28.362457    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:26:58.324603 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:26:58.324571    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"]
Jul 20 05:27:13.345258 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.345185    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs" podUID="f539eea7-9853-4f6f-86ef-b3d8a27d25e8" containerName="main" containerID="cri-o://a3f18fee94b67c23ebaa32f9c8cdce3538de54ec08c2ea639e967918a6c74aab" gracePeriod=45
Jul 20 05:27:13.558415 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.558384    2576 generic.go:356] "Generic (PLEG): container finished" podID="f539eea7-9853-4f6f-86ef-b3d8a27d25e8" containerID="a3f18fee94b67c23ebaa32f9c8cdce3538de54ec08c2ea639e967918a6c74aab" exitCode=0
Jul 20 05:27:13.558557 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.558443    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs" event={"ID":"f539eea7-9853-4f6f-86ef-b3d8a27d25e8","Type":"ContainerDied","Data":"a3f18fee94b67c23ebaa32f9c8cdce3538de54ec08c2ea639e967918a6c74aab"}
Jul 20 05:27:13.598136 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.598080    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:27:13.724919 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.724864    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-tmp-dir\") pod \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") "
Jul 20 05:27:13.725098 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.724975    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2l6s5\" (UniqueName: \"kubernetes.io/projected/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-kube-api-access-2l6s5\") pod \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") "
Jul 20 05:27:13.725098 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.724997    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-dshm\") pod \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") "
Jul 20 05:27:13.725098 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.725021    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-model-cache\") pod \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") "
Jul 20 05:27:13.725098 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.725061    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-tls-certs\") pod \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") "
Jul 20 05:27:13.725098 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.725084    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-home\") pod \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\" (UID: \"f539eea7-9853-4f6f-86ef-b3d8a27d25e8\") "
Jul 20 05:27:13.725338 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.725167    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f539eea7-9853-4f6f-86ef-b3d8a27d25e8" (UID: "f539eea7-9853-4f6f-86ef-b3d8a27d25e8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:27:13.725338 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.725286    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-model-cache" (OuterVolumeSpecName: "model-cache") pod "f539eea7-9853-4f6f-86ef-b3d8a27d25e8" (UID: "f539eea7-9853-4f6f-86ef-b3d8a27d25e8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:27:13.725448 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.725388    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-home" (OuterVolumeSpecName: "home") pod "f539eea7-9853-4f6f-86ef-b3d8a27d25e8" (UID: "f539eea7-9853-4f6f-86ef-b3d8a27d25e8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:27:13.725448 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.725400    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-tmp-dir\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:27:13.725448 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.725428    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-model-cache\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:27:13.727405 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.727382    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-dshm" (OuterVolumeSpecName: "dshm") pod "f539eea7-9853-4f6f-86ef-b3d8a27d25e8" (UID: "f539eea7-9853-4f6f-86ef-b3d8a27d25e8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:27:13.727405 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.727377    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f539eea7-9853-4f6f-86ef-b3d8a27d25e8" (UID: "f539eea7-9853-4f6f-86ef-b3d8a27d25e8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:27:13.727565 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.727438    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-kube-api-access-2l6s5" (OuterVolumeSpecName: "kube-api-access-2l6s5") pod "f539eea7-9853-4f6f-86ef-b3d8a27d25e8" (UID: "f539eea7-9853-4f6f-86ef-b3d8a27d25e8"). InnerVolumeSpecName "kube-api-access-2l6s5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:27:13.826078 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.826046    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2l6s5\" (UniqueName: \"kubernetes.io/projected/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-kube-api-access-2l6s5\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:27:13.826078 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.826072    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-dshm\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:27:13.826263 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.826086    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-tls-certs\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:27:13.826263 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:13.826098    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f539eea7-9853-4f6f-86ef-b3d8a27d25e8-home\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:27:14.564958 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:14.564922    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs" event={"ID":"f539eea7-9853-4f6f-86ef-b3d8a27d25e8","Type":"ContainerDied","Data":"f8a78e35be560e9457765d554940bc1adef7f052b4dd10fedbb55b552f4e8cf0"}
Jul 20 05:27:14.564958 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:14.564944    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"
Jul 20 05:27:14.565434 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:14.564969    2576 scope.go:117] "RemoveContainer" containerID="a3f18fee94b67c23ebaa32f9c8cdce3538de54ec08c2ea639e967918a6c74aab"
Jul 20 05:27:14.586306 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:14.586282    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"]
Jul 20 05:27:14.590305 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:14.590278    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-203d8646-kserve-86946b586c-qx5hs"]
Jul 20 05:27:14.680950 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:27:14.680910    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f539eea7-9853-4f6f-86ef-b3d8a27d25e8" path="/var/lib/kubelet/pods/f539eea7-9853-4f6f-86ef-b3d8a27d25e8/volumes"
Jul 20 05:30:44.109914 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.109828    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"]
Jul 20 05:30:44.110338 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.110236    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f539eea7-9853-4f6f-86ef-b3d8a27d25e8" containerName="main"
Jul 20 05:30:44.110338 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.110252    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f539eea7-9853-4f6f-86ef-b3d8a27d25e8" containerName="main"
Jul 20 05:30:44.110338 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.110311    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f539eea7-9853-4f6f-86ef-b3d8a27d25e8" containerName="main"
Jul 20 05:30:44.113661 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.113645    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"
Jul 20 05:30:44.116935 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.116902    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-50b57cd2-serving-cert\""
Jul 20 05:30:44.123579 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.123553    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"]
Jul 20 05:30:44.180714 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.180688    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07a34cbc-a33e-464e-aee4-75c53ddd992f-maas-api-tls\") pod \"maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx\" (UID: \"07a34cbc-a33e-464e-aee4-75c53ddd992f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"
Jul 20 05:30:44.180835 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.180724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a34cbc-a33e-464e-aee4-75c53ddd992f-openshift-service-ca\") pod \"maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx\" (UID: \"07a34cbc-a33e-464e-aee4-75c53ddd992f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"
Jul 20 05:30:44.180835 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.180770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64jf4\" (UniqueName: \"kubernetes.io/projected/07a34cbc-a33e-464e-aee4-75c53ddd992f-kube-api-access-64jf4\") pod \"maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx\" (UID: \"07a34cbc-a33e-464e-aee4-75c53ddd992f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"
Jul 20 05:30:44.281491 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.281458    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07a34cbc-a33e-464e-aee4-75c53ddd992f-maas-api-tls\") pod \"maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx\" (UID: \"07a34cbc-a33e-464e-aee4-75c53ddd992f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"
Jul 20 05:30:44.281652 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.281505    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a34cbc-a33e-464e-aee4-75c53ddd992f-openshift-service-ca\") pod \"maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx\" (UID: \"07a34cbc-a33e-464e-aee4-75c53ddd992f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"
Jul 20 05:30:44.281652 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.281559    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64jf4\" (UniqueName: \"kubernetes.io/projected/07a34cbc-a33e-464e-aee4-75c53ddd992f-kube-api-access-64jf4\") pod \"maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx\" (UID: \"07a34cbc-a33e-464e-aee4-75c53ddd992f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"
Jul 20 05:30:44.281652 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:30:44.281622    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-serving-cert: secret "maas-api-e2e-ait-50b57cd2-serving-cert" not found
Jul 20 05:30:44.281758 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:30:44.281687    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07a34cbc-a33e-464e-aee4-75c53ddd992f-maas-api-tls podName:07a34cbc-a33e-464e-aee4-75c53ddd992f nodeName:}" failed. No retries permitted until 2026-07-20 05:30:44.781667603 +0000 UTC m=+1900.597161654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/07a34cbc-a33e-464e-aee4-75c53ddd992f-maas-api-tls") pod "maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx" (UID: "07a34cbc-a33e-464e-aee4-75c53ddd992f") : secret "maas-api-e2e-ait-50b57cd2-serving-cert" not found
Jul 20 05:30:44.282205 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.282183    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a34cbc-a33e-464e-aee4-75c53ddd992f-openshift-service-ca\") pod \"maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx\" (UID: \"07a34cbc-a33e-464e-aee4-75c53ddd992f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"
Jul 20 05:30:44.292950 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.292930    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64jf4\" (UniqueName: \"kubernetes.io/projected/07a34cbc-a33e-464e-aee4-75c53ddd992f-kube-api-access-64jf4\") pod \"maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx\" (UID: \"07a34cbc-a33e-464e-aee4-75c53ddd992f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"
Jul 20 05:30:44.786102 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.786072    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07a34cbc-a33e-464e-aee4-75c53ddd992f-maas-api-tls\") pod \"maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx\" (UID: \"07a34cbc-a33e-464e-aee4-75c53ddd992f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"
Jul 20 05:30:44.788797 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:44.788770    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07a34cbc-a33e-464e-aee4-75c53ddd992f-maas-api-tls\") pod \"maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx\" (UID: \"07a34cbc-a33e-464e-aee4-75c53ddd992f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"
Jul 20 05:30:45.024892 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:45.024859    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"
Jul 20 05:30:45.158781 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:45.158748    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"]
Jul 20 05:30:45.160857 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:30:45.160832    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a34cbc_a33e_464e_aee4_75c53ddd992f.slice/crio-089ad9e22f56a8b2d92b24e198a6d8b52ef5e5153a8f4c7a4d0ca23d0d435e87 WatchSource:0}: Error finding container 089ad9e22f56a8b2d92b24e198a6d8b52ef5e5153a8f4c7a4d0ca23d0d435e87: Status 404 returned error can't find the container with id 089ad9e22f56a8b2d92b24e198a6d8b52ef5e5153a8f4c7a4d0ca23d0d435e87
Jul 20 05:30:45.162116 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:45.162096    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 05:30:45.505975 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:45.505940    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx" event={"ID":"07a34cbc-a33e-464e-aee4-75c53ddd992f","Type":"ContainerStarted","Data":"089ad9e22f56a8b2d92b24e198a6d8b52ef5e5153a8f4c7a4d0ca23d0d435e87"}
Jul 20 05:30:46.512090 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:46.512054    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx" event={"ID":"07a34cbc-a33e-464e-aee4-75c53ddd992f","Type":"ContainerStarted","Data":"628214c39f0cf3db3459b9e87ff298fa5a4add4389312867dfa961137b603043"}
Jul 20 05:30:46.512481 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:46.512194    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"
Jul 20 05:30:46.529468 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:46.529425    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx" podStartSLOduration=2.12959054 podStartE2EDuration="2.529412125s" totalImagesPullingTime="399.821585ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:30:46.528026486 +0000 UTC m=+1902.343520559" watchObservedRunningTime="2026-07-20 05:30:46.529412125 +0000 UTC m=+1902.344906240"
Jul 20 05:30:52.522118 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:30:52.522084    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"
Jul 20 05:31:19.942121 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:19.942085    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"]
Jul 20 05:31:19.944611 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:19.942312    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx" podUID="07a34cbc-a33e-464e-aee4-75c53ddd992f" containerName="maas-api" containerID="cri-o://628214c39f0cf3db3459b9e87ff298fa5a4add4389312867dfa961137b603043" gracePeriod=30
Jul 20 05:31:20.183540 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.183518    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"
Jul 20 05:31:20.304208 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.304177    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07a34cbc-a33e-464e-aee4-75c53ddd992f-maas-api-tls\") pod \"07a34cbc-a33e-464e-aee4-75c53ddd992f\" (UID: \"07a34cbc-a33e-464e-aee4-75c53ddd992f\") "
Jul 20 05:31:20.304407 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.304281    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a34cbc-a33e-464e-aee4-75c53ddd992f-openshift-service-ca\") pod \"07a34cbc-a33e-464e-aee4-75c53ddd992f\" (UID: \"07a34cbc-a33e-464e-aee4-75c53ddd992f\") "
Jul 20 05:31:20.304407 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.304326    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64jf4\" (UniqueName: \"kubernetes.io/projected/07a34cbc-a33e-464e-aee4-75c53ddd992f-kube-api-access-64jf4\") pod \"07a34cbc-a33e-464e-aee4-75c53ddd992f\" (UID: \"07a34cbc-a33e-464e-aee4-75c53ddd992f\") "
Jul 20 05:31:20.304708 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.304674    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07a34cbc-a33e-464e-aee4-75c53ddd992f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "07a34cbc-a33e-464e-aee4-75c53ddd992f" (UID: "07a34cbc-a33e-464e-aee4-75c53ddd992f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:31:20.306644 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.306618    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07a34cbc-a33e-464e-aee4-75c53ddd992f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "07a34cbc-a33e-464e-aee4-75c53ddd992f" (UID: "07a34cbc-a33e-464e-aee4-75c53ddd992f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:31:20.306734 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.306675    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07a34cbc-a33e-464e-aee4-75c53ddd992f-kube-api-access-64jf4" (OuterVolumeSpecName: "kube-api-access-64jf4") pod "07a34cbc-a33e-464e-aee4-75c53ddd992f" (UID: "07a34cbc-a33e-464e-aee4-75c53ddd992f"). InnerVolumeSpecName "kube-api-access-64jf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:31:20.405203 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.405159    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a34cbc-a33e-464e-aee4-75c53ddd992f-openshift-service-ca\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:31:20.405203 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.405197    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64jf4\" (UniqueName: \"kubernetes.io/projected/07a34cbc-a33e-464e-aee4-75c53ddd992f-kube-api-access-64jf4\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:31:20.405203 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.405207    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/07a34cbc-a33e-464e-aee4-75c53ddd992f-maas-api-tls\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:31:20.670926 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.670824    2576 generic.go:356] "Generic (PLEG): container finished" podID="07a34cbc-a33e-464e-aee4-75c53ddd992f" containerID="628214c39f0cf3db3459b9e87ff298fa5a4add4389312867dfa961137b603043" exitCode=0
Jul 20 05:31:20.670926 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.670874    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"
Jul 20 05:31:20.671100 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.670917    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx" event={"ID":"07a34cbc-a33e-464e-aee4-75c53ddd992f","Type":"ContainerDied","Data":"628214c39f0cf3db3459b9e87ff298fa5a4add4389312867dfa961137b603043"}
Jul 20 05:31:20.671100 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.670974    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx" event={"ID":"07a34cbc-a33e-464e-aee4-75c53ddd992f","Type":"ContainerDied","Data":"089ad9e22f56a8b2d92b24e198a6d8b52ef5e5153a8f4c7a4d0ca23d0d435e87"}
Jul 20 05:31:20.671100 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.670997    2576 scope.go:117] "RemoveContainer" containerID="628214c39f0cf3db3459b9e87ff298fa5a4add4389312867dfa961137b603043"
Jul 20 05:31:20.680100 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.680080    2576 scope.go:117] "RemoveContainer" containerID="628214c39f0cf3db3459b9e87ff298fa5a4add4389312867dfa961137b603043"
Jul 20 05:31:20.680362 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:31:20.680343    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"628214c39f0cf3db3459b9e87ff298fa5a4add4389312867dfa961137b603043\": container with ID starting with 628214c39f0cf3db3459b9e87ff298fa5a4add4389312867dfa961137b603043 not found: ID does not exist" containerID="628214c39f0cf3db3459b9e87ff298fa5a4add4389312867dfa961137b603043"
Jul 20 05:31:20.680425 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.680371    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"628214c39f0cf3db3459b9e87ff298fa5a4add4389312867dfa961137b603043"} err="failed to get container status \"628214c39f0cf3db3459b9e87ff298fa5a4add4389312867dfa961137b603043\": rpc error: code = NotFound desc = could not find container \"628214c39f0cf3db3459b9e87ff298fa5a4add4389312867dfa961137b603043\": container with ID starting with 628214c39f0cf3db3459b9e87ff298fa5a4add4389312867dfa961137b603043 not found: ID does not exist"
Jul 20 05:31:20.692618 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.692598    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"]
Jul 20 05:31:20.698024 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:20.698003    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-50b57cd2-7556f86cd8-lnrvx"]
Jul 20 05:31:22.681260 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:22.681227    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07a34cbc-a33e-464e-aee4-75c53ddd992f" path="/var/lib/kubelet/pods/07a34cbc-a33e-464e-aee4-75c53ddd992f/volumes"
Jul 20 05:31:31.249313 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:31.249282    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"]
Jul 20 05:31:31.249676 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:31.249641    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07a34cbc-a33e-464e-aee4-75c53ddd992f" containerName="maas-api"
Jul 20 05:31:31.249676 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:31.249653    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="07a34cbc-a33e-464e-aee4-75c53ddd992f" containerName="maas-api"
Jul 20 05:31:31.249748 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:31.249713    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="07a34cbc-a33e-464e-aee4-75c53ddd992f" containerName="maas-api"
Jul 20 05:31:31.254091 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:31.254073    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"
Jul 20 05:31:31.256466 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:31.256442    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-be1ac6ef-serving-cert\""
Jul 20 05:31:31.262296 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:31.262272    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"]
Jul 20 05:31:31.400726 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:31.400687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-maas-api-tls\") pod \"maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2\" (UID: \"f5c5f17f-dd54-4d26-adc4-25e82ce782eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"
Jul 20 05:31:31.400726 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:31.400729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdds6\" (UniqueName: \"kubernetes.io/projected/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-kube-api-access-jdds6\") pod \"maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2\" (UID: \"f5c5f17f-dd54-4d26-adc4-25e82ce782eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"
Jul 20 05:31:31.400986 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:31.400780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-openshift-service-ca\") pod \"maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2\" (UID: \"f5c5f17f-dd54-4d26-adc4-25e82ce782eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"
Jul 20 05:31:31.501911 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:31.501807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-maas-api-tls\") pod \"maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2\" (UID: \"f5c5f17f-dd54-4d26-adc4-25e82ce782eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"
Jul 20 05:31:31.501911 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:31.501845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdds6\" (UniqueName: \"kubernetes.io/projected/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-kube-api-access-jdds6\") pod \"maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2\" (UID: \"f5c5f17f-dd54-4d26-adc4-25e82ce782eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"
Jul 20 05:31:31.501911 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:31.501896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-openshift-service-ca\") pod \"maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2\" (UID: \"f5c5f17f-dd54-4d26-adc4-25e82ce782eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"
Jul 20 05:31:31.502127 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:31:31.502008    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-serving-cert: secret "maas-api-e2e-migrate-be1ac6ef-serving-cert" not found
Jul 20 05:31:31.502127 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:31:31.502087    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-maas-api-tls podName:f5c5f17f-dd54-4d26-adc4-25e82ce782eb nodeName:}" failed. No retries permitted until 2026-07-20 05:31:32.002065789 +0000 UTC m=+1947.817559839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-maas-api-tls") pod "maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2" (UID: "f5c5f17f-dd54-4d26-adc4-25e82ce782eb") : secret "maas-api-e2e-migrate-be1ac6ef-serving-cert" not found
Jul 20 05:31:31.502589 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:31.502570    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-openshift-service-ca\") pod \"maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2\" (UID: \"f5c5f17f-dd54-4d26-adc4-25e82ce782eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"
Jul 20 05:31:31.513366 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:31.513338    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdds6\" (UniqueName: \"kubernetes.io/projected/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-kube-api-access-jdds6\") pod \"maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2\" (UID: \"f5c5f17f-dd54-4d26-adc4-25e82ce782eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"
Jul 20 05:31:32.005813 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:32.005775    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-maas-api-tls\") pod \"maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2\" (UID: \"f5c5f17f-dd54-4d26-adc4-25e82ce782eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"
Jul 20 05:31:32.008368 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:32.008349    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-maas-api-tls\") pod \"maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2\" (UID: \"f5c5f17f-dd54-4d26-adc4-25e82ce782eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"
Jul 20 05:31:32.164993 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:32.164948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"
Jul 20 05:31:32.294960 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:32.294863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"]
Jul 20 05:31:32.298781 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:31:32.298749    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c5f17f_dd54_4d26_adc4_25e82ce782eb.slice/crio-969d774d5531a5b89c8dfbfbaa217c1dde9bbb33858192bb5c83a0586dd2084a WatchSource:0}: Error finding container 969d774d5531a5b89c8dfbfbaa217c1dde9bbb33858192bb5c83a0586dd2084a: Status 404 returned error can't find the container with id 969d774d5531a5b89c8dfbfbaa217c1dde9bbb33858192bb5c83a0586dd2084a
Jul 20 05:31:32.725411 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:32.725376    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2" event={"ID":"f5c5f17f-dd54-4d26-adc4-25e82ce782eb","Type":"ContainerStarted","Data":"935d9999d6c7b436f5de13ab3671a351b1f1450a3cbedfe368ac8c3c41333d57"}
Jul 20 05:31:32.725590 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:32.725431    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2" event={"ID":"f5c5f17f-dd54-4d26-adc4-25e82ce782eb","Type":"ContainerStarted","Data":"969d774d5531a5b89c8dfbfbaa217c1dde9bbb33858192bb5c83a0586dd2084a"}
Jul 20 05:31:32.725590 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:32.725509    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"
Jul 20 05:31:32.742004 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:32.741921    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2" podStartSLOduration=1.4614664259999999 podStartE2EDuration="1.741900657s" totalImagesPullingTime="280.434231ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:31:32.741114514 +0000 UTC m=+1948.556608586" watchObservedRunningTime="2026-07-20 05:31:32.741900657 +0000 UTC m=+1948.557394735"
Jul 20 05:31:38.735560 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:31:38.735526    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"
Jul 20 05:32:06.515340 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.515300    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"]
Jul 20 05:32:06.515863 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.515581    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2" podUID="f5c5f17f-dd54-4d26-adc4-25e82ce782eb" containerName="maas-api" containerID="cri-o://935d9999d6c7b436f5de13ab3671a351b1f1450a3cbedfe368ac8c3c41333d57" gracePeriod=30
Jul 20 05:32:06.764532 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.764501    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"
Jul 20 05:32:06.806279 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.806202    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-maas-api-tls\") pod \"f5c5f17f-dd54-4d26-adc4-25e82ce782eb\" (UID: \"f5c5f17f-dd54-4d26-adc4-25e82ce782eb\") "
Jul 20 05:32:06.806416 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.806285    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-openshift-service-ca\") pod \"f5c5f17f-dd54-4d26-adc4-25e82ce782eb\" (UID: \"f5c5f17f-dd54-4d26-adc4-25e82ce782eb\") "
Jul 20 05:32:06.806416 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.806316    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdds6\" (UniqueName: \"kubernetes.io/projected/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-kube-api-access-jdds6\") pod \"f5c5f17f-dd54-4d26-adc4-25e82ce782eb\" (UID: \"f5c5f17f-dd54-4d26-adc4-25e82ce782eb\") "
Jul 20 05:32:06.806687 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.806642    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f5c5f17f-dd54-4d26-adc4-25e82ce782eb" (UID: "f5c5f17f-dd54-4d26-adc4-25e82ce782eb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:32:06.808547 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.808499    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f5c5f17f-dd54-4d26-adc4-25e82ce782eb" (UID: "f5c5f17f-dd54-4d26-adc4-25e82ce782eb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:32:06.808632 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.808556    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-kube-api-access-jdds6" (OuterVolumeSpecName: "kube-api-access-jdds6") pod "f5c5f17f-dd54-4d26-adc4-25e82ce782eb" (UID: "f5c5f17f-dd54-4d26-adc4-25e82ce782eb"). InnerVolumeSpecName "kube-api-access-jdds6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:32:06.888082 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.888044    2576 generic.go:356] "Generic (PLEG): container finished" podID="f5c5f17f-dd54-4d26-adc4-25e82ce782eb" containerID="935d9999d6c7b436f5de13ab3671a351b1f1450a3cbedfe368ac8c3c41333d57" exitCode=0
Jul 20 05:32:06.888251 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.888095    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"
Jul 20 05:32:06.888251 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.888124    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2" event={"ID":"f5c5f17f-dd54-4d26-adc4-25e82ce782eb","Type":"ContainerDied","Data":"935d9999d6c7b436f5de13ab3671a351b1f1450a3cbedfe368ac8c3c41333d57"}
Jul 20 05:32:06.888251 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.888175    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2" event={"ID":"f5c5f17f-dd54-4d26-adc4-25e82ce782eb","Type":"ContainerDied","Data":"969d774d5531a5b89c8dfbfbaa217c1dde9bbb33858192bb5c83a0586dd2084a"}
Jul 20 05:32:06.888251 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.888196    2576 scope.go:117] "RemoveContainer" containerID="935d9999d6c7b436f5de13ab3671a351b1f1450a3cbedfe368ac8c3c41333d57"
Jul 20 05:32:06.898002 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.897982    2576 scope.go:117] "RemoveContainer" containerID="935d9999d6c7b436f5de13ab3671a351b1f1450a3cbedfe368ac8c3c41333d57"
Jul 20 05:32:06.898346 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:32:06.898322    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"935d9999d6c7b436f5de13ab3671a351b1f1450a3cbedfe368ac8c3c41333d57\": container with ID starting with 935d9999d6c7b436f5de13ab3671a351b1f1450a3cbedfe368ac8c3c41333d57 not found: ID does not exist" containerID="935d9999d6c7b436f5de13ab3671a351b1f1450a3cbedfe368ac8c3c41333d57"
Jul 20 05:32:06.898416 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.898357    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"935d9999d6c7b436f5de13ab3671a351b1f1450a3cbedfe368ac8c3c41333d57"} err="failed to get container status \"935d9999d6c7b436f5de13ab3671a351b1f1450a3cbedfe368ac8c3c41333d57\": rpc error: code = NotFound desc = could not find container \"935d9999d6c7b436f5de13ab3671a351b1f1450a3cbedfe368ac8c3c41333d57\": container with ID starting with 935d9999d6c7b436f5de13ab3671a351b1f1450a3cbedfe368ac8c3c41333d57 not found: ID does not exist"
Jul 20 05:32:06.907737 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.907710    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-openshift-service-ca\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:32:06.907737 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.907738    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdds6\" (UniqueName: \"kubernetes.io/projected/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-kube-api-access-jdds6\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:32:06.907951 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.907751    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5c5f17f-dd54-4d26-adc4-25e82ce782eb-maas-api-tls\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:32:06.909484 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.909461    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"]
Jul 20 05:32:06.913997 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:06.913971    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-be1ac6ef-6cd6657666-6zpd2"]
Jul 20 05:32:08.680457 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:08.680426    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5c5f17f-dd54-4d26-adc4-25e82ce782eb" path="/var/lib/kubelet/pods/f5c5f17f-dd54-4d26-adc4-25e82ce782eb/volumes"
Jul 20 05:32:14.346276 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:14.346242    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"]
Jul 20 05:32:14.346628 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:14.346585    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5c5f17f-dd54-4d26-adc4-25e82ce782eb" containerName="maas-api"
Jul 20 05:32:14.346628 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:14.346595    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5c5f17f-dd54-4d26-adc4-25e82ce782eb" containerName="maas-api"
Jul 20 05:32:14.346700 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:14.346673    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5c5f17f-dd54-4d26-adc4-25e82ce782eb" containerName="maas-api"
Jul 20 05:32:14.350999 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:14.350981    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"
Jul 20 05:32:14.353449 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:14.353426    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-defc77b8-serving-cert\""
Jul 20 05:32:14.360434 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:14.360411    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"]
Jul 20 05:32:14.473573 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:14.473531    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2213f699-3ac7-457f-92df-ffd51801b3ce-openshift-service-ca\") pod \"maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr\" (UID: \"2213f699-3ac7-457f-92df-ffd51801b3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"
Jul 20 05:32:14.473573 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:14.473580    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2213f699-3ac7-457f-92df-ffd51801b3ce-maas-api-tls\") pod \"maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr\" (UID: \"2213f699-3ac7-457f-92df-ffd51801b3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"
Jul 20 05:32:14.473788 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:14.473645    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xdpz\" (UniqueName: \"kubernetes.io/projected/2213f699-3ac7-457f-92df-ffd51801b3ce-kube-api-access-9xdpz\") pod \"maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr\" (UID: \"2213f699-3ac7-457f-92df-ffd51801b3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"
Jul 20 05:32:14.574131 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:14.574092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2213f699-3ac7-457f-92df-ffd51801b3ce-openshift-service-ca\") pod \"maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr\" (UID: \"2213f699-3ac7-457f-92df-ffd51801b3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"
Jul 20 05:32:14.574131 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:14.574139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2213f699-3ac7-457f-92df-ffd51801b3ce-maas-api-tls\") pod \"maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr\" (UID: \"2213f699-3ac7-457f-92df-ffd51801b3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"
Jul 20 05:32:14.574338 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:32:14.574235    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-serving-cert: secret "maas-api-e2e-ait-defc77b8-serving-cert" not found
Jul 20 05:32:14.574338 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:14.574265    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xdpz\" (UniqueName: \"kubernetes.io/projected/2213f699-3ac7-457f-92df-ffd51801b3ce-kube-api-access-9xdpz\") pod \"maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr\" (UID: \"2213f699-3ac7-457f-92df-ffd51801b3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"
Jul 20 05:32:14.574338 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:32:14.574293    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2213f699-3ac7-457f-92df-ffd51801b3ce-maas-api-tls podName:2213f699-3ac7-457f-92df-ffd51801b3ce nodeName:}" failed. No retries permitted until 2026-07-20 05:32:15.074276088 +0000 UTC m=+1990.889770137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2213f699-3ac7-457f-92df-ffd51801b3ce-maas-api-tls") pod "maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr" (UID: "2213f699-3ac7-457f-92df-ffd51801b3ce") : secret "maas-api-e2e-ait-defc77b8-serving-cert" not found
Jul 20 05:32:14.574809 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:14.574791    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2213f699-3ac7-457f-92df-ffd51801b3ce-openshift-service-ca\") pod \"maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr\" (UID: \"2213f699-3ac7-457f-92df-ffd51801b3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"
Jul 20 05:32:14.582795 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:14.582769    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xdpz\" (UniqueName: \"kubernetes.io/projected/2213f699-3ac7-457f-92df-ffd51801b3ce-kube-api-access-9xdpz\") pod \"maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr\" (UID: \"2213f699-3ac7-457f-92df-ffd51801b3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"
Jul 20 05:32:15.079034 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:15.078995    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2213f699-3ac7-457f-92df-ffd51801b3ce-maas-api-tls\") pod \"maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr\" (UID: \"2213f699-3ac7-457f-92df-ffd51801b3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"
Jul 20 05:32:15.081598 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:15.081572    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2213f699-3ac7-457f-92df-ffd51801b3ce-maas-api-tls\") pod \"maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr\" (UID: \"2213f699-3ac7-457f-92df-ffd51801b3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"
Jul 20 05:32:15.262234 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:15.262193    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"
Jul 20 05:32:15.398387 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:15.398361    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"]
Jul 20 05:32:15.400384 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:32:15.400348    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2213f699_3ac7_457f_92df_ffd51801b3ce.slice/crio-8497427404af27e1c237d4646d379ae926d566439dfa9bd308fb92ed33b8c23d WatchSource:0}: Error finding container 8497427404af27e1c237d4646d379ae926d566439dfa9bd308fb92ed33b8c23d: Status 404 returned error can't find the container with id 8497427404af27e1c237d4646d379ae926d566439dfa9bd308fb92ed33b8c23d
Jul 20 05:32:15.931085 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:15.931046    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr" event={"ID":"2213f699-3ac7-457f-92df-ffd51801b3ce","Type":"ContainerStarted","Data":"6711bdb3d5c974abc3ea38292c42399482283a5c2ef3d005c18e32bb9afcdb0d"}
Jul 20 05:32:15.931454 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:15.931109    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr" event={"ID":"2213f699-3ac7-457f-92df-ffd51801b3ce","Type":"ContainerStarted","Data":"8497427404af27e1c237d4646d379ae926d566439dfa9bd308fb92ed33b8c23d"}
Jul 20 05:32:15.931454 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:15.931221    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"
Jul 20 05:32:15.948454 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:15.948408    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr" podStartSLOduration=1.5254075820000002 podStartE2EDuration="1.94839351s" totalImagesPullingTime="422.985928ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:32:15.946523748 +0000 UTC m=+1991.762017822" watchObservedRunningTime="2026-07-20 05:32:15.94839351 +0000 UTC m=+1991.763887582"
Jul 20 05:32:21.942007 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:21.941976    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"
Jul 20 05:32:50.520739 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:50.520705    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"]
Jul 20 05:32:50.521286 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:50.520928    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr" podUID="2213f699-3ac7-457f-92df-ffd51801b3ce" containerName="maas-api" containerID="cri-o://6711bdb3d5c974abc3ea38292c42399482283a5c2ef3d005c18e32bb9afcdb0d" gracePeriod=30
Jul 20 05:32:50.761644 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:50.761622    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"
Jul 20 05:32:50.771736 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:50.771694    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2213f699-3ac7-457f-92df-ffd51801b3ce-maas-api-tls\") pod \"2213f699-3ac7-457f-92df-ffd51801b3ce\" (UID: \"2213f699-3ac7-457f-92df-ffd51801b3ce\") "
Jul 20 05:32:50.771809 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:50.771743    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2213f699-3ac7-457f-92df-ffd51801b3ce-openshift-service-ca\") pod \"2213f699-3ac7-457f-92df-ffd51801b3ce\" (UID: \"2213f699-3ac7-457f-92df-ffd51801b3ce\") "
Jul 20 05:32:50.771809 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:50.771781    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xdpz\" (UniqueName: \"kubernetes.io/projected/2213f699-3ac7-457f-92df-ffd51801b3ce-kube-api-access-9xdpz\") pod \"2213f699-3ac7-457f-92df-ffd51801b3ce\" (UID: \"2213f699-3ac7-457f-92df-ffd51801b3ce\") "
Jul 20 05:32:50.772185 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:50.772156    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2213f699-3ac7-457f-92df-ffd51801b3ce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2213f699-3ac7-457f-92df-ffd51801b3ce" (UID: "2213f699-3ac7-457f-92df-ffd51801b3ce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:32:50.773869 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:50.773843    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2213f699-3ac7-457f-92df-ffd51801b3ce-kube-api-access-9xdpz" (OuterVolumeSpecName: "kube-api-access-9xdpz") pod "2213f699-3ac7-457f-92df-ffd51801b3ce" (UID: "2213f699-3ac7-457f-92df-ffd51801b3ce"). InnerVolumeSpecName "kube-api-access-9xdpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:32:50.773978 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:50.773910    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2213f699-3ac7-457f-92df-ffd51801b3ce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2213f699-3ac7-457f-92df-ffd51801b3ce" (UID: "2213f699-3ac7-457f-92df-ffd51801b3ce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:32:50.872847 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:50.872814    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2213f699-3ac7-457f-92df-ffd51801b3ce-openshift-service-ca\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:32:50.872847 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:50.872842    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xdpz\" (UniqueName: \"kubernetes.io/projected/2213f699-3ac7-457f-92df-ffd51801b3ce-kube-api-access-9xdpz\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:32:50.872847 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:50.872853    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2213f699-3ac7-457f-92df-ffd51801b3ce-maas-api-tls\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:32:51.091620 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:51.091537    2576 generic.go:356] "Generic (PLEG): container finished" podID="2213f699-3ac7-457f-92df-ffd51801b3ce" containerID="6711bdb3d5c974abc3ea38292c42399482283a5c2ef3d005c18e32bb9afcdb0d" exitCode=0
Jul 20 05:32:51.091620 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:51.091580    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"
Jul 20 05:32:51.091851 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:51.091631    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr" event={"ID":"2213f699-3ac7-457f-92df-ffd51801b3ce","Type":"ContainerDied","Data":"6711bdb3d5c974abc3ea38292c42399482283a5c2ef3d005c18e32bb9afcdb0d"}
Jul 20 05:32:51.091851 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:51.091684    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr" event={"ID":"2213f699-3ac7-457f-92df-ffd51801b3ce","Type":"ContainerDied","Data":"8497427404af27e1c237d4646d379ae926d566439dfa9bd308fb92ed33b8c23d"}
Jul 20 05:32:51.091851 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:51.091715    2576 scope.go:117] "RemoveContainer" containerID="6711bdb3d5c974abc3ea38292c42399482283a5c2ef3d005c18e32bb9afcdb0d"
Jul 20 05:32:51.101248 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:51.101234    2576 scope.go:117] "RemoveContainer" containerID="6711bdb3d5c974abc3ea38292c42399482283a5c2ef3d005c18e32bb9afcdb0d"
Jul 20 05:32:51.101520 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:32:51.101496    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6711bdb3d5c974abc3ea38292c42399482283a5c2ef3d005c18e32bb9afcdb0d\": container with ID starting with 6711bdb3d5c974abc3ea38292c42399482283a5c2ef3d005c18e32bb9afcdb0d not found: ID does not exist" containerID="6711bdb3d5c974abc3ea38292c42399482283a5c2ef3d005c18e32bb9afcdb0d"
Jul 20 05:32:51.101559 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:51.101531    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6711bdb3d5c974abc3ea38292c42399482283a5c2ef3d005c18e32bb9afcdb0d"} err="failed to get container status \"6711bdb3d5c974abc3ea38292c42399482283a5c2ef3d005c18e32bb9afcdb0d\": rpc error: code = NotFound desc = could not find container \"6711bdb3d5c974abc3ea38292c42399482283a5c2ef3d005c18e32bb9afcdb0d\": container with ID starting with 6711bdb3d5c974abc3ea38292c42399482283a5c2ef3d005c18e32bb9afcdb0d not found: ID does not exist"
Jul 20 05:32:51.112491 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:51.112471    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"]
Jul 20 05:32:51.115918 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:51.115897    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-defc77b8-6d56f764f6-dk2dr"]
Jul 20 05:32:52.680574 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:52.680537    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2213f699-3ac7-457f-92df-ffd51801b3ce" path="/var/lib/kubelet/pods/2213f699-3ac7-457f-92df-ffd51801b3ce/volumes"
Jul 20 05:32:59.583652 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.583617    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"]
Jul 20 05:32:59.584022 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.583974    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2213f699-3ac7-457f-92df-ffd51801b3ce" containerName="maas-api"
Jul 20 05:32:59.584022 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.583986    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2213f699-3ac7-457f-92df-ffd51801b3ce" containerName="maas-api"
Jul 20 05:32:59.584094 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.584050    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="2213f699-3ac7-457f-92df-ffd51801b3ce" containerName="maas-api"
Jul 20 05:32:59.588281 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.588264    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"
Jul 20 05:32:59.591029 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.591008    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-3a653f83-serving-cert\""
Jul 20 05:32:59.598039 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.598018    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"]
Jul 20 05:32:59.640733 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.640695    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chjwx\" (UniqueName: \"kubernetes.io/projected/79567e0d-24c2-4af5-b7c9-5e2769c6c847-kube-api-access-chjwx\") pod \"maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt\" (UID: \"79567e0d-24c2-4af5-b7c9-5e2769c6c847\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"
Jul 20 05:32:59.640912 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.640741    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79567e0d-24c2-4af5-b7c9-5e2769c6c847-openshift-service-ca\") pod \"maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt\" (UID: \"79567e0d-24c2-4af5-b7c9-5e2769c6c847\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"
Jul 20 05:32:59.640912 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.640811    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79567e0d-24c2-4af5-b7c9-5e2769c6c847-maas-api-tls\") pod \"maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt\" (UID: \"79567e0d-24c2-4af5-b7c9-5e2769c6c847\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"
Jul 20 05:32:59.741636 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.741600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chjwx\" (UniqueName: \"kubernetes.io/projected/79567e0d-24c2-4af5-b7c9-5e2769c6c847-kube-api-access-chjwx\") pod \"maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt\" (UID: \"79567e0d-24c2-4af5-b7c9-5e2769c6c847\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"
Jul 20 05:32:59.741815 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.741647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79567e0d-24c2-4af5-b7c9-5e2769c6c847-openshift-service-ca\") pod \"maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt\" (UID: \"79567e0d-24c2-4af5-b7c9-5e2769c6c847\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"
Jul 20 05:32:59.741815 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.741675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79567e0d-24c2-4af5-b7c9-5e2769c6c847-maas-api-tls\") pod \"maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt\" (UID: \"79567e0d-24c2-4af5-b7c9-5e2769c6c847\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"
Jul 20 05:32:59.742452 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.742392    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79567e0d-24c2-4af5-b7c9-5e2769c6c847-openshift-service-ca\") pod \"maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt\" (UID: \"79567e0d-24c2-4af5-b7c9-5e2769c6c847\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"
Jul 20 05:32:59.744241 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.744221    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79567e0d-24c2-4af5-b7c9-5e2769c6c847-maas-api-tls\") pod \"maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt\" (UID: \"79567e0d-24c2-4af5-b7c9-5e2769c6c847\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"
Jul 20 05:32:59.749535 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.749512    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chjwx\" (UniqueName: \"kubernetes.io/projected/79567e0d-24c2-4af5-b7c9-5e2769c6c847-kube-api-access-chjwx\") pod \"maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt\" (UID: \"79567e0d-24c2-4af5-b7c9-5e2769c6c847\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"
Jul 20 05:32:59.900116 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:32:59.900028    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"
Jul 20 05:33:00.030421 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:00.030386    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"]
Jul 20 05:33:00.032834 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:33:00.032801    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79567e0d_24c2_4af5_b7c9_5e2769c6c847.slice/crio-7840b0e06fa5c8085d82d9b0abe591d10ebe8915e284236735a1fd227fd60226 WatchSource:0}: Error finding container 7840b0e06fa5c8085d82d9b0abe591d10ebe8915e284236735a1fd227fd60226: Status 404 returned error can't find the container with id 7840b0e06fa5c8085d82d9b0abe591d10ebe8915e284236735a1fd227fd60226
Jul 20 05:33:00.139833 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:00.139793    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt" event={"ID":"79567e0d-24c2-4af5-b7c9-5e2769c6c847","Type":"ContainerStarted","Data":"7840b0e06fa5c8085d82d9b0abe591d10ebe8915e284236735a1fd227fd60226"}
Jul 20 05:33:01.147520 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:01.147487    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt" event={"ID":"79567e0d-24c2-4af5-b7c9-5e2769c6c847","Type":"ContainerStarted","Data":"8881d82d347d2cd1a12cbf7fddc1009ca6c9e7b657202461942dd2e3f685f661"}
Jul 20 05:33:01.147931 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:01.147605    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"
Jul 20 05:33:01.165551 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:01.165500    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt" podStartSLOduration=1.843536212 podStartE2EDuration="2.165485306s" totalImagesPullingTime="321.949094ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:33:01.163724098 +0000 UTC m=+2036.979218171" watchObservedRunningTime="2026-07-20 05:33:01.165485306 +0000 UTC m=+2036.980979378"
Jul 20 05:33:07.157084 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:07.157049    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"
Jul 20 05:33:34.803008 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:34.802932    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"]
Jul 20 05:33:34.803502 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:34.803157    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt" podUID="79567e0d-24c2-4af5-b7c9-5e2769c6c847" containerName="maas-api" containerID="cri-o://8881d82d347d2cd1a12cbf7fddc1009ca6c9e7b657202461942dd2e3f685f661" gracePeriod=30
Jul 20 05:33:35.048960 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.048930    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"
Jul 20 05:33:35.144718 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.144629    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79567e0d-24c2-4af5-b7c9-5e2769c6c847-maas-api-tls\") pod \"79567e0d-24c2-4af5-b7c9-5e2769c6c847\" (UID: \"79567e0d-24c2-4af5-b7c9-5e2769c6c847\") "
Jul 20 05:33:35.144718 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.144671    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chjwx\" (UniqueName: \"kubernetes.io/projected/79567e0d-24c2-4af5-b7c9-5e2769c6c847-kube-api-access-chjwx\") pod \"79567e0d-24c2-4af5-b7c9-5e2769c6c847\" (UID: \"79567e0d-24c2-4af5-b7c9-5e2769c6c847\") "
Jul 20 05:33:35.144936 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.144726    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79567e0d-24c2-4af5-b7c9-5e2769c6c847-openshift-service-ca\") pod \"79567e0d-24c2-4af5-b7c9-5e2769c6c847\" (UID: \"79567e0d-24c2-4af5-b7c9-5e2769c6c847\") "
Jul 20 05:33:35.145191 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.145155    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79567e0d-24c2-4af5-b7c9-5e2769c6c847-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "79567e0d-24c2-4af5-b7c9-5e2769c6c847" (UID: "79567e0d-24c2-4af5-b7c9-5e2769c6c847"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:33:35.147045 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.147022    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79567e0d-24c2-4af5-b7c9-5e2769c6c847-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "79567e0d-24c2-4af5-b7c9-5e2769c6c847" (UID: "79567e0d-24c2-4af5-b7c9-5e2769c6c847"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:33:35.147045 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.147015    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79567e0d-24c2-4af5-b7c9-5e2769c6c847-kube-api-access-chjwx" (OuterVolumeSpecName: "kube-api-access-chjwx") pod "79567e0d-24c2-4af5-b7c9-5e2769c6c847" (UID: "79567e0d-24c2-4af5-b7c9-5e2769c6c847"). InnerVolumeSpecName "kube-api-access-chjwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:33:35.245836 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.245798    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79567e0d-24c2-4af5-b7c9-5e2769c6c847-openshift-service-ca\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:33:35.245836 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.245832    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79567e0d-24c2-4af5-b7c9-5e2769c6c847-maas-api-tls\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:33:35.245836 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.245841    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chjwx\" (UniqueName: \"kubernetes.io/projected/79567e0d-24c2-4af5-b7c9-5e2769c6c847-kube-api-access-chjwx\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:33:35.297773 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.297741    2576 generic.go:356] "Generic (PLEG): container finished" podID="79567e0d-24c2-4af5-b7c9-5e2769c6c847" containerID="8881d82d347d2cd1a12cbf7fddc1009ca6c9e7b657202461942dd2e3f685f661" exitCode=0
Jul 20 05:33:35.297978 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.297789    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"
Jul 20 05:33:35.297978 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.297805    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt" event={"ID":"79567e0d-24c2-4af5-b7c9-5e2769c6c847","Type":"ContainerDied","Data":"8881d82d347d2cd1a12cbf7fddc1009ca6c9e7b657202461942dd2e3f685f661"}
Jul 20 05:33:35.297978 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.297860    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt" event={"ID":"79567e0d-24c2-4af5-b7c9-5e2769c6c847","Type":"ContainerDied","Data":"7840b0e06fa5c8085d82d9b0abe591d10ebe8915e284236735a1fd227fd60226"}
Jul 20 05:33:35.297978 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.297917    2576 scope.go:117] "RemoveContainer" containerID="8881d82d347d2cd1a12cbf7fddc1009ca6c9e7b657202461942dd2e3f685f661"
Jul 20 05:33:35.307211 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.307195    2576 scope.go:117] "RemoveContainer" containerID="8881d82d347d2cd1a12cbf7fddc1009ca6c9e7b657202461942dd2e3f685f661"
Jul 20 05:33:35.307462 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:33:35.307441    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8881d82d347d2cd1a12cbf7fddc1009ca6c9e7b657202461942dd2e3f685f661\": container with ID starting with 8881d82d347d2cd1a12cbf7fddc1009ca6c9e7b657202461942dd2e3f685f661 not found: ID does not exist" containerID="8881d82d347d2cd1a12cbf7fddc1009ca6c9e7b657202461942dd2e3f685f661"
Jul 20 05:33:35.307506 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.307470    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8881d82d347d2cd1a12cbf7fddc1009ca6c9e7b657202461942dd2e3f685f661"} err="failed to get container status \"8881d82d347d2cd1a12cbf7fddc1009ca6c9e7b657202461942dd2e3f685f661\": rpc error: code = NotFound desc = could not find container \"8881d82d347d2cd1a12cbf7fddc1009ca6c9e7b657202461942dd2e3f685f661\": container with ID starting with 8881d82d347d2cd1a12cbf7fddc1009ca6c9e7b657202461942dd2e3f685f661 not found: ID does not exist"
Jul 20 05:33:35.319275 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.319251    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"]
Jul 20 05:33:35.323298 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:35.323278    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-3a653f83-7b55ddcfd4-t2cmt"]
Jul 20 05:33:36.680797 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:33:36.680755    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79567e0d-24c2-4af5-b7c9-5e2769c6c847" path="/var/lib/kubelet/pods/79567e0d-24c2-4af5-b7c9-5e2769c6c847/volumes"
Jul 20 05:35:19.812142 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:19.812057    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"]
Jul 20 05:35:19.812623 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:19.812603    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79567e0d-24c2-4af5-b7c9-5e2769c6c847" containerName="maas-api"
Jul 20 05:35:19.812669 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:19.812627    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="79567e0d-24c2-4af5-b7c9-5e2769c6c847" containerName="maas-api"
Jul 20 05:35:19.812729 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:19.812717    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="79567e0d-24c2-4af5-b7c9-5e2769c6c847" containerName="maas-api"
Jul 20 05:35:19.815957 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:19.815935    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"
Jul 20 05:35:19.818521 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:19.818496    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-d01a7226-serving-cert\""
Jul 20 05:35:19.824543 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:19.824516    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"]
Jul 20 05:35:19.962243 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:19.962202    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91bb18da-23ee-40f0-8c24-663a11111217-maas-api-tls\") pod \"maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw\" (UID: \"91bb18da-23ee-40f0-8c24-663a11111217\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"
Jul 20 05:35:19.962434 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:19.962257    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckrc2\" (UniqueName: \"kubernetes.io/projected/91bb18da-23ee-40f0-8c24-663a11111217-kube-api-access-ckrc2\") pod \"maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw\" (UID: \"91bb18da-23ee-40f0-8c24-663a11111217\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"
Jul 20 05:35:19.962434 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:19.962386    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91bb18da-23ee-40f0-8c24-663a11111217-openshift-service-ca\") pod \"maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw\" (UID: \"91bb18da-23ee-40f0-8c24-663a11111217\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"
Jul 20 05:35:20.064033 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:20.063945    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91bb18da-23ee-40f0-8c24-663a11111217-openshift-service-ca\") pod \"maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw\" (UID: \"91bb18da-23ee-40f0-8c24-663a11111217\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"
Jul 20 05:35:20.064203 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:20.064080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91bb18da-23ee-40f0-8c24-663a11111217-maas-api-tls\") pod \"maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw\" (UID: \"91bb18da-23ee-40f0-8c24-663a11111217\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"
Jul 20 05:35:20.064203 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:20.064142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckrc2\" (UniqueName: \"kubernetes.io/projected/91bb18da-23ee-40f0-8c24-663a11111217-kube-api-access-ckrc2\") pod \"maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw\" (UID: \"91bb18da-23ee-40f0-8c24-663a11111217\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"
Jul 20 05:35:20.064674 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:20.064649    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91bb18da-23ee-40f0-8c24-663a11111217-openshift-service-ca\") pod \"maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw\" (UID: \"91bb18da-23ee-40f0-8c24-663a11111217\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"
Jul 20 05:35:20.066969 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:20.066938    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91bb18da-23ee-40f0-8c24-663a11111217-maas-api-tls\") pod \"maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw\" (UID: \"91bb18da-23ee-40f0-8c24-663a11111217\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"
Jul 20 05:35:20.092634 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:20.092597    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckrc2\" (UniqueName: \"kubernetes.io/projected/91bb18da-23ee-40f0-8c24-663a11111217-kube-api-access-ckrc2\") pod \"maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw\" (UID: \"91bb18da-23ee-40f0-8c24-663a11111217\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"
Jul 20 05:35:20.128473 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:20.128436    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"
Jul 20 05:35:20.287946 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:20.287911    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"]
Jul 20 05:35:20.291625 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:35:20.291590    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91bb18da_23ee_40f0_8c24_663a11111217.slice/crio-fd6a21548bc9e6b4cf61cd65b73951ef4f1f9b47d1daf392751aa0043676e461 WatchSource:0}: Error finding container fd6a21548bc9e6b4cf61cd65b73951ef4f1f9b47d1daf392751aa0043676e461: Status 404 returned error can't find the container with id fd6a21548bc9e6b4cf61cd65b73951ef4f1f9b47d1daf392751aa0043676e461
Jul 20 05:35:20.772528 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:20.772498    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw" event={"ID":"91bb18da-23ee-40f0-8c24-663a11111217","Type":"ContainerStarted","Data":"fd6a21548bc9e6b4cf61cd65b73951ef4f1f9b47d1daf392751aa0043676e461"}
Jul 20 05:35:21.779524 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:21.779470    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw" event={"ID":"91bb18da-23ee-40f0-8c24-663a11111217","Type":"ContainerStarted","Data":"33563c91b6fabb810d6d78917c1ee426c6c499edf3eb7daa4a1155dd4115708e"}
Jul 20 05:35:21.779918 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:21.779625    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"
Jul 20 05:35:21.796760 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:21.796712    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw" podStartSLOduration=2.366827622 podStartE2EDuration="2.796697935s" totalImagesPullingTime="429.870313ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:35:21.795524966 +0000 UTC m=+2177.611019038" watchObservedRunningTime="2026-07-20 05:35:21.796697935 +0000 UTC m=+2177.612192006"
Jul 20 05:35:27.790351 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:27.790319    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"
Jul 20 05:35:41.803526 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:41.803487    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"]
Jul 20 05:35:41.804016 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:41.803745    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw" podUID="91bb18da-23ee-40f0-8c24-663a11111217" containerName="maas-api" containerID="cri-o://33563c91b6fabb810d6d78917c1ee426c6c499edf3eb7daa4a1155dd4115708e" gracePeriod=30
Jul 20 05:35:42.050141 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.050116    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"
Jul 20 05:35:42.154432 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.154345    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckrc2\" (UniqueName: \"kubernetes.io/projected/91bb18da-23ee-40f0-8c24-663a11111217-kube-api-access-ckrc2\") pod \"91bb18da-23ee-40f0-8c24-663a11111217\" (UID: \"91bb18da-23ee-40f0-8c24-663a11111217\") "
Jul 20 05:35:42.154432 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.154406    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91bb18da-23ee-40f0-8c24-663a11111217-maas-api-tls\") pod \"91bb18da-23ee-40f0-8c24-663a11111217\" (UID: \"91bb18da-23ee-40f0-8c24-663a11111217\") "
Jul 20 05:35:42.154628 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.154520    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91bb18da-23ee-40f0-8c24-663a11111217-openshift-service-ca\") pod \"91bb18da-23ee-40f0-8c24-663a11111217\" (UID: \"91bb18da-23ee-40f0-8c24-663a11111217\") "
Jul 20 05:35:42.154869 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.154837    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91bb18da-23ee-40f0-8c24-663a11111217-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "91bb18da-23ee-40f0-8c24-663a11111217" (UID: "91bb18da-23ee-40f0-8c24-663a11111217"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:35:42.156635 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.156613    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91bb18da-23ee-40f0-8c24-663a11111217-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "91bb18da-23ee-40f0-8c24-663a11111217" (UID: "91bb18da-23ee-40f0-8c24-663a11111217"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:35:42.156701 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.156675    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91bb18da-23ee-40f0-8c24-663a11111217-kube-api-access-ckrc2" (OuterVolumeSpecName: "kube-api-access-ckrc2") pod "91bb18da-23ee-40f0-8c24-663a11111217" (UID: "91bb18da-23ee-40f0-8c24-663a11111217"). InnerVolumeSpecName "kube-api-access-ckrc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:35:42.255508 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.255467    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckrc2\" (UniqueName: \"kubernetes.io/projected/91bb18da-23ee-40f0-8c24-663a11111217-kube-api-access-ckrc2\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:35:42.255508 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.255500    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91bb18da-23ee-40f0-8c24-663a11111217-maas-api-tls\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:35:42.255508 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.255511    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91bb18da-23ee-40f0-8c24-663a11111217-openshift-service-ca\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:35:42.875484 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.875443    2576 generic.go:356] "Generic (PLEG): container finished" podID="91bb18da-23ee-40f0-8c24-663a11111217" containerID="33563c91b6fabb810d6d78917c1ee426c6c499edf3eb7daa4a1155dd4115708e" exitCode=0
Jul 20 05:35:42.875484 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.875490    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"
Jul 20 05:35:42.875946 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.875526    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw" event={"ID":"91bb18da-23ee-40f0-8c24-663a11111217","Type":"ContainerDied","Data":"33563c91b6fabb810d6d78917c1ee426c6c499edf3eb7daa4a1155dd4115708e"}
Jul 20 05:35:42.875946 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.875583    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw" event={"ID":"91bb18da-23ee-40f0-8c24-663a11111217","Type":"ContainerDied","Data":"fd6a21548bc9e6b4cf61cd65b73951ef4f1f9b47d1daf392751aa0043676e461"}
Jul 20 05:35:42.875946 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.875605    2576 scope.go:117] "RemoveContainer" containerID="33563c91b6fabb810d6d78917c1ee426c6c499edf3eb7daa4a1155dd4115708e"
Jul 20 05:35:42.884179 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.884161    2576 scope.go:117] "RemoveContainer" containerID="33563c91b6fabb810d6d78917c1ee426c6c499edf3eb7daa4a1155dd4115708e"
Jul 20 05:35:42.884439 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:35:42.884414    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33563c91b6fabb810d6d78917c1ee426c6c499edf3eb7daa4a1155dd4115708e\": container with ID starting with 33563c91b6fabb810d6d78917c1ee426c6c499edf3eb7daa4a1155dd4115708e not found: ID does not exist" containerID="33563c91b6fabb810d6d78917c1ee426c6c499edf3eb7daa4a1155dd4115708e"
Jul 20 05:35:42.884536 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.884446    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33563c91b6fabb810d6d78917c1ee426c6c499edf3eb7daa4a1155dd4115708e"} err="failed to get container status \"33563c91b6fabb810d6d78917c1ee426c6c499edf3eb7daa4a1155dd4115708e\": rpc error: code = NotFound desc = could not find container \"33563c91b6fabb810d6d78917c1ee426c6c499edf3eb7daa4a1155dd4115708e\": container with ID starting with 33563c91b6fabb810d6d78917c1ee426c6c499edf3eb7daa4a1155dd4115708e not found: ID does not exist"
Jul 20 05:35:42.891497 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.891475    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"]
Jul 20 05:35:42.894677 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:42.894656    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-d01a7226-6f6cdcb76-zhsdw"]
Jul 20 05:35:44.680166 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:35:44.680134    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91bb18da-23ee-40f0-8c24-663a11111217" path="/var/lib/kubelet/pods/91bb18da-23ee-40f0-8c24-663a11111217/volumes"
Jul 20 05:36:15.109978 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.109942    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"]
Jul 20 05:36:15.110357 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.110273    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91bb18da-23ee-40f0-8c24-663a11111217" containerName="maas-api"
Jul 20 05:36:15.110357 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.110284    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="91bb18da-23ee-40f0-8c24-663a11111217" containerName="maas-api"
Jul 20 05:36:15.110357 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.110347    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="91bb18da-23ee-40f0-8c24-663a11111217" containerName="maas-api"
Jul 20 05:36:15.113206 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.113189    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"
Jul 20 05:36:15.115622 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.115601    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-77b596d2-serving-cert\""
Jul 20 05:36:15.124563 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.124537    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"]
Jul 20 05:36:15.243094 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.243061    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bb98a18-c437-4f91-99ff-f002aa6afd50-openshift-service-ca\") pod \"maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt\" (UID: \"3bb98a18-c437-4f91-99ff-f002aa6afd50\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"
Jul 20 05:36:15.243094 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.243101    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bb98a18-c437-4f91-99ff-f002aa6afd50-maas-api-tls\") pod \"maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt\" (UID: \"3bb98a18-c437-4f91-99ff-f002aa6afd50\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"
Jul 20 05:36:15.243316 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.243117    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2hzt\" (UniqueName: \"kubernetes.io/projected/3bb98a18-c437-4f91-99ff-f002aa6afd50-kube-api-access-k2hzt\") pod \"maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt\" (UID: \"3bb98a18-c437-4f91-99ff-f002aa6afd50\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"
Jul 20 05:36:15.343873 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.343840    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bb98a18-c437-4f91-99ff-f002aa6afd50-openshift-service-ca\") pod \"maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt\" (UID: \"3bb98a18-c437-4f91-99ff-f002aa6afd50\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"
Jul 20 05:36:15.343873 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.343899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bb98a18-c437-4f91-99ff-f002aa6afd50-maas-api-tls\") pod \"maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt\" (UID: \"3bb98a18-c437-4f91-99ff-f002aa6afd50\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"
Jul 20 05:36:15.344129 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.343919    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2hzt\" (UniqueName: \"kubernetes.io/projected/3bb98a18-c437-4f91-99ff-f002aa6afd50-kube-api-access-k2hzt\") pod \"maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt\" (UID: \"3bb98a18-c437-4f91-99ff-f002aa6afd50\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"
Jul 20 05:36:15.344129 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:36:15.344013    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-serving-cert: secret "maas-api-e2e-mt-77b596d2-serving-cert" not found
Jul 20 05:36:15.344129 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:36:15.344104    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bb98a18-c437-4f91-99ff-f002aa6afd50-maas-api-tls podName:3bb98a18-c437-4f91-99ff-f002aa6afd50 nodeName:}" failed. No retries permitted until 2026-07-20 05:36:15.84408042 +0000 UTC m=+2231.659574483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3bb98a18-c437-4f91-99ff-f002aa6afd50-maas-api-tls") pod "maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt" (UID: "3bb98a18-c437-4f91-99ff-f002aa6afd50") : secret "maas-api-e2e-mt-77b596d2-serving-cert" not found
Jul 20 05:36:15.344468 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.344445    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bb98a18-c437-4f91-99ff-f002aa6afd50-openshift-service-ca\") pod \"maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt\" (UID: \"3bb98a18-c437-4f91-99ff-f002aa6afd50\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"
Jul 20 05:36:15.353128 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.353107    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2hzt\" (UniqueName: \"kubernetes.io/projected/3bb98a18-c437-4f91-99ff-f002aa6afd50-kube-api-access-k2hzt\") pod \"maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt\" (UID: \"3bb98a18-c437-4f91-99ff-f002aa6afd50\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"
Jul 20 05:36:15.848698 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.848654    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bb98a18-c437-4f91-99ff-f002aa6afd50-maas-api-tls\") pod \"maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt\" (UID: \"3bb98a18-c437-4f91-99ff-f002aa6afd50\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"
Jul 20 05:36:15.851089 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:15.851065    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bb98a18-c437-4f91-99ff-f002aa6afd50-maas-api-tls\") pod \"maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt\" (UID: \"3bb98a18-c437-4f91-99ff-f002aa6afd50\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"
Jul 20 05:36:16.023965 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:16.023937    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"
Jul 20 05:36:16.157963 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:16.157935    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"]
Jul 20 05:36:16.160379 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:36:16.160343    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb98a18_c437_4f91_99ff_f002aa6afd50.slice/crio-258e6458bf74bab4ab851768388d54a9aca2d1b94f71a82ff8b959d6e2c569dd WatchSource:0}: Error finding container 258e6458bf74bab4ab851768388d54a9aca2d1b94f71a82ff8b959d6e2c569dd: Status 404 returned error can't find the container with id 258e6458bf74bab4ab851768388d54a9aca2d1b94f71a82ff8b959d6e2c569dd
Jul 20 05:36:16.161700 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:16.161681    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 05:36:17.028974 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:17.028937    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt" event={"ID":"3bb98a18-c437-4f91-99ff-f002aa6afd50","Type":"ContainerStarted","Data":"9399d561f45841ba6517f783fd1e99bb3bb1323c14aa49ebd174732497e85e8d"}
Jul 20 05:36:17.029154 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:17.029000    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt" event={"ID":"3bb98a18-c437-4f91-99ff-f002aa6afd50","Type":"ContainerStarted","Data":"258e6458bf74bab4ab851768388d54a9aca2d1b94f71a82ff8b959d6e2c569dd"}
Jul 20 05:36:17.029154 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:17.029077    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"
Jul 20 05:36:17.047382 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:17.047332    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt" podStartSLOduration=1.7169695489999999 podStartE2EDuration="2.047315057s" totalImagesPullingTime="330.345508ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:36:17.046338603 +0000 UTC m=+2232.861832680" watchObservedRunningTime="2026-07-20 05:36:17.047315057 +0000 UTC m=+2232.862809130"
Jul 20 05:36:23.038737 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:36:23.038702    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"
Jul 20 05:37:03.506863 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:03.506826    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"]
Jul 20 05:37:03.507408 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:03.507092    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt" podUID="3bb98a18-c437-4f91-99ff-f002aa6afd50" containerName="maas-api" containerID="cri-o://9399d561f45841ba6517f783fd1e99bb3bb1323c14aa49ebd174732497e85e8d" gracePeriod=30
Jul 20 05:37:03.747641 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:03.747619    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"
Jul 20 05:37:03.862386 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:03.862300    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bb98a18-c437-4f91-99ff-f002aa6afd50-openshift-service-ca\") pod \"3bb98a18-c437-4f91-99ff-f002aa6afd50\" (UID: \"3bb98a18-c437-4f91-99ff-f002aa6afd50\") "
Jul 20 05:37:03.862386 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:03.862379    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2hzt\" (UniqueName: \"kubernetes.io/projected/3bb98a18-c437-4f91-99ff-f002aa6afd50-kube-api-access-k2hzt\") pod \"3bb98a18-c437-4f91-99ff-f002aa6afd50\" (UID: \"3bb98a18-c437-4f91-99ff-f002aa6afd50\") "
Jul 20 05:37:03.862564 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:03.862438    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bb98a18-c437-4f91-99ff-f002aa6afd50-maas-api-tls\") pod \"3bb98a18-c437-4f91-99ff-f002aa6afd50\" (UID: \"3bb98a18-c437-4f91-99ff-f002aa6afd50\") "
Jul 20 05:37:03.862717 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:03.862685    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bb98a18-c437-4f91-99ff-f002aa6afd50-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3bb98a18-c437-4f91-99ff-f002aa6afd50" (UID: "3bb98a18-c437-4f91-99ff-f002aa6afd50"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:37:03.864637 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:03.864614    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bb98a18-c437-4f91-99ff-f002aa6afd50-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3bb98a18-c437-4f91-99ff-f002aa6afd50" (UID: "3bb98a18-c437-4f91-99ff-f002aa6afd50"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:37:03.864812 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:03.864791    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bb98a18-c437-4f91-99ff-f002aa6afd50-kube-api-access-k2hzt" (OuterVolumeSpecName: "kube-api-access-k2hzt") pod "3bb98a18-c437-4f91-99ff-f002aa6afd50" (UID: "3bb98a18-c437-4f91-99ff-f002aa6afd50"). InnerVolumeSpecName "kube-api-access-k2hzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:37:03.963913 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:03.963868    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3bb98a18-c437-4f91-99ff-f002aa6afd50-maas-api-tls\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:37:03.963913 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:03.963909    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bb98a18-c437-4f91-99ff-f002aa6afd50-openshift-service-ca\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:37:03.963913 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:03.963919    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2hzt\" (UniqueName: \"kubernetes.io/projected/3bb98a18-c437-4f91-99ff-f002aa6afd50-kube-api-access-k2hzt\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:37:04.232941 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:04.232906    2576 generic.go:356] "Generic (PLEG): container finished" podID="3bb98a18-c437-4f91-99ff-f002aa6afd50" containerID="9399d561f45841ba6517f783fd1e99bb3bb1323c14aa49ebd174732497e85e8d" exitCode=0
Jul 20 05:37:04.233093 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:04.232946    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"
Jul 20 05:37:04.233093 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:04.232990    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt" event={"ID":"3bb98a18-c437-4f91-99ff-f002aa6afd50","Type":"ContainerDied","Data":"9399d561f45841ba6517f783fd1e99bb3bb1323c14aa49ebd174732497e85e8d"}
Jul 20 05:37:04.233093 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:04.233039    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt" event={"ID":"3bb98a18-c437-4f91-99ff-f002aa6afd50","Type":"ContainerDied","Data":"258e6458bf74bab4ab851768388d54a9aca2d1b94f71a82ff8b959d6e2c569dd"}
Jul 20 05:37:04.233093 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:04.233061    2576 scope.go:117] "RemoveContainer" containerID="9399d561f45841ba6517f783fd1e99bb3bb1323c14aa49ebd174732497e85e8d"
Jul 20 05:37:04.242105 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:04.242089    2576 scope.go:117] "RemoveContainer" containerID="9399d561f45841ba6517f783fd1e99bb3bb1323c14aa49ebd174732497e85e8d"
Jul 20 05:37:04.242350 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:37:04.242332    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9399d561f45841ba6517f783fd1e99bb3bb1323c14aa49ebd174732497e85e8d\": container with ID starting with 9399d561f45841ba6517f783fd1e99bb3bb1323c14aa49ebd174732497e85e8d not found: ID does not exist" containerID="9399d561f45841ba6517f783fd1e99bb3bb1323c14aa49ebd174732497e85e8d"
Jul 20 05:37:04.242400 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:04.242359    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9399d561f45841ba6517f783fd1e99bb3bb1323c14aa49ebd174732497e85e8d"} err="failed to get container status \"9399d561f45841ba6517f783fd1e99bb3bb1323c14aa49ebd174732497e85e8d\": rpc error: code = NotFound desc = could not find container \"9399d561f45841ba6517f783fd1e99bb3bb1323c14aa49ebd174732497e85e8d\": container with ID starting with 9399d561f45841ba6517f783fd1e99bb3bb1323c14aa49ebd174732497e85e8d not found: ID does not exist"
Jul 20 05:37:04.259110 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:04.259087    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"]
Jul 20 05:37:04.261577 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:04.261552    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77b596d2-6c6d48685-4mfxt"]
Jul 20 05:37:04.681726 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:37:04.681651    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bb98a18-c437-4f91-99ff-f002aa6afd50" path="/var/lib/kubelet/pods/3bb98a18-c437-4f91-99ff-f002aa6afd50/volumes"
Jul 20 05:38:56.901975 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:56.901940    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"]
Jul 20 05:38:56.902422 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:56.902326    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bb98a18-c437-4f91-99ff-f002aa6afd50" containerName="maas-api"
Jul 20 05:38:56.902422 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:56.902338    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bb98a18-c437-4f91-99ff-f002aa6afd50" containerName="maas-api"
Jul 20 05:38:56.902422 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:56.902410    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bb98a18-c437-4f91-99ff-f002aa6afd50" containerName="maas-api"
Jul 20 05:38:56.905448 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:56.905433    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"
Jul 20 05:38:56.908041 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:56.908016    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-192e48-serving-cert\""
Jul 20 05:38:56.914315 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:56.914291    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"]
Jul 20 05:38:56.961441 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:56.961246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/078ff30c-2809-42ee-b853-502e63db60df-maas-api-tls\") pod \"maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp\" (UID: \"078ff30c-2809-42ee-b853-502e63db60df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"
Jul 20 05:38:56.961441 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:56.961341    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk7kf\" (UniqueName: \"kubernetes.io/projected/078ff30c-2809-42ee-b853-502e63db60df-kube-api-access-bk7kf\") pod \"maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp\" (UID: \"078ff30c-2809-42ee-b853-502e63db60df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"
Jul 20 05:38:56.961441 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:56.961377    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/078ff30c-2809-42ee-b853-502e63db60df-openshift-service-ca\") pod \"maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp\" (UID: \"078ff30c-2809-42ee-b853-502e63db60df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"
Jul 20 05:38:57.062127 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:57.062088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk7kf\" (UniqueName: \"kubernetes.io/projected/078ff30c-2809-42ee-b853-502e63db60df-kube-api-access-bk7kf\") pod \"maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp\" (UID: \"078ff30c-2809-42ee-b853-502e63db60df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"
Jul 20 05:38:57.062127 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:57.062131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/078ff30c-2809-42ee-b853-502e63db60df-openshift-service-ca\") pod \"maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp\" (UID: \"078ff30c-2809-42ee-b853-502e63db60df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"
Jul 20 05:38:57.062352 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:57.062186    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/078ff30c-2809-42ee-b853-502e63db60df-maas-api-tls\") pod \"maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp\" (UID: \"078ff30c-2809-42ee-b853-502e63db60df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"
Jul 20 05:38:57.062841 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:57.062817    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/078ff30c-2809-42ee-b853-502e63db60df-openshift-service-ca\") pod \"maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp\" (UID: \"078ff30c-2809-42ee-b853-502e63db60df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"
Jul 20 05:38:57.064689 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:57.064660    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/078ff30c-2809-42ee-b853-502e63db60df-maas-api-tls\") pod \"maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp\" (UID: \"078ff30c-2809-42ee-b853-502e63db60df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"
Jul 20 05:38:57.070424 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:57.070400    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk7kf\" (UniqueName: \"kubernetes.io/projected/078ff30c-2809-42ee-b853-502e63db60df-kube-api-access-bk7kf\") pod \"maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp\" (UID: \"078ff30c-2809-42ee-b853-502e63db60df\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"
Jul 20 05:38:57.216026 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:57.215996    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"
Jul 20 05:38:57.344364 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:57.344222    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"]
Jul 20 05:38:57.346515 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:38:57.346489    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod078ff30c_2809_42ee_b853_502e63db60df.slice/crio-31b98191cac7192d441d1b210c2e37916ff837d73ae48845571973faed563c92 WatchSource:0}: Error finding container 31b98191cac7192d441d1b210c2e37916ff837d73ae48845571973faed563c92: Status 404 returned error can't find the container with id 31b98191cac7192d441d1b210c2e37916ff837d73ae48845571973faed563c92
Jul 20 05:38:57.754779 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:57.754745    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp" event={"ID":"078ff30c-2809-42ee-b853-502e63db60df","Type":"ContainerStarted","Data":"31b98191cac7192d441d1b210c2e37916ff837d73ae48845571973faed563c92"}
Jul 20 05:38:58.760241 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:58.760205    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp" event={"ID":"078ff30c-2809-42ee-b853-502e63db60df","Type":"ContainerStarted","Data":"dfab1e86b4c93e988dd8ff66041eba5fe04ca40ce813c106fcd492d2cf34e676"}
Jul 20 05:38:58.760611 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:58.760282    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"
Jul 20 05:38:58.778370 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:38:58.778326    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp" podStartSLOduration=2.248077562 podStartE2EDuration="2.778312338s" totalImagesPullingTime="530.234776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:38:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:38:58.776176774 +0000 UTC m=+2394.591670840" watchObservedRunningTime="2026-07-20 05:38:58.778312338 +0000 UTC m=+2394.593806447"
Jul 20 05:39:04.775614 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:04.775581    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"
Jul 20 05:39:05.176268 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:05.176178    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"]
Jul 20 05:39:05.179959 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:05.179940    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"
Jul 20 05:39:05.182552 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:05.182528    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-598bdb-serving-cert\""
Jul 20 05:39:05.190090 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:05.190063    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"]
Jul 20 05:39:05.230957 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:05.230927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-maas-api-tls\") pod \"maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g\" (UID: \"56e0f9cb-b456-4758-b2ab-ce5494d2d18f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"
Jul 20 05:39:05.230957 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:05.230957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khc27\" (UniqueName: \"kubernetes.io/projected/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-kube-api-access-khc27\") pod \"maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g\" (UID: \"56e0f9cb-b456-4758-b2ab-ce5494d2d18f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"
Jul 20 05:39:05.231124 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:05.230989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g\" (UID: \"56e0f9cb-b456-4758-b2ab-ce5494d2d18f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"
Jul 20 05:39:05.331802 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:05.331775    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-maas-api-tls\") pod \"maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g\" (UID: \"56e0f9cb-b456-4758-b2ab-ce5494d2d18f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"
Jul 20 05:39:05.332009 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:05.331807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khc27\" (UniqueName: \"kubernetes.io/projected/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-kube-api-access-khc27\") pod \"maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g\" (UID: \"56e0f9cb-b456-4758-b2ab-ce5494d2d18f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"
Jul 20 05:39:05.332009 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:05.331834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g\" (UID: \"56e0f9cb-b456-4758-b2ab-ce5494d2d18f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"
Jul 20 05:39:05.332469 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:05.332452    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g\" (UID: \"56e0f9cb-b456-4758-b2ab-ce5494d2d18f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"
Jul 20 05:39:05.334440 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:05.334423    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-maas-api-tls\") pod \"maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g\" (UID: \"56e0f9cb-b456-4758-b2ab-ce5494d2d18f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"
Jul 20 05:39:05.339392 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:05.339369    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khc27\" (UniqueName: \"kubernetes.io/projected/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-kube-api-access-khc27\") pod \"maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g\" (UID: \"56e0f9cb-b456-4758-b2ab-ce5494d2d18f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"
Jul 20 05:39:05.490925 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:05.490874    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"
Jul 20 05:39:05.625463 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:05.625404    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"]
Jul 20 05:39:05.627601 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:39:05.627574    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e0f9cb_b456_4758_b2ab_ce5494d2d18f.slice/crio-38f05f51fd5dec0b38571b94c10da7ff5993ab3dcbf52383987385087348c5a9 WatchSource:0}: Error finding container 38f05f51fd5dec0b38571b94c10da7ff5993ab3dcbf52383987385087348c5a9: Status 404 returned error can't find the container with id 38f05f51fd5dec0b38571b94c10da7ff5993ab3dcbf52383987385087348c5a9
Jul 20 05:39:05.792514 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:05.792428    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g" event={"ID":"56e0f9cb-b456-4758-b2ab-ce5494d2d18f","Type":"ContainerStarted","Data":"38f05f51fd5dec0b38571b94c10da7ff5993ab3dcbf52383987385087348c5a9"}
Jul 20 05:39:06.798429 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:06.798396    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g" event={"ID":"56e0f9cb-b456-4758-b2ab-ce5494d2d18f","Type":"ContainerStarted","Data":"bc9bebee227504d239e6caac673d7363f3d45b91414ddbc4e5b79debcc6e8870"}
Jul 20 05:39:06.798861 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:06.798515    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"
Jul 20 05:39:06.815303 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:06.815243    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g" podStartSLOduration=1.428729213 podStartE2EDuration="1.815227055s" totalImagesPullingTime="386.497842ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:39:06.813503421 +0000 UTC m=+2402.628997496" watchObservedRunningTime="2026-07-20 05:39:06.815227055 +0000 UTC m=+2402.630721179"
Jul 20 05:39:12.808538 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:12.808511    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"
Jul 20 05:39:19.528235 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.528199    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"]
Jul 20 05:39:19.531118 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.531101    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.534924 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.534896    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-192e48\"/\"kube-root-ca.crt\""
Jul 20 05:39:19.535061 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.534928    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-192e48\"/\"test-model-192e48-kserve-self-signed-certs\""
Jul 20 05:39:19.535061 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.534930    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-192e48\"/\"default-dockercfg-j2p6d\""
Jul 20 05:39:19.535061 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.534903    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-192e48\"/\"openshift-service-ca.crt\""
Jul 20 05:39:19.540830 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.540801    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"]
Jul 20 05:39:19.657074 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.657025    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-model-cache\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.657074 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.657074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-dshm\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.657290 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.657102    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-tmp-dir\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.657290 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.657173    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-home\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.657290 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.657225    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfdl7\" (UniqueName: \"kubernetes.io/projected/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-kube-api-access-tfdl7\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.657396 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.657293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-tls-certs\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.758130 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.758085    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-tmp-dir\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.758130 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.758139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-home\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.758326 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.758175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfdl7\" (UniqueName: \"kubernetes.io/projected/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-kube-api-access-tfdl7\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.758326 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.758212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-tls-certs\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.758326 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.758258    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-model-cache\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.758326 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.758284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-dshm\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.758564 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.758538    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-tmp-dir\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.758631 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.758568    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-home\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.758689 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.758648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-model-cache\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.760588 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.760567    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-dshm\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.760769 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.760751    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-tls-certs\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.766553 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.766532    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfdl7\" (UniqueName: \"kubernetes.io/projected/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-kube-api-access-tfdl7\") pod \"test-model-192e48-kserve-655c4fd8c5-j8vl2\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") " pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.842248 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.842174    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:19.977982 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:19.977939    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"]
Jul 20 05:39:19.980149 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:39:19.980118    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6023b3c7_1b19_48c2_a4e6_5ba8e665ce97.slice/crio-c6580f5d91f1b5b6d23d061d2336f4a6c28a3972c3ad037684c3bec6d91c186a WatchSource:0}: Error finding container c6580f5d91f1b5b6d23d061d2336f4a6c28a3972c3ad037684c3bec6d91c186a: Status 404 returned error can't find the container with id c6580f5d91f1b5b6d23d061d2336f4a6c28a3972c3ad037684c3bec6d91c186a
Jul 20 05:39:20.864440 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:20.864397    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2" event={"ID":"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97","Type":"ContainerStarted","Data":"148923acab39e7efb389d69d4b50d87cd247de2d74aee94eb9d902ec6915ea0f"}
Jul 20 05:39:20.864440 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:20.864443    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2" event={"ID":"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97","Type":"ContainerStarted","Data":"c6580f5d91f1b5b6d23d061d2336f4a6c28a3972c3ad037684c3bec6d91c186a"}
Jul 20 05:39:20.883254 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:20.883209    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2" podStartSLOduration=1.8831896559999999 podStartE2EDuration="1.883189656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:39:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:39:20.882597385 +0000 UTC m=+2416.698091456" watchObservedRunningTime="2026-07-20 05:39:20.883189656 +0000 UTC m=+2416.698683728"
Jul 20 05:39:29.842457 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:29.842402    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:29.842457 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:29.842460    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:29.855003 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:29.854980    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:39:29.916500 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:39:29.916475    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:40:23.813079 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:23.813027    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"]
Jul 20 05:40:35.261814 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:35.261781    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"]
Jul 20 05:40:35.262290 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:35.262022    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp" podUID="078ff30c-2809-42ee-b853-502e63db60df" containerName="maas-api" containerID="cri-o://dfab1e86b4c93e988dd8ff66041eba5fe04ca40ce813c106fcd492d2cf34e676" gracePeriod=30
Jul 20 05:40:35.711116 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:35.711092    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"
Jul 20 05:40:35.852521 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:35.852426    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/078ff30c-2809-42ee-b853-502e63db60df-openshift-service-ca\") pod \"078ff30c-2809-42ee-b853-502e63db60df\" (UID: \"078ff30c-2809-42ee-b853-502e63db60df\") "
Jul 20 05:40:35.852521 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:35.852467    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/078ff30c-2809-42ee-b853-502e63db60df-maas-api-tls\") pod \"078ff30c-2809-42ee-b853-502e63db60df\" (UID: \"078ff30c-2809-42ee-b853-502e63db60df\") "
Jul 20 05:40:35.852521 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:35.852493    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bk7kf\" (UniqueName: \"kubernetes.io/projected/078ff30c-2809-42ee-b853-502e63db60df-kube-api-access-bk7kf\") pod \"078ff30c-2809-42ee-b853-502e63db60df\" (UID: \"078ff30c-2809-42ee-b853-502e63db60df\") "
Jul 20 05:40:35.852860 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:35.852835    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/078ff30c-2809-42ee-b853-502e63db60df-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "078ff30c-2809-42ee-b853-502e63db60df" (UID: "078ff30c-2809-42ee-b853-502e63db60df"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:40:35.854610 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:35.854583    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/078ff30c-2809-42ee-b853-502e63db60df-kube-api-access-bk7kf" (OuterVolumeSpecName: "kube-api-access-bk7kf") pod "078ff30c-2809-42ee-b853-502e63db60df" (UID: "078ff30c-2809-42ee-b853-502e63db60df"). InnerVolumeSpecName "kube-api-access-bk7kf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:40:35.854749 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:35.854720    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/078ff30c-2809-42ee-b853-502e63db60df-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "078ff30c-2809-42ee-b853-502e63db60df" (UID: "078ff30c-2809-42ee-b853-502e63db60df"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:40:35.954051 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:35.954007    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/078ff30c-2809-42ee-b853-502e63db60df-openshift-service-ca\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:40:35.954051 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:35.954042    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/078ff30c-2809-42ee-b853-502e63db60df-maas-api-tls\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:40:35.954051 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:35.954051    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk7kf\" (UniqueName: \"kubernetes.io/projected/078ff30c-2809-42ee-b853-502e63db60df-kube-api-access-bk7kf\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:40:36.218372 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:36.218334    2576 generic.go:356] "Generic (PLEG): container finished" podID="078ff30c-2809-42ee-b853-502e63db60df" containerID="dfab1e86b4c93e988dd8ff66041eba5fe04ca40ce813c106fcd492d2cf34e676" exitCode=0
Jul 20 05:40:36.218580 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:36.218422    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"
Jul 20 05:40:36.218580 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:36.218420    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp" event={"ID":"078ff30c-2809-42ee-b853-502e63db60df","Type":"ContainerDied","Data":"dfab1e86b4c93e988dd8ff66041eba5fe04ca40ce813c106fcd492d2cf34e676"}
Jul 20 05:40:36.218727 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:36.218603    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp" event={"ID":"078ff30c-2809-42ee-b853-502e63db60df","Type":"ContainerDied","Data":"31b98191cac7192d441d1b210c2e37916ff837d73ae48845571973faed563c92"}
Jul 20 05:40:36.218727 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:36.218637    2576 scope.go:117] "RemoveContainer" containerID="dfab1e86b4c93e988dd8ff66041eba5fe04ca40ce813c106fcd492d2cf34e676"
Jul 20 05:40:36.228277 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:36.228259    2576 scope.go:117] "RemoveContainer" containerID="dfab1e86b4c93e988dd8ff66041eba5fe04ca40ce813c106fcd492d2cf34e676"
Jul 20 05:40:36.228523 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:40:36.228507    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfab1e86b4c93e988dd8ff66041eba5fe04ca40ce813c106fcd492d2cf34e676\": container with ID starting with dfab1e86b4c93e988dd8ff66041eba5fe04ca40ce813c106fcd492d2cf34e676 not found: ID does not exist" containerID="dfab1e86b4c93e988dd8ff66041eba5fe04ca40ce813c106fcd492d2cf34e676"
Jul 20 05:40:36.228576 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:36.228531    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfab1e86b4c93e988dd8ff66041eba5fe04ca40ce813c106fcd492d2cf34e676"} err="failed to get container status \"dfab1e86b4c93e988dd8ff66041eba5fe04ca40ce813c106fcd492d2cf34e676\": rpc error: code = NotFound desc = could not find container \"dfab1e86b4c93e988dd8ff66041eba5fe04ca40ce813c106fcd492d2cf34e676\": container with ID starting with dfab1e86b4c93e988dd8ff66041eba5fe04ca40ce813c106fcd492d2cf34e676 not found: ID does not exist"
Jul 20 05:40:36.238664 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:36.238640    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"]
Jul 20 05:40:36.244340 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:36.244319    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-192e48-cfdf59d6b-zqwgp"]
Jul 20 05:40:36.680470 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:36.680393    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="078ff30c-2809-42ee-b853-502e63db60df" path="/var/lib/kubelet/pods/078ff30c-2809-42ee-b853-502e63db60df/volumes"
Jul 20 05:40:38.833693 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:38.833648    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2" podUID="6023b3c7-1b19-48c2-a4e6-5ba8e665ce97" containerName="main" containerID="cri-o://148923acab39e7efb389d69d4b50d87cd247de2d74aee94eb9d902ec6915ea0f" gracePeriod=45
Jul 20 05:40:39.087845 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.087776    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:40:39.182811 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.182773    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfdl7\" (UniqueName: \"kubernetes.io/projected/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-kube-api-access-tfdl7\") pod \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") "
Jul 20 05:40:39.183033 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.182826    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-dshm\") pod \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") "
Jul 20 05:40:39.183033 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.182861    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-tmp-dir\") pod \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") "
Jul 20 05:40:39.183033 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.182925    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-home\") pod \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") "
Jul 20 05:40:39.183033 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.182975    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-tls-certs\") pod \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") "
Jul 20 05:40:39.183033 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.183014    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-model-cache\") pod \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\" (UID: \"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97\") "
Jul 20 05:40:39.183283 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.183195    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6023b3c7-1b19-48c2-a4e6-5ba8e665ce97" (UID: "6023b3c7-1b19-48c2-a4e6-5ba8e665ce97"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:40:39.183283 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.183216    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-home" (OuterVolumeSpecName: "home") pod "6023b3c7-1b19-48c2-a4e6-5ba8e665ce97" (UID: "6023b3c7-1b19-48c2-a4e6-5ba8e665ce97"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:40:39.183390 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.183360    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-model-cache" (OuterVolumeSpecName: "model-cache") pod "6023b3c7-1b19-48c2-a4e6-5ba8e665ce97" (UID: "6023b3c7-1b19-48c2-a4e6-5ba8e665ce97"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:40:39.185186 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.185162    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-dshm" (OuterVolumeSpecName: "dshm") pod "6023b3c7-1b19-48c2-a4e6-5ba8e665ce97" (UID: "6023b3c7-1b19-48c2-a4e6-5ba8e665ce97"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:40:39.185278 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.185237    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6023b3c7-1b19-48c2-a4e6-5ba8e665ce97" (UID: "6023b3c7-1b19-48c2-a4e6-5ba8e665ce97"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:40:39.185278 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.185264    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-kube-api-access-tfdl7" (OuterVolumeSpecName: "kube-api-access-tfdl7") pod "6023b3c7-1b19-48c2-a4e6-5ba8e665ce97" (UID: "6023b3c7-1b19-48c2-a4e6-5ba8e665ce97"). InnerVolumeSpecName "kube-api-access-tfdl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:40:39.235066 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.235033    2576 generic.go:356] "Generic (PLEG): container finished" podID="6023b3c7-1b19-48c2-a4e6-5ba8e665ce97" containerID="148923acab39e7efb389d69d4b50d87cd247de2d74aee94eb9d902ec6915ea0f" exitCode=0
Jul 20 05:40:39.235222 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.235078    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"
Jul 20 05:40:39.235222 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.235107    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2" event={"ID":"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97","Type":"ContainerDied","Data":"148923acab39e7efb389d69d4b50d87cd247de2d74aee94eb9d902ec6915ea0f"}
Jul 20 05:40:39.235222 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.235136    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2" event={"ID":"6023b3c7-1b19-48c2-a4e6-5ba8e665ce97","Type":"ContainerDied","Data":"c6580f5d91f1b5b6d23d061d2336f4a6c28a3972c3ad037684c3bec6d91c186a"}
Jul 20 05:40:39.235222 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.235152    2576 scope.go:117] "RemoveContainer" containerID="148923acab39e7efb389d69d4b50d87cd247de2d74aee94eb9d902ec6915ea0f"
Jul 20 05:40:39.244171 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.244154    2576 scope.go:117] "RemoveContainer" containerID="148923acab39e7efb389d69d4b50d87cd247de2d74aee94eb9d902ec6915ea0f"
Jul 20 05:40:39.244405 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:40:39.244388    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"148923acab39e7efb389d69d4b50d87cd247de2d74aee94eb9d902ec6915ea0f\": container with ID starting with 148923acab39e7efb389d69d4b50d87cd247de2d74aee94eb9d902ec6915ea0f not found: ID does not exist" containerID="148923acab39e7efb389d69d4b50d87cd247de2d74aee94eb9d902ec6915ea0f"
Jul 20 05:40:39.244456 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.244413    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"148923acab39e7efb389d69d4b50d87cd247de2d74aee94eb9d902ec6915ea0f"} err="failed to get container status \"148923acab39e7efb389d69d4b50d87cd247de2d74aee94eb9d902ec6915ea0f\": rpc error: code = NotFound desc = could not find container \"148923acab39e7efb389d69d4b50d87cd247de2d74aee94eb9d902ec6915ea0f\": container with ID starting with 148923acab39e7efb389d69d4b50d87cd247de2d74aee94eb9d902ec6915ea0f not found: ID does not exist"
Jul 20 05:40:39.255317 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.255289    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"]
Jul 20 05:40:39.259008 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.258985    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-192e48/test-model-192e48-kserve-655c4fd8c5-j8vl2"]
Jul 20 05:40:39.283917 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.283860    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-tmp-dir\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:40:39.283917 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.283914    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-home\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:40:39.284076 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.283928    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-tls-certs\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:40:39.284076 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.283939    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-model-cache\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:40:39.284076 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.283951    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfdl7\" (UniqueName: \"kubernetes.io/projected/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-kube-api-access-tfdl7\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:40:39.284076 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:39.283971    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97-dshm\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:40:40.681609 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:40.681575    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6023b3c7-1b19-48c2-a4e6-5ba8e665ce97" path="/var/lib/kubelet/pods/6023b3c7-1b19-48c2-a4e6-5ba8e665ce97/volumes"
Jul 20 05:40:57.454635 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:57.454554    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"]
Jul 20 05:40:57.455244 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:57.454810    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g" podUID="56e0f9cb-b456-4758-b2ab-ce5494d2d18f" containerName="maas-api" containerID="cri-o://bc9bebee227504d239e6caac673d7363f3d45b91414ddbc4e5b79debcc6e8870" gracePeriod=30
Jul 20 05:40:57.703303 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:57.703278    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"
Jul 20 05:40:57.760259 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:57.760180    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khc27\" (UniqueName: \"kubernetes.io/projected/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-kube-api-access-khc27\") pod \"56e0f9cb-b456-4758-b2ab-ce5494d2d18f\" (UID: \"56e0f9cb-b456-4758-b2ab-ce5494d2d18f\") "
Jul 20 05:40:57.760259 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:57.760219    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-openshift-service-ca\") pod \"56e0f9cb-b456-4758-b2ab-ce5494d2d18f\" (UID: \"56e0f9cb-b456-4758-b2ab-ce5494d2d18f\") "
Jul 20 05:40:57.760449 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:57.760258    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-maas-api-tls\") pod \"56e0f9cb-b456-4758-b2ab-ce5494d2d18f\" (UID: \"56e0f9cb-b456-4758-b2ab-ce5494d2d18f\") "
Jul 20 05:40:57.760683 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:57.760649    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56e0f9cb-b456-4758-b2ab-ce5494d2d18f" (UID: "56e0f9cb-b456-4758-b2ab-ce5494d2d18f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:40:57.762499 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:57.762475    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-kube-api-access-khc27" (OuterVolumeSpecName: "kube-api-access-khc27") pod "56e0f9cb-b456-4758-b2ab-ce5494d2d18f" (UID: "56e0f9cb-b456-4758-b2ab-ce5494d2d18f"). InnerVolumeSpecName "kube-api-access-khc27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:40:57.762499 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:57.762489    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56e0f9cb-b456-4758-b2ab-ce5494d2d18f" (UID: "56e0f9cb-b456-4758-b2ab-ce5494d2d18f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:40:57.861271 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:57.861238    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-maas-api-tls\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:40:57.861271 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:57.861268    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khc27\" (UniqueName: \"kubernetes.io/projected/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-kube-api-access-khc27\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:40:57.861271 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:57.861278    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56e0f9cb-b456-4758-b2ab-ce5494d2d18f-openshift-service-ca\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:40:58.326007 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:58.325970    2576 generic.go:356] "Generic (PLEG): container finished" podID="56e0f9cb-b456-4758-b2ab-ce5494d2d18f" containerID="bc9bebee227504d239e6caac673d7363f3d45b91414ddbc4e5b79debcc6e8870" exitCode=0
Jul 20 05:40:58.326174 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:58.326034    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"
Jul 20 05:40:58.326174 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:58.326042    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g" event={"ID":"56e0f9cb-b456-4758-b2ab-ce5494d2d18f","Type":"ContainerDied","Data":"bc9bebee227504d239e6caac673d7363f3d45b91414ddbc4e5b79debcc6e8870"}
Jul 20 05:40:58.326174 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:58.326132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g" event={"ID":"56e0f9cb-b456-4758-b2ab-ce5494d2d18f","Type":"ContainerDied","Data":"38f05f51fd5dec0b38571b94c10da7ff5993ab3dcbf52383987385087348c5a9"}
Jul 20 05:40:58.326174 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:58.326161    2576 scope.go:117] "RemoveContainer" containerID="bc9bebee227504d239e6caac673d7363f3d45b91414ddbc4e5b79debcc6e8870"
Jul 20 05:40:58.334596 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:58.334578    2576 scope.go:117] "RemoveContainer" containerID="bc9bebee227504d239e6caac673d7363f3d45b91414ddbc4e5b79debcc6e8870"
Jul 20 05:40:58.334910 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:40:58.334870    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc9bebee227504d239e6caac673d7363f3d45b91414ddbc4e5b79debcc6e8870\": container with ID starting with bc9bebee227504d239e6caac673d7363f3d45b91414ddbc4e5b79debcc6e8870 not found: ID does not exist" containerID="bc9bebee227504d239e6caac673d7363f3d45b91414ddbc4e5b79debcc6e8870"
Jul 20 05:40:58.334977 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:58.334921    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc9bebee227504d239e6caac673d7363f3d45b91414ddbc4e5b79debcc6e8870"} err="failed to get container status \"bc9bebee227504d239e6caac673d7363f3d45b91414ddbc4e5b79debcc6e8870\": rpc error: code = NotFound desc = could not find container \"bc9bebee227504d239e6caac673d7363f3d45b91414ddbc4e5b79debcc6e8870\": container with ID starting with bc9bebee227504d239e6caac673d7363f3d45b91414ddbc4e5b79debcc6e8870 not found: ID does not exist"
Jul 20 05:40:58.346280 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:58.346252    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"]
Jul 20 05:40:58.349685 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:58.349661    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-598bdb-76f6f7b768-gl28g"]
Jul 20 05:40:58.680455 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:40:58.680378    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56e0f9cb-b456-4758-b2ab-ce5494d2d18f" path="/var/lib/kubelet/pods/56e0f9cb-b456-4758-b2ab-ce5494d2d18f/volumes"
Jul 20 05:41:12.482746 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.482707    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"]
Jul 20 05:41:12.483222 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.483066    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6023b3c7-1b19-48c2-a4e6-5ba8e665ce97" containerName="main"
Jul 20 05:41:12.483222 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.483079    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6023b3c7-1b19-48c2-a4e6-5ba8e665ce97" containerName="main"
Jul 20 05:41:12.483222 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.483092    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="078ff30c-2809-42ee-b853-502e63db60df" containerName="maas-api"
Jul 20 05:41:12.483222 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.483098    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="078ff30c-2809-42ee-b853-502e63db60df" containerName="maas-api"
Jul 20 05:41:12.483222 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.483111    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56e0f9cb-b456-4758-b2ab-ce5494d2d18f" containerName="maas-api"
Jul 20 05:41:12.483222 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.483116    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="56e0f9cb-b456-4758-b2ab-ce5494d2d18f" containerName="maas-api"
Jul 20 05:41:12.483222 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.483170    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6023b3c7-1b19-48c2-a4e6-5ba8e665ce97" containerName="main"
Jul 20 05:41:12.483222 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.483178    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="078ff30c-2809-42ee-b853-502e63db60df" containerName="maas-api"
Jul 20 05:41:12.483222 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.483186    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="56e0f9cb-b456-4758-b2ab-ce5494d2d18f" containerName="maas-api"
Jul 20 05:41:12.485988 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.485968    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:12.488617 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.488594    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-ce4188-serving-cert\""
Jul 20 05:41:12.497290 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.497265    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"]
Jul 20 05:41:12.584379 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.584338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nklp\" (UniqueName: \"kubernetes.io/projected/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-kube-api-access-4nklp\") pod \"maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls\" (UID: \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:12.584560 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.584399    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-maas-api-tls\") pod \"maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls\" (UID: \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:12.584560 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.584501    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-openshift-service-ca\") pod \"maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls\" (UID: \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:12.685309 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.685279    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nklp\" (UniqueName: \"kubernetes.io/projected/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-kube-api-access-4nklp\") pod \"maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls\" (UID: \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:12.685480 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.685322    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-maas-api-tls\") pod \"maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls\" (UID: \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:12.685480 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.685365    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-openshift-service-ca\") pod \"maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls\" (UID: \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:12.685554 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:41:12.685504    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-serving-cert: secret "maas-api-e2e-api-a-ce4188-serving-cert" not found
Jul 20 05:41:12.685588 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:41:12.685577    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-maas-api-tls podName:e28e78a5-2e2a-4b21-a216-ccd1a47d9f65 nodeName:}" failed. No retries permitted until 2026-07-20 05:41:13.185560417 +0000 UTC m=+2529.001054470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-maas-api-tls") pod "maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls" (UID: "e28e78a5-2e2a-4b21-a216-ccd1a47d9f65") : secret "maas-api-e2e-api-a-ce4188-serving-cert" not found
Jul 20 05:41:12.685975 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.685958    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-openshift-service-ca\") pod \"maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls\" (UID: \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:12.707037 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:12.707002    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nklp\" (UniqueName: \"kubernetes.io/projected/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-kube-api-access-4nklp\") pod \"maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls\" (UID: \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:13.190898 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:13.190855    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-maas-api-tls\") pod \"maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls\" (UID: \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:13.191087 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:41:13.191008    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-serving-cert: secret "maas-api-e2e-api-a-ce4188-serving-cert" not found
Jul 20 05:41:13.191087 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:41:13.191071    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-maas-api-tls podName:e28e78a5-2e2a-4b21-a216-ccd1a47d9f65 nodeName:}" failed. No retries permitted until 2026-07-20 05:41:14.191056146 +0000 UTC m=+2530.006550196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-maas-api-tls") pod "maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls" (UID: "e28e78a5-2e2a-4b21-a216-ccd1a47d9f65") : secret "maas-api-e2e-api-a-ce4188-serving-cert" not found
Jul 20 05:41:14.199116 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:14.199079    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-maas-api-tls\") pod \"maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls\" (UID: \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:14.201671 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:14.201650    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-maas-api-tls\") pod \"maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls\" (UID: \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:14.296831 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:14.296793    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:14.451604 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:14.451523    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"]
Jul 20 05:41:14.454845 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:41:14.454804    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28e78a5_2e2a_4b21_a216_ccd1a47d9f65.slice/crio-f272bafd08c4935802fca7e340eb70f99b3f492aab6d47c35882660ee21cf474 WatchSource:0}: Error finding container f272bafd08c4935802fca7e340eb70f99b3f492aab6d47c35882660ee21cf474: Status 404 returned error can't find the container with id f272bafd08c4935802fca7e340eb70f99b3f492aab6d47c35882660ee21cf474
Jul 20 05:41:15.403036 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:15.403003    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls" event={"ID":"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65","Type":"ContainerStarted","Data":"eebd156ecb026f4b0e2512c3982f5a35c71ea81e6f0f2c239a81c9b016f0f91e"}
Jul 20 05:41:15.403402 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:15.403051    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls" event={"ID":"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65","Type":"ContainerStarted","Data":"f272bafd08c4935802fca7e340eb70f99b3f492aab6d47c35882660ee21cf474"}
Jul 20 05:41:15.403402 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:15.403093    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:15.425955 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:15.425911    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls" podStartSLOduration=3.008131424 podStartE2EDuration="3.425895633s" totalImagesPullingTime="417.764209ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:41:15.424004148 +0000 UTC m=+2531.239498214" watchObservedRunningTime="2026-07-20 05:41:15.425895633 +0000 UTC m=+2531.241389695"
Jul 20 05:41:20.713177 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:20.713139    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"]
Jul 20 05:41:20.717770 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:20.717741    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"
Jul 20 05:41:20.720354 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:20.720331    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-d0511a-serving-cert\""
Jul 20 05:41:20.729274 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:20.729255    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"]
Jul 20 05:41:20.861363 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:20.861332    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d076d8c-06f7-48af-b54d-46b742537c9d-openshift-service-ca\") pod \"maas-api-e2e-api-b-d0511a-8657578495-mgpnq\" (UID: \"9d076d8c-06f7-48af-b54d-46b742537c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"
Jul 20 05:41:20.861516 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:20.861382    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d076d8c-06f7-48af-b54d-46b742537c9d-maas-api-tls\") pod \"maas-api-e2e-api-b-d0511a-8657578495-mgpnq\" (UID: \"9d076d8c-06f7-48af-b54d-46b742537c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"
Jul 20 05:41:20.861516 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:20.861468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4wb9\" (UniqueName: \"kubernetes.io/projected/9d076d8c-06f7-48af-b54d-46b742537c9d-kube-api-access-q4wb9\") pod \"maas-api-e2e-api-b-d0511a-8657578495-mgpnq\" (UID: \"9d076d8c-06f7-48af-b54d-46b742537c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"
Jul 20 05:41:20.962809 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:20.962775    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4wb9\" (UniqueName: \"kubernetes.io/projected/9d076d8c-06f7-48af-b54d-46b742537c9d-kube-api-access-q4wb9\") pod \"maas-api-e2e-api-b-d0511a-8657578495-mgpnq\" (UID: \"9d076d8c-06f7-48af-b54d-46b742537c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"
Jul 20 05:41:20.962996 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:20.962845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d076d8c-06f7-48af-b54d-46b742537c9d-openshift-service-ca\") pod \"maas-api-e2e-api-b-d0511a-8657578495-mgpnq\" (UID: \"9d076d8c-06f7-48af-b54d-46b742537c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"
Jul 20 05:41:20.962996 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:20.962872    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d076d8c-06f7-48af-b54d-46b742537c9d-maas-api-tls\") pod \"maas-api-e2e-api-b-d0511a-8657578495-mgpnq\" (UID: \"9d076d8c-06f7-48af-b54d-46b742537c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"
Jul 20 05:41:20.963080 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:41:20.963001    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-serving-cert: secret "maas-api-e2e-api-b-d0511a-serving-cert" not found
Jul 20 05:41:20.963080 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:41:20.963048    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d076d8c-06f7-48af-b54d-46b742537c9d-maas-api-tls podName:9d076d8c-06f7-48af-b54d-46b742537c9d nodeName:}" failed. No retries permitted until 2026-07-20 05:41:21.463033514 +0000 UTC m=+2537.278527564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9d076d8c-06f7-48af-b54d-46b742537c9d-maas-api-tls") pod "maas-api-e2e-api-b-d0511a-8657578495-mgpnq" (UID: "9d076d8c-06f7-48af-b54d-46b742537c9d") : secret "maas-api-e2e-api-b-d0511a-serving-cert" not found
Jul 20 05:41:20.963518 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:20.963472    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d076d8c-06f7-48af-b54d-46b742537c9d-openshift-service-ca\") pod \"maas-api-e2e-api-b-d0511a-8657578495-mgpnq\" (UID: \"9d076d8c-06f7-48af-b54d-46b742537c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"
Jul 20 05:41:20.983420 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:20.983388    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4wb9\" (UniqueName: \"kubernetes.io/projected/9d076d8c-06f7-48af-b54d-46b742537c9d-kube-api-access-q4wb9\") pod \"maas-api-e2e-api-b-d0511a-8657578495-mgpnq\" (UID: \"9d076d8c-06f7-48af-b54d-46b742537c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"
Jul 20 05:41:21.413282 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:21.413204    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:21.466869 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:21.466832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d076d8c-06f7-48af-b54d-46b742537c9d-maas-api-tls\") pod \"maas-api-e2e-api-b-d0511a-8657578495-mgpnq\" (UID: \"9d076d8c-06f7-48af-b54d-46b742537c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"
Jul 20 05:41:21.469347 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:21.469327    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d076d8c-06f7-48af-b54d-46b742537c9d-maas-api-tls\") pod \"maas-api-e2e-api-b-d0511a-8657578495-mgpnq\" (UID: \"9d076d8c-06f7-48af-b54d-46b742537c9d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"
Jul 20 05:41:21.630290 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:21.630253    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"
Jul 20 05:41:21.761423 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:21.761390    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"]
Jul 20 05:41:21.764665 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:41:21.764643    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d076d8c_06f7_48af_b54d_46b742537c9d.slice/crio-f6990e1272de0200e595c1b468e07e73b1f8318917ebfd2c032a6730fc0d5ead WatchSource:0}: Error finding container f6990e1272de0200e595c1b468e07e73b1f8318917ebfd2c032a6730fc0d5ead: Status 404 returned error can't find the container with id f6990e1272de0200e595c1b468e07e73b1f8318917ebfd2c032a6730fc0d5ead
Jul 20 05:41:21.766500 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:21.766478    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 05:41:22.438781 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:22.438678    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq" event={"ID":"9d076d8c-06f7-48af-b54d-46b742537c9d","Type":"ContainerStarted","Data":"3a62739b0911e69e935e41b25b01d71bc517020d2bc3dceeecf80ee5d3b9723b"}
Jul 20 05:41:22.438781 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:22.438740    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq" event={"ID":"9d076d8c-06f7-48af-b54d-46b742537c9d","Type":"ContainerStarted","Data":"f6990e1272de0200e595c1b468e07e73b1f8318917ebfd2c032a6730fc0d5ead"}
Jul 20 05:41:22.438781 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:22.438770    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"
Jul 20 05:41:22.454892 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:22.454820    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq" podStartSLOduration=2.112655709 podStartE2EDuration="2.454799978s" totalImagesPullingTime="342.144269ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:41:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:41:22.454281193 +0000 UTC m=+2538.269775264" watchObservedRunningTime="2026-07-20 05:41:22.454799978 +0000 UTC m=+2538.270294050"
Jul 20 05:41:28.449801 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:28.449770    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"
Jul 20 05:41:48.834404 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:48.834370    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"]
Jul 20 05:41:48.834899 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:48.834642    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls" podUID="e28e78a5-2e2a-4b21-a216-ccd1a47d9f65" containerName="maas-api" containerID="cri-o://eebd156ecb026f4b0e2512c3982f5a35c71ea81e6f0f2c239a81c9b016f0f91e" gracePeriod=30
Jul 20 05:41:49.082299 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.082271    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:49.112033 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.111955    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-openshift-service-ca\") pod \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\" (UID: \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\") "
Jul 20 05:41:49.112033 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.112006    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-maas-api-tls\") pod \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\" (UID: \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\") "
Jul 20 05:41:49.112248 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.112068    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nklp\" (UniqueName: \"kubernetes.io/projected/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-kube-api-access-4nklp\") pod \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\" (UID: \"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65\") "
Jul 20 05:41:49.112310 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.112292    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e28e78a5-2e2a-4b21-a216-ccd1a47d9f65" (UID: "e28e78a5-2e2a-4b21-a216-ccd1a47d9f65"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:41:49.114315 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.114291    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e28e78a5-2e2a-4b21-a216-ccd1a47d9f65" (UID: "e28e78a5-2e2a-4b21-a216-ccd1a47d9f65"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:41:49.114315 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.114296    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-kube-api-access-4nklp" (OuterVolumeSpecName: "kube-api-access-4nklp") pod "e28e78a5-2e2a-4b21-a216-ccd1a47d9f65" (UID: "e28e78a5-2e2a-4b21-a216-ccd1a47d9f65"). InnerVolumeSpecName "kube-api-access-4nklp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:41:49.212974 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.212937    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-maas-api-tls\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:41:49.212974 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.212967    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nklp\" (UniqueName: \"kubernetes.io/projected/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-kube-api-access-4nklp\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:41:49.212974 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.212976    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65-openshift-service-ca\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:41:49.557555 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.557519    2576 generic.go:356] "Generic (PLEG): container finished" podID="e28e78a5-2e2a-4b21-a216-ccd1a47d9f65" containerID="eebd156ecb026f4b0e2512c3982f5a35c71ea81e6f0f2c239a81c9b016f0f91e" exitCode=0
Jul 20 05:41:49.557718 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.557567    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"
Jul 20 05:41:49.557718 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.557603    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls" event={"ID":"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65","Type":"ContainerDied","Data":"eebd156ecb026f4b0e2512c3982f5a35c71ea81e6f0f2c239a81c9b016f0f91e"}
Jul 20 05:41:49.557718 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.557652    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls" event={"ID":"e28e78a5-2e2a-4b21-a216-ccd1a47d9f65","Type":"ContainerDied","Data":"f272bafd08c4935802fca7e340eb70f99b3f492aab6d47c35882660ee21cf474"}
Jul 20 05:41:49.557718 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.557675    2576 scope.go:117] "RemoveContainer" containerID="eebd156ecb026f4b0e2512c3982f5a35c71ea81e6f0f2c239a81c9b016f0f91e"
Jul 20 05:41:49.566401 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.566387    2576 scope.go:117] "RemoveContainer" containerID="eebd156ecb026f4b0e2512c3982f5a35c71ea81e6f0f2c239a81c9b016f0f91e"
Jul 20 05:41:49.566645 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:41:49.566627    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eebd156ecb026f4b0e2512c3982f5a35c71ea81e6f0f2c239a81c9b016f0f91e\": container with ID starting with eebd156ecb026f4b0e2512c3982f5a35c71ea81e6f0f2c239a81c9b016f0f91e not found: ID does not exist" containerID="eebd156ecb026f4b0e2512c3982f5a35c71ea81e6f0f2c239a81c9b016f0f91e"
Jul 20 05:41:49.566697 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.566660    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebd156ecb026f4b0e2512c3982f5a35c71ea81e6f0f2c239a81c9b016f0f91e"} err="failed to get container status \"eebd156ecb026f4b0e2512c3982f5a35c71ea81e6f0f2c239a81c9b016f0f91e\": rpc error: code = NotFound desc = could not find container \"eebd156ecb026f4b0e2512c3982f5a35c71ea81e6f0f2c239a81c9b016f0f91e\": container with ID starting with eebd156ecb026f4b0e2512c3982f5a35c71ea81e6f0f2c239a81c9b016f0f91e not found: ID does not exist"
Jul 20 05:41:49.578034 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.577989    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"]
Jul 20 05:41:49.579671 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:49.579651    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ce4188-6c9c96bc55-wvgls"]
Jul 20 05:41:50.685732 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:41:50.685698    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e28e78a5-2e2a-4b21-a216-ccd1a47d9f65" path="/var/lib/kubelet/pods/e28e78a5-2e2a-4b21-a216-ccd1a47d9f65/volumes"
Jul 20 05:42:15.209724 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.209690    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"]
Jul 20 05:42:15.210308 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.209946    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq" podUID="9d076d8c-06f7-48af-b54d-46b742537c9d" containerName="maas-api" containerID="cri-o://3a62739b0911e69e935e41b25b01d71bc517020d2bc3dceeecf80ee5d3b9723b" gracePeriod=30
Jul 20 05:42:15.456552 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.456531    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"
Jul 20 05:42:15.547918 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.547814    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d076d8c-06f7-48af-b54d-46b742537c9d-openshift-service-ca\") pod \"9d076d8c-06f7-48af-b54d-46b742537c9d\" (UID: \"9d076d8c-06f7-48af-b54d-46b742537c9d\") "
Jul 20 05:42:15.548085 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.547922    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d076d8c-06f7-48af-b54d-46b742537c9d-maas-api-tls\") pod \"9d076d8c-06f7-48af-b54d-46b742537c9d\" (UID: \"9d076d8c-06f7-48af-b54d-46b742537c9d\") "
Jul 20 05:42:15.548085 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.547945    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4wb9\" (UniqueName: \"kubernetes.io/projected/9d076d8c-06f7-48af-b54d-46b742537c9d-kube-api-access-q4wb9\") pod \"9d076d8c-06f7-48af-b54d-46b742537c9d\" (UID: \"9d076d8c-06f7-48af-b54d-46b742537c9d\") "
Jul 20 05:42:15.548282 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.548256    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d076d8c-06f7-48af-b54d-46b742537c9d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9d076d8c-06f7-48af-b54d-46b742537c9d" (UID: "9d076d8c-06f7-48af-b54d-46b742537c9d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:42:15.550125 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.550098    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d076d8c-06f7-48af-b54d-46b742537c9d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9d076d8c-06f7-48af-b54d-46b742537c9d" (UID: "9d076d8c-06f7-48af-b54d-46b742537c9d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:42:15.550215 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.550163    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d076d8c-06f7-48af-b54d-46b742537c9d-kube-api-access-q4wb9" (OuterVolumeSpecName: "kube-api-access-q4wb9") pod "9d076d8c-06f7-48af-b54d-46b742537c9d" (UID: "9d076d8c-06f7-48af-b54d-46b742537c9d"). InnerVolumeSpecName "kube-api-access-q4wb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:42:15.648860 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.648833    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d076d8c-06f7-48af-b54d-46b742537c9d-openshift-service-ca\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:42:15.648860 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.648856    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d076d8c-06f7-48af-b54d-46b742537c9d-maas-api-tls\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:42:15.649018 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.648867    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4wb9\" (UniqueName: \"kubernetes.io/projected/9d076d8c-06f7-48af-b54d-46b742537c9d-kube-api-access-q4wb9\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:42:15.679699 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.679670    2576 generic.go:356] "Generic (PLEG): container finished" podID="9d076d8c-06f7-48af-b54d-46b742537c9d" containerID="3a62739b0911e69e935e41b25b01d71bc517020d2bc3dceeecf80ee5d3b9723b" exitCode=0
Jul 20 05:42:15.679792 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.679717    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq" event={"ID":"9d076d8c-06f7-48af-b54d-46b742537c9d","Type":"ContainerDied","Data":"3a62739b0911e69e935e41b25b01d71bc517020d2bc3dceeecf80ee5d3b9723b"}
Jul 20 05:42:15.679792 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.679723    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"
Jul 20 05:42:15.679792 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.679760    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq" event={"ID":"9d076d8c-06f7-48af-b54d-46b742537c9d","Type":"ContainerDied","Data":"f6990e1272de0200e595c1b468e07e73b1f8318917ebfd2c032a6730fc0d5ead"}
Jul 20 05:42:15.679792 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.679785    2576 scope.go:117] "RemoveContainer" containerID="3a62739b0911e69e935e41b25b01d71bc517020d2bc3dceeecf80ee5d3b9723b"
Jul 20 05:42:15.688755 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.688739    2576 scope.go:117] "RemoveContainer" containerID="3a62739b0911e69e935e41b25b01d71bc517020d2bc3dceeecf80ee5d3b9723b"
Jul 20 05:42:15.689045 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:42:15.689027    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a62739b0911e69e935e41b25b01d71bc517020d2bc3dceeecf80ee5d3b9723b\": container with ID starting with 3a62739b0911e69e935e41b25b01d71bc517020d2bc3dceeecf80ee5d3b9723b not found: ID does not exist" containerID="3a62739b0911e69e935e41b25b01d71bc517020d2bc3dceeecf80ee5d3b9723b"
Jul 20 05:42:15.689112 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.689054    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a62739b0911e69e935e41b25b01d71bc517020d2bc3dceeecf80ee5d3b9723b"} err="failed to get container status \"3a62739b0911e69e935e41b25b01d71bc517020d2bc3dceeecf80ee5d3b9723b\": rpc error: code = NotFound desc = could not find container \"3a62739b0911e69e935e41b25b01d71bc517020d2bc3dceeecf80ee5d3b9723b\": container with ID starting with 3a62739b0911e69e935e41b25b01d71bc517020d2bc3dceeecf80ee5d3b9723b not found: ID does not exist"
Jul 20 05:42:15.700335 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.700314    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"]
Jul 20 05:42:15.703495 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:15.703475    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-d0511a-8657578495-mgpnq"]
Jul 20 05:42:16.680020 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:16.679984    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d076d8c-06f7-48af-b54d-46b742537c9d" path="/var/lib/kubelet/pods/9d076d8c-06f7-48af-b54d-46b742537c9d/volumes"
Jul 20 05:42:29.904369 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:29.904330    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"]
Jul 20 05:42:29.904833 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:29.904812    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d076d8c-06f7-48af-b54d-46b742537c9d" containerName="maas-api"
Jul 20 05:42:29.904926 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:29.904837    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d076d8c-06f7-48af-b54d-46b742537c9d" containerName="maas-api"
Jul 20 05:42:29.904926 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:29.904852    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e28e78a5-2e2a-4b21-a216-ccd1a47d9f65" containerName="maas-api"
Jul 20 05:42:29.904926 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:29.904861    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e28e78a5-2e2a-4b21-a216-ccd1a47d9f65" containerName="maas-api"
Jul 20 05:42:29.905082 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:29.904991    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e28e78a5-2e2a-4b21-a216-ccd1a47d9f65" containerName="maas-api"
Jul 20 05:42:29.905082 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:29.905008    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d076d8c-06f7-48af-b54d-46b742537c9d" containerName="maas-api"
Jul 20 05:42:29.909227 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:29.909204    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"
Jul 20 05:42:29.911701 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:29.911675    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-851aef-serving-cert\""
Jul 20 05:42:29.918061 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:29.918024    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"]
Jul 20 05:42:30.074061 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:30.074027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9c09705-5596-4c27-98b7-00d64730e2c3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd\" (UID: \"a9c09705-5596-4c27-98b7-00d64730e2c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"
Jul 20 05:42:30.074294 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:30.074075    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9c09705-5596-4c27-98b7-00d64730e2c3-maas-api-tls\") pod \"maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd\" (UID: \"a9c09705-5596-4c27-98b7-00d64730e2c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"
Jul 20 05:42:30.074294 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:30.074157    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qpgm\" (UniqueName: \"kubernetes.io/projected/a9c09705-5596-4c27-98b7-00d64730e2c3-kube-api-access-7qpgm\") pod \"maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd\" (UID: \"a9c09705-5596-4c27-98b7-00d64730e2c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"
Jul 20 05:42:30.174638 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:30.174549    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qpgm\" (UniqueName: \"kubernetes.io/projected/a9c09705-5596-4c27-98b7-00d64730e2c3-kube-api-access-7qpgm\") pod \"maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd\" (UID: \"a9c09705-5596-4c27-98b7-00d64730e2c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"
Jul 20 05:42:30.174638 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:30.174628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9c09705-5596-4c27-98b7-00d64730e2c3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd\" (UID: \"a9c09705-5596-4c27-98b7-00d64730e2c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"
Jul 20 05:42:30.174821 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:30.174657    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9c09705-5596-4c27-98b7-00d64730e2c3-maas-api-tls\") pod \"maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd\" (UID: \"a9c09705-5596-4c27-98b7-00d64730e2c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"
Jul 20 05:42:30.174821 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:42:30.174760    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-serving-cert: secret "maas-api-e2e-shared-a-851aef-serving-cert" not found
Jul 20 05:42:30.174821 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:42:30.174821    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c09705-5596-4c27-98b7-00d64730e2c3-maas-api-tls podName:a9c09705-5596-4c27-98b7-00d64730e2c3 nodeName:}" failed. No retries permitted until 2026-07-20 05:42:30.674804425 +0000 UTC m=+2606.490298477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a9c09705-5596-4c27-98b7-00d64730e2c3-maas-api-tls") pod "maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd" (UID: "a9c09705-5596-4c27-98b7-00d64730e2c3") : secret "maas-api-e2e-shared-a-851aef-serving-cert" not found
Jul 20 05:42:30.175250 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:30.175232    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9c09705-5596-4c27-98b7-00d64730e2c3-openshift-service-ca\") pod \"maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd\" (UID: \"a9c09705-5596-4c27-98b7-00d64730e2c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"
Jul 20 05:42:30.199848 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:30.199819    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qpgm\" (UniqueName: \"kubernetes.io/projected/a9c09705-5596-4c27-98b7-00d64730e2c3-kube-api-access-7qpgm\") pod \"maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd\" (UID: \"a9c09705-5596-4c27-98b7-00d64730e2c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"
Jul 20 05:42:30.679508 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:30.679479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9c09705-5596-4c27-98b7-00d64730e2c3-maas-api-tls\") pod \"maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd\" (UID: \"a9c09705-5596-4c27-98b7-00d64730e2c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"
Jul 20 05:42:30.682076 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:30.682045    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9c09705-5596-4c27-98b7-00d64730e2c3-maas-api-tls\") pod \"maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd\" (UID: \"a9c09705-5596-4c27-98b7-00d64730e2c3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"
Jul 20 05:42:30.820505 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:30.820453    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"
Jul 20 05:42:30.950340 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:30.950315    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"]
Jul 20 05:42:30.952162 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:42:30.952127    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c09705_5596_4c27_98b7_00d64730e2c3.slice/crio-d2956ae24be31a49870463131b68cbcccbedd47dfedac26f405afb5b0334272a WatchSource:0}: Error finding container d2956ae24be31a49870463131b68cbcccbedd47dfedac26f405afb5b0334272a: Status 404 returned error can't find the container with id d2956ae24be31a49870463131b68cbcccbedd47dfedac26f405afb5b0334272a
Jul 20 05:42:31.748358 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:31.748321    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd" event={"ID":"a9c09705-5596-4c27-98b7-00d64730e2c3","Type":"ContainerStarted","Data":"46bbacc1a1dc8f4c6959fee01084ef38273864c953df7b5b707f06d228f46cb1"}
Jul 20 05:42:31.748554 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:31.748372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd" event={"ID":"a9c09705-5596-4c27-98b7-00d64730e2c3","Type":"ContainerStarted","Data":"d2956ae24be31a49870463131b68cbcccbedd47dfedac26f405afb5b0334272a"}
Jul 20 05:42:31.748554 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:31.748400    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"
Jul 20 05:42:31.766532 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:31.766481    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd" podStartSLOduration=2.42235868 podStartE2EDuration="2.766464666s" totalImagesPullingTime="344.105986ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:42:31.764051249 +0000 UTC m=+2607.579545324" watchObservedRunningTime="2026-07-20 05:42:31.766464666 +0000 UTC m=+2607.581958772"
Jul 20 05:42:37.758285 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:37.758252    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"
Jul 20 05:42:38.009653 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:38.009563    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"]
Jul 20 05:42:38.013327 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:38.013305    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"
Jul 20 05:42:38.016074 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:38.016054    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-82cedd-serving-cert\""
Jul 20 05:42:38.030479 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:38.030449    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"]
Jul 20 05:42:38.042335 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:38.042300    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf4df766-c37f-4697-8a37-69a0c30793f5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m\" (UID: \"cf4df766-c37f-4697-8a37-69a0c30793f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"
Jul 20 05:42:38.042448 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:38.042338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v46f6\" (UniqueName: \"kubernetes.io/projected/cf4df766-c37f-4697-8a37-69a0c30793f5-kube-api-access-v46f6\") pod \"maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m\" (UID: \"cf4df766-c37f-4697-8a37-69a0c30793f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"
Jul 20 05:42:38.042448 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:38.042369    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf4df766-c37f-4697-8a37-69a0c30793f5-maas-api-tls\") pod \"maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m\" (UID: \"cf4df766-c37f-4697-8a37-69a0c30793f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"
Jul 20 05:42:38.142840 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:38.142809    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf4df766-c37f-4697-8a37-69a0c30793f5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m\" (UID: \"cf4df766-c37f-4697-8a37-69a0c30793f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"
Jul 20 05:42:38.142840 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:38.142839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v46f6\" (UniqueName: \"kubernetes.io/projected/cf4df766-c37f-4697-8a37-69a0c30793f5-kube-api-access-v46f6\") pod \"maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m\" (UID: \"cf4df766-c37f-4697-8a37-69a0c30793f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"
Jul 20 05:42:38.143060 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:38.142861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf4df766-c37f-4697-8a37-69a0c30793f5-maas-api-tls\") pod \"maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m\" (UID: \"cf4df766-c37f-4697-8a37-69a0c30793f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"
Jul 20 05:42:38.143060 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:42:38.143014    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-serving-cert: secret "maas-api-e2e-shared-b-82cedd-serving-cert" not found
Jul 20 05:42:38.143144 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:42:38.143076    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf4df766-c37f-4697-8a37-69a0c30793f5-maas-api-tls podName:cf4df766-c37f-4697-8a37-69a0c30793f5 nodeName:}" failed. No retries permitted until 2026-07-20 05:42:38.643060495 +0000 UTC m=+2614.458554546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cf4df766-c37f-4697-8a37-69a0c30793f5-maas-api-tls") pod "maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m" (UID: "cf4df766-c37f-4697-8a37-69a0c30793f5") : secret "maas-api-e2e-shared-b-82cedd-serving-cert" not found
Jul 20 05:42:38.143450 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:38.143431    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf4df766-c37f-4697-8a37-69a0c30793f5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m\" (UID: \"cf4df766-c37f-4697-8a37-69a0c30793f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"
Jul 20 05:42:38.154815 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:38.154786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v46f6\" (UniqueName: \"kubernetes.io/projected/cf4df766-c37f-4697-8a37-69a0c30793f5-kube-api-access-v46f6\") pod \"maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m\" (UID: \"cf4df766-c37f-4697-8a37-69a0c30793f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"
Jul 20 05:42:38.646983 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:38.646952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf4df766-c37f-4697-8a37-69a0c30793f5-maas-api-tls\") pod \"maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m\" (UID: \"cf4df766-c37f-4697-8a37-69a0c30793f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"
Jul 20 05:42:38.649510 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:38.649490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf4df766-c37f-4697-8a37-69a0c30793f5-maas-api-tls\") pod \"maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m\" (UID: \"cf4df766-c37f-4697-8a37-69a0c30793f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"
Jul 20 05:42:38.924629 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:38.924552    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"
Jul 20 05:42:39.057331 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:39.057306    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"]
Jul 20 05:42:39.059482 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:42:39.059454    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4df766_c37f_4697_8a37_69a0c30793f5.slice/crio-d45a12dace0b0420f525c7b65acf3c8961d4ded4e46a15d4be77565ed1acfa42 WatchSource:0}: Error finding container d45a12dace0b0420f525c7b65acf3c8961d4ded4e46a15d4be77565ed1acfa42: Status 404 returned error can't find the container with id d45a12dace0b0420f525c7b65acf3c8961d4ded4e46a15d4be77565ed1acfa42
Jul 20 05:42:39.789841 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:39.789737    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m" event={"ID":"cf4df766-c37f-4697-8a37-69a0c30793f5","Type":"ContainerStarted","Data":"384be7696fbc0f62961ba7297c469bf45ba959d568dc71693b89bd933a907a6c"}
Jul 20 05:42:39.789841 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:39.789798    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m" event={"ID":"cf4df766-c37f-4697-8a37-69a0c30793f5","Type":"ContainerStarted","Data":"d45a12dace0b0420f525c7b65acf3c8961d4ded4e46a15d4be77565ed1acfa42"}
Jul 20 05:42:39.790079 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:39.789909    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"
Jul 20 05:42:39.806222 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:39.806174    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m" podStartSLOduration=2.388755157 podStartE2EDuration="2.806155865s" totalImagesPullingTime="417.400708ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:42:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:42:39.805642245 +0000 UTC m=+2615.621136315" watchObservedRunningTime="2026-07-20 05:42:39.806155865 +0000 UTC m=+2615.621649937"
Jul 20 05:42:45.800840 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:45.800804    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"
Jul 20 05:42:54.615059 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.615025    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"]
Jul 20 05:42:54.618638 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.618621    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.621302 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.621280    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-851aef\"/\"kube-root-ca.crt\""
Jul 20 05:42:54.622395 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.622375    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-851aef\"/\"default-dockercfg-2k5b6\""
Jul 20 05:42:54.622527 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.622378    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-851aef\"/\"auth-test-model-851aef-kserve-self-signed-certs\""
Jul 20 05:42:54.622527 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.622418    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-851aef\"/\"openshift-service-ca.crt\""
Jul 20 05:42:54.628000 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.627980    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"]
Jul 20 05:42:54.693831 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.693798    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5kgt\" (UniqueName: \"kubernetes.io/projected/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-kube-api-access-t5kgt\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.694031 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.693838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-tls-certs\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.694031 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.693926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-dshm\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.694031 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.693971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-model-cache\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.694031 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.694011    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-home\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.694200 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.694083    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-tmp-dir\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.795165 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.795133    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5kgt\" (UniqueName: \"kubernetes.io/projected/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-kube-api-access-t5kgt\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.795165 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.795170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-tls-certs\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.795406 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.795357    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-dshm\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.795406 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.795401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-model-cache\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.795520 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.795445    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-home\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.795520 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.795486    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-tmp-dir\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.795820 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.795796    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-model-cache\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.795820 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.795815    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-tmp-dir\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.795958 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.795855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-home\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.797818 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.797801    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-dshm\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.798124 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.798101    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-tls-certs\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.802778 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.802753    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5kgt\" (UniqueName: \"kubernetes.io/projected/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-kube-api-access-t5kgt\") pod \"auth-test-model-851aef-kserve-67df98f979-qxp8x\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") " pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:54.929419 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:54.929330    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:42:55.062945 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:55.062921    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"]
Jul 20 05:42:55.064770 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:42:55.064742    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b05d30a_8cbb_4904_91b1_fed38f8f4f6d.slice/crio-a63e22f1319099505dd334ac5396210951da13bfa607ec5e411603454b6ee6a5 WatchSource:0}: Error finding container a63e22f1319099505dd334ac5396210951da13bfa607ec5e411603454b6ee6a5: Status 404 returned error can't find the container with id a63e22f1319099505dd334ac5396210951da13bfa607ec5e411603454b6ee6a5
Jul 20 05:42:55.867637 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:55.867605    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x" event={"ID":"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d","Type":"ContainerStarted","Data":"4720da3544361b5bc2de02abd3b5e99955e83e8ffbda95b7359f12e09fb80471"}
Jul 20 05:42:55.867637 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:55.867644    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x" event={"ID":"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d","Type":"ContainerStarted","Data":"a63e22f1319099505dd334ac5396210951da13bfa607ec5e411603454b6ee6a5"}
Jul 20 05:42:55.884419 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:42:55.884361    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x" podStartSLOduration=1.884343376 podStartE2EDuration="1.884343376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:42:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:42:55.882757731 +0000 UTC m=+2631.698251803" watchObservedRunningTime="2026-07-20 05:42:55.884343376 +0000 UTC m=+2631.699837448"
Jul 20 05:43:04.930293 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:04.930265    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:43:04.930573 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:04.930318    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:43:04.943004 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:04.942982    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:43:05.923131 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:05.923093    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:43:23.827274 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.827239    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"]
Jul 20 05:43:23.830870 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.830845    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.834499 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.834467    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-82cedd\"/\"default-dockercfg-cbjxn\""
Jul 20 05:43:23.834499 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.834469    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-82cedd\"/\"auth-test-model-82cedd-kserve-self-signed-certs\""
Jul 20 05:43:23.834723 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.834494    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-82cedd\"/\"openshift-service-ca.crt\""
Jul 20 05:43:23.834723 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.834536    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-82cedd\"/\"kube-root-ca.crt\""
Jul 20 05:43:23.841181 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.841156    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"]
Jul 20 05:43:23.852520 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.852498    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-model-cache\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.852623 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.852536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-dshm\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.852623 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.852564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-tmp-dir\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.852697 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.852666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k69v7\" (UniqueName: \"kubernetes.io/projected/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-kube-api-access-k69v7\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.852737 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.852712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-tls-certs\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.852804 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.852787    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-home\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.953369 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.953341    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-model-cache\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.953520 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.953376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-dshm\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.953520 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.953393    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-tmp-dir\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.953520 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.953430    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k69v7\" (UniqueName: \"kubernetes.io/projected/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-kube-api-access-k69v7\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.953520 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.953453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-tls-certs\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.953520 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.953484    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-home\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.953768 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.953735    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-model-cache\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.953841 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.953796    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-tmp-dir\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.953913 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.953863    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-home\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.955840 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.955815    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-dshm\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.955968 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.955935    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-tls-certs\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:23.961947 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:23.961924    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k69v7\" (UniqueName: \"kubernetes.io/projected/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-kube-api-access-k69v7\") pod \"auth-test-model-82cedd-kserve-dc7bcd875-svcnd\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") " pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:24.142305 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:24.142228    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:24.276315 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:24.276289    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"]
Jul 20 05:43:24.278252 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:43:24.278217    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ff9590c_9531_4bb4_9ae3_5e4c9cb7e1d1.slice/crio-b9cf5a953ec1a0bb9e2bdddd22bfbf3cc2ddf3f10f894a64866cf1e153a1ad7c WatchSource:0}: Error finding container b9cf5a953ec1a0bb9e2bdddd22bfbf3cc2ddf3f10f894a64866cf1e153a1ad7c: Status 404 returned error can't find the container with id b9cf5a953ec1a0bb9e2bdddd22bfbf3cc2ddf3f10f894a64866cf1e153a1ad7c
Jul 20 05:43:24.998181 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:24.998150    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd" event={"ID":"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1","Type":"ContainerStarted","Data":"928c6b5240af9d7b2287294365ade6419b000c242f165f044fd02f671857b391"}
Jul 20 05:43:24.998573 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:24.998189    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd" event={"ID":"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1","Type":"ContainerStarted","Data":"b9cf5a953ec1a0bb9e2bdddd22bfbf3cc2ddf3f10f894a64866cf1e153a1ad7c"}
Jul 20 05:43:25.017894 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:25.017825    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd" podStartSLOduration=2.017809515 podStartE2EDuration="2.017809515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:43:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:43:25.016846979 +0000 UTC m=+2660.832341051" watchObservedRunningTime="2026-07-20 05:43:25.017809515 +0000 UTC m=+2660.833303586"
Jul 20 05:43:34.142830 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:34.142794    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:34.142830 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:34.142833    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:34.155314 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:34.155285    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:43:35.057005 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:43:35.056975    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:45:30.712089 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:30.712050    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"]
Jul 20 05:45:31.598547 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:31.598516    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"]
Jul 20 05:45:45.732592 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:45.732527    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x" podUID="5b05d30a-8cbb-4904-91b1-fed38f8f4f6d" containerName="main" containerID="cri-o://4720da3544361b5bc2de02abd3b5e99955e83e8ffbda95b7359f12e09fb80471" gracePeriod=45
Jul 20 05:45:45.983091 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:45.983031    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:45:46.029072 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.029047    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-tls-certs\") pod \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") "
Jul 20 05:45:46.029250 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.029090    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-dshm\") pod \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") "
Jul 20 05:45:46.029250 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.029115    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-model-cache\") pod \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") "
Jul 20 05:45:46.029250 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.029132    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-tmp-dir\") pod \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") "
Jul 20 05:45:46.029250 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.029206    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-home\") pod \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") "
Jul 20 05:45:46.029468 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.029268    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5kgt\" (UniqueName: \"kubernetes.io/projected/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-kube-api-access-t5kgt\") pod \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\" (UID: \"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d\") "
Jul 20 05:45:46.029468 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.029391    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5b05d30a-8cbb-4904-91b1-fed38f8f4f6d" (UID: "5b05d30a-8cbb-4904-91b1-fed38f8f4f6d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:45:46.029468 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.029406    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-model-cache" (OuterVolumeSpecName: "model-cache") pod "5b05d30a-8cbb-4904-91b1-fed38f8f4f6d" (UID: "5b05d30a-8cbb-4904-91b1-fed38f8f4f6d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:45:46.029468 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.029432    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-home" (OuterVolumeSpecName: "home") pod "5b05d30a-8cbb-4904-91b1-fed38f8f4f6d" (UID: "5b05d30a-8cbb-4904-91b1-fed38f8f4f6d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:45:46.029680 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.029572    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-model-cache\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:45:46.029680 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.029585    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-tmp-dir\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:45:46.029680 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.029592    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-home\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:45:46.031474 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.031442    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-dshm" (OuterVolumeSpecName: "dshm") pod "5b05d30a-8cbb-4904-91b1-fed38f8f4f6d" (UID: "5b05d30a-8cbb-4904-91b1-fed38f8f4f6d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:45:46.031474 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.031444    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5b05d30a-8cbb-4904-91b1-fed38f8f4f6d" (UID: "5b05d30a-8cbb-4904-91b1-fed38f8f4f6d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:45:46.031614 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.031497    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-kube-api-access-t5kgt" (OuterVolumeSpecName: "kube-api-access-t5kgt") pod "5b05d30a-8cbb-4904-91b1-fed38f8f4f6d" (UID: "5b05d30a-8cbb-4904-91b1-fed38f8f4f6d"). InnerVolumeSpecName "kube-api-access-t5kgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:45:46.130213 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.130177    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-tls-certs\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:45:46.130213 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.130206    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-dshm\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:45:46.130213 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.130215    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5kgt\" (UniqueName: \"kubernetes.io/projected/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d-kube-api-access-t5kgt\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:45:46.619260 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.619191    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd" podUID="9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1" containerName="main" containerID="cri-o://928c6b5240af9d7b2287294365ade6419b000c242f165f044fd02f671857b391" gracePeriod=45
Jul 20 05:45:46.677726 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.677696    2576 generic.go:356] "Generic (PLEG): container finished" podID="5b05d30a-8cbb-4904-91b1-fed38f8f4f6d" containerID="4720da3544361b5bc2de02abd3b5e99955e83e8ffbda95b7359f12e09fb80471" exitCode=0
Jul 20 05:45:46.677896 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.677824    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"
Jul 20 05:45:46.681209 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.681182    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x" event={"ID":"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d","Type":"ContainerDied","Data":"4720da3544361b5bc2de02abd3b5e99955e83e8ffbda95b7359f12e09fb80471"}
Jul 20 05:45:46.681361 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.681217    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x" event={"ID":"5b05d30a-8cbb-4904-91b1-fed38f8f4f6d","Type":"ContainerDied","Data":"a63e22f1319099505dd334ac5396210951da13bfa607ec5e411603454b6ee6a5"}
Jul 20 05:45:46.681361 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.681234    2576 scope.go:117] "RemoveContainer" containerID="4720da3544361b5bc2de02abd3b5e99955e83e8ffbda95b7359f12e09fb80471"
Jul 20 05:45:46.698997 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.698971    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"]
Jul 20 05:45:46.702366 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.702342    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x"]
Jul 20 05:45:46.731715 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.731692    2576 scope.go:117] "RemoveContainer" containerID="4720da3544361b5bc2de02abd3b5e99955e83e8ffbda95b7359f12e09fb80471"
Jul 20 05:45:46.732045 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:45:46.732028    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4720da3544361b5bc2de02abd3b5e99955e83e8ffbda95b7359f12e09fb80471\": container with ID starting with 4720da3544361b5bc2de02abd3b5e99955e83e8ffbda95b7359f12e09fb80471 not found: ID does not exist" containerID="4720da3544361b5bc2de02abd3b5e99955e83e8ffbda95b7359f12e09fb80471"
Jul 20 05:45:46.732102 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.732054    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4720da3544361b5bc2de02abd3b5e99955e83e8ffbda95b7359f12e09fb80471"} err="failed to get container status \"4720da3544361b5bc2de02abd3b5e99955e83e8ffbda95b7359f12e09fb80471\": rpc error: code = NotFound desc = could not find container \"4720da3544361b5bc2de02abd3b5e99955e83e8ffbda95b7359f12e09fb80471\": container with ID starting with 4720da3544361b5bc2de02abd3b5e99955e83e8ffbda95b7359f12e09fb80471 not found: ID does not exist"
Jul 20 05:45:46.865479 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.865454    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:45:46.937903 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.937817    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-dshm\") pod \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") "
Jul 20 05:45:46.937903 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.937855    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-home\") pod \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") "
Jul 20 05:45:46.937903 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.937899    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-tls-certs\") pod \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") "
Jul 20 05:45:46.938114 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.937940    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-tmp-dir\") pod \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") "
Jul 20 05:45:46.938114 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.937979    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k69v7\" (UniqueName: \"kubernetes.io/projected/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-kube-api-access-k69v7\") pod \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") "
Jul 20 05:45:46.938114 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.938012    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-model-cache\") pod \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\" (UID: \"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1\") "
Jul 20 05:45:46.938276 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.938139    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-home" (OuterVolumeSpecName: "home") pod "9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1" (UID: "9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:45:46.938276 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.938217    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1" (UID: "9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:45:46.938374 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.938301    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-home\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:45:46.938374 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.938314    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-tmp-dir\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:45:46.938374 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.938331    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1" (UID: "9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:45:46.940308 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.940285    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-dshm" (OuterVolumeSpecName: "dshm") pod "9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1" (UID: "9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:45:46.940409 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.940302    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1" (UID: "9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:45:46.940409 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:46.940290    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-kube-api-access-k69v7" (OuterVolumeSpecName: "kube-api-access-k69v7") pod "9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1" (UID: "9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1"). InnerVolumeSpecName "kube-api-access-k69v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:45:47.039497 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.039469    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k69v7\" (UniqueName: \"kubernetes.io/projected/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-kube-api-access-k69v7\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:45:47.039497 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.039494    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-model-cache\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:45:47.039677 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.039512    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-dshm\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:45:47.039677 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.039521    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1-tls-certs\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:45:47.625675 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.625637    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"]
Jul 20 05:45:47.626153 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.626132    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b05d30a-8cbb-4904-91b1-fed38f8f4f6d" containerName="main"
Jul 20 05:45:47.626208 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.626158    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b05d30a-8cbb-4904-91b1-fed38f8f4f6d" containerName="main"
Jul 20 05:45:47.626208 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.626172    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1" containerName="main"
Jul 20 05:45:47.626208 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.626180    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1" containerName="main"
Jul 20 05:45:47.626303 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.626279    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1" containerName="main"
Jul 20 05:45:47.626303 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.626293    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b05d30a-8cbb-4904-91b1-fed38f8f4f6d" containerName="main"
Jul 20 05:45:47.629388 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.629371    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.633058 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.633034    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-851aef\"/\"sub-test-model-851aef-kserve-self-signed-certs\""
Jul 20 05:45:47.633157 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.633078    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-851aef\"/\"openshift-service-ca.crt\""
Jul 20 05:45:47.633157 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.633078    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-851aef\"/\"kube-root-ca.crt\""
Jul 20 05:45:47.633157 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.633081    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-851aef\"/\"default-dockercfg-2k5b6\""
Jul 20 05:45:47.637342 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.637322    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"]
Jul 20 05:45:47.645753 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.645731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-home\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.645849 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.645766    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-tls-certs\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.645849 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.645836    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-tmp-dir\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.646010 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.645988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-model-cache\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.646057 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.646027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7fqb\" (UniqueName: \"kubernetes.io/projected/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-kube-api-access-w7fqb\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.646105 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.646086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-dshm\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.686534 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.686499    2576 generic.go:356] "Generic (PLEG): container finished" podID="9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1" containerID="928c6b5240af9d7b2287294365ade6419b000c242f165f044fd02f671857b391" exitCode=0
Jul 20 05:45:47.686675 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.686546    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"
Jul 20 05:45:47.686675 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.686571    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd" event={"ID":"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1","Type":"ContainerDied","Data":"928c6b5240af9d7b2287294365ade6419b000c242f165f044fd02f671857b391"}
Jul 20 05:45:47.686675 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.686604    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd" event={"ID":"9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1","Type":"ContainerDied","Data":"b9cf5a953ec1a0bb9e2bdddd22bfbf3cc2ddf3f10f894a64866cf1e153a1ad7c"}
Jul 20 05:45:47.686675 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.686626    2576 scope.go:117] "RemoveContainer" containerID="928c6b5240af9d7b2287294365ade6419b000c242f165f044fd02f671857b391"
Jul 20 05:45:47.695392 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.695376    2576 scope.go:117] "RemoveContainer" containerID="928c6b5240af9d7b2287294365ade6419b000c242f165f044fd02f671857b391"
Jul 20 05:45:47.695676 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:45:47.695656    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"928c6b5240af9d7b2287294365ade6419b000c242f165f044fd02f671857b391\": container with ID starting with 928c6b5240af9d7b2287294365ade6419b000c242f165f044fd02f671857b391 not found: ID does not exist" containerID="928c6b5240af9d7b2287294365ade6419b000c242f165f044fd02f671857b391"
Jul 20 05:45:47.695722 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.695684    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"928c6b5240af9d7b2287294365ade6419b000c242f165f044fd02f671857b391"} err="failed to get container status \"928c6b5240af9d7b2287294365ade6419b000c242f165f044fd02f671857b391\": rpc error: code = NotFound desc = could not find container \"928c6b5240af9d7b2287294365ade6419b000c242f165f044fd02f671857b391\": container with ID starting with 928c6b5240af9d7b2287294365ade6419b000c242f165f044fd02f671857b391 not found: ID does not exist"
Jul 20 05:45:47.709802 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.709772    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"]
Jul 20 05:45:47.712176 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.712152    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/auth-test-model-82cedd-kserve-dc7bcd875-svcnd"]
Jul 20 05:45:47.746858 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.746832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-model-cache\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.746997 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.746861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7fqb\" (UniqueName: \"kubernetes.io/projected/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-kube-api-access-w7fqb\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.746997 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.746923    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-dshm\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.746997 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.746958    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-home\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.746997 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.746982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-tls-certs\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.747200 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.747028    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-tmp-dir\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.747263 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.747206    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-model-cache\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.747355 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.747337    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-home\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.747402 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.747377    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-tmp-dir\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.749238 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.749219    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-dshm\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.749494 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.749477    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-tls-certs\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.754740 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.754718    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7fqb\" (UniqueName: \"kubernetes.io/projected/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-kube-api-access-w7fqb\") pod \"sub-test-model-851aef-kserve-58c7fb7499-6rq2d\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") " pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:47.938979 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:47.938874    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:48.068893 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:48.068854    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"]
Jul 20 05:45:48.070841 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:45:48.070812    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5d221f4_b0ed_41f8_9b4b_12cdf4e30cb0.slice/crio-efc96e677eca1d192b0b0ed675bf81b73af601a045c71d27c0d68753c4caf476 WatchSource:0}: Error finding container efc96e677eca1d192b0b0ed675bf81b73af601a045c71d27c0d68753c4caf476: Status 404 returned error can't find the container with id efc96e677eca1d192b0b0ed675bf81b73af601a045c71d27c0d68753c4caf476
Jul 20 05:45:48.682832 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:48.682791    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b05d30a-8cbb-4904-91b1-fed38f8f4f6d" path="/var/lib/kubelet/pods/5b05d30a-8cbb-4904-91b1-fed38f8f4f6d/volumes"
Jul 20 05:45:48.683655 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:48.683629    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1" path="/var/lib/kubelet/pods/9ff9590c-9531-4bb4-9ae3-5e4c9cb7e1d1/volumes"
Jul 20 05:45:48.693203 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:48.693176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d" event={"ID":"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0","Type":"ContainerStarted","Data":"6770f43c773b6af9886e91804cfbae19f4e2f109e86710ac6c9e938974feb490"}
Jul 20 05:45:48.693308 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:48.693211    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d" event={"ID":"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0","Type":"ContainerStarted","Data":"efc96e677eca1d192b0b0ed675bf81b73af601a045c71d27c0d68753c4caf476"}
Jul 20 05:45:48.710481 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:48.710434    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d" podStartSLOduration=1.710416499 podStartE2EDuration="1.710416499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:45:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:45:48.71025261 +0000 UTC m=+2804.525746683" watchObservedRunningTime="2026-07-20 05:45:48.710416499 +0000 UTC m=+2804.525910574"
Jul 20 05:45:50.912797 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:50.912741    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-851aef/auth-test-model-851aef-kserve-67df98f979-qxp8x" podUID="5b05d30a-8cbb-4904-91b1-fed38f8f4f6d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.50:8000/ready\": context deadline exceeded"
Jul 20 05:45:57.939523 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:57.939473    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:57.940078 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:57.939566    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:57.952030 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:57.952006    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:45:58.749107 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:45:58.749078    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:46:30.030025 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.029990    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"]
Jul 20 05:46:30.033158 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.033140    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.036831 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.036807    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-82cedd\"/\"default-dockercfg-cbjxn\""
Jul 20 05:46:30.036979 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.036857    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-82cedd\"/\"openshift-service-ca.crt\""
Jul 20 05:46:30.036979 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.036857    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-82cedd\"/\"kube-root-ca.crt\""
Jul 20 05:46:30.036979 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.036870    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-82cedd\"/\"sub-test-model-82cedd-kserve-self-signed-certs\""
Jul 20 05:46:30.041173 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.041151    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"]
Jul 20 05:46:30.129634 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.129604    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-home\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.129812 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.129646    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-model-cache\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.129812 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.129666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33a55197-48e0-4a96-a24d-509eccfff337-tls-certs\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.129812 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.129780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-dshm\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.129973 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.129813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-tmp-dir\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.129973 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.129840    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctd5n\" (UniqueName: \"kubernetes.io/projected/33a55197-48e0-4a96-a24d-509eccfff337-kube-api-access-ctd5n\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.230592 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.230558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-tmp-dir\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.230763 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.230598    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctd5n\" (UniqueName: \"kubernetes.io/projected/33a55197-48e0-4a96-a24d-509eccfff337-kube-api-access-ctd5n\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.230763 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.230641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-home\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.230763 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.230676    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-model-cache\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.230763 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.230703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33a55197-48e0-4a96-a24d-509eccfff337-tls-certs\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.231014 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.230814    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-dshm\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.231086 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.231064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-tmp-dir\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.231146 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.231075    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-home\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.231146 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.231121    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-model-cache\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.233246 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.233214    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-dshm\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.233378 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.233362    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33a55197-48e0-4a96-a24d-509eccfff337-tls-certs\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.238815 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.238797    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctd5n\" (UniqueName: \"kubernetes.io/projected/33a55197-48e0-4a96-a24d-509eccfff337-kube-api-access-ctd5n\") pod \"sub-test-model-82cedd-kserve-6c8d88d64c-qxscq\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") " pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.343995 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.343893    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:30.474710 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.474684    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"]
Jul 20 05:46:30.476430 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:46:30.476401    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33a55197_48e0_4a96_a24d_509eccfff337.slice/crio-2b00f8d8a2707c175a8faaa01c3cfffba4c92e6a0484266ba464eb1b54a1ca71 WatchSource:0}: Error finding container 2b00f8d8a2707c175a8faaa01c3cfffba4c92e6a0484266ba464eb1b54a1ca71: Status 404 returned error can't find the container with id 2b00f8d8a2707c175a8faaa01c3cfffba4c92e6a0484266ba464eb1b54a1ca71
Jul 20 05:46:30.882020 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.881982    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq" event={"ID":"33a55197-48e0-4a96-a24d-509eccfff337","Type":"ContainerStarted","Data":"baf8326057bcf308dfe08fa2477cbf034a15e42c722202294eef78a74d3b9871"}
Jul 20 05:46:30.882188 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.882029    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq" event={"ID":"33a55197-48e0-4a96-a24d-509eccfff337","Type":"ContainerStarted","Data":"2b00f8d8a2707c175a8faaa01c3cfffba4c92e6a0484266ba464eb1b54a1ca71"}
Jul 20 05:46:30.901780 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:30.901729    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq" podStartSLOduration=0.901714189 podStartE2EDuration="901.714189ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:46:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:46:30.899179495 +0000 UTC m=+2846.714673568" watchObservedRunningTime="2026-07-20 05:46:30.901714189 +0000 UTC m=+2846.717208261"
Jul 20 05:46:40.345097 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:40.345063    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:40.345548 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:40.345114    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:40.358091 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:40.358063    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:46:40.937904 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:46:40.937862    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:47:06.160519 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:06.160443    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"]
Jul 20 05:47:07.211312 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:07.211282    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"]
Jul 20 05:47:21.180916 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.180830    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d" podUID="d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0" containerName="main" containerID="cri-o://6770f43c773b6af9886e91804cfbae19f4e2f109e86710ac6c9e938974feb490" gracePeriod=45
Jul 20 05:47:21.435784 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.435725    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:47:21.589785 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.589735    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-dshm\") pod \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") "
Jul 20 05:47:21.589785 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.589794    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-tls-certs\") pod \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") "
Jul 20 05:47:21.590058 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.589814    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-tmp-dir\") pod \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") "
Jul 20 05:47:21.590058 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.589840    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7fqb\" (UniqueName: \"kubernetes.io/projected/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-kube-api-access-w7fqb\") pod \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") "
Jul 20 05:47:21.590058 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.589875    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-home\") pod \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") "
Jul 20 05:47:21.590058 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.589925    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-model-cache\") pod \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\" (UID: \"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0\") "
Jul 20 05:47:21.590283 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.590105    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0" (UID: "d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:47:21.590283 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.590220    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-home" (OuterVolumeSpecName: "home") pod "d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0" (UID: "d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:47:21.590283 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.590245    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-model-cache" (OuterVolumeSpecName: "model-cache") pod "d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0" (UID: "d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:47:21.590448 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.590283    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-tmp-dir\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:47:21.592134 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.592108    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-dshm" (OuterVolumeSpecName: "dshm") pod "d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0" (UID: "d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:47:21.592240 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.592196    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-kube-api-access-w7fqb" (OuterVolumeSpecName: "kube-api-access-w7fqb") pod "d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0" (UID: "d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0"). InnerVolumeSpecName "kube-api-access-w7fqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:47:21.592283 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.592265    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0" (UID: "d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:47:21.691202 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.691119    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-dshm\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:47:21.691202 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.691147    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-tls-certs\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:47:21.691202 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.691157    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7fqb\" (UniqueName: \"kubernetes.io/projected/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-kube-api-access-w7fqb\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:47:21.691202 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.691166    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-home\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:47:21.691202 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:21.691175    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0-model-cache\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:47:22.116202 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.116167    2576 generic.go:356] "Generic (PLEG): container finished" podID="d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0" containerID="6770f43c773b6af9886e91804cfbae19f4e2f109e86710ac6c9e938974feb490" exitCode=0
Jul 20 05:47:22.116373 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.116211    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"
Jul 20 05:47:22.116373 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.116257    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d" event={"ID":"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0","Type":"ContainerDied","Data":"6770f43c773b6af9886e91804cfbae19f4e2f109e86710ac6c9e938974feb490"}
Jul 20 05:47:22.116373 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.116300    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d" event={"ID":"d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0","Type":"ContainerDied","Data":"efc96e677eca1d192b0b0ed675bf81b73af601a045c71d27c0d68753c4caf476"}
Jul 20 05:47:22.116373 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.116318    2576 scope.go:117] "RemoveContainer" containerID="6770f43c773b6af9886e91804cfbae19f4e2f109e86710ac6c9e938974feb490"
Jul 20 05:47:22.125327 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.125312    2576 scope.go:117] "RemoveContainer" containerID="6770f43c773b6af9886e91804cfbae19f4e2f109e86710ac6c9e938974feb490"
Jul 20 05:47:22.125572 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:47:22.125548    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6770f43c773b6af9886e91804cfbae19f4e2f109e86710ac6c9e938974feb490\": container with ID starting with 6770f43c773b6af9886e91804cfbae19f4e2f109e86710ac6c9e938974feb490 not found: ID does not exist" containerID="6770f43c773b6af9886e91804cfbae19f4e2f109e86710ac6c9e938974feb490"
Jul 20 05:47:22.125623 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.125584    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6770f43c773b6af9886e91804cfbae19f4e2f109e86710ac6c9e938974feb490"} err="failed to get container status \"6770f43c773b6af9886e91804cfbae19f4e2f109e86710ac6c9e938974feb490\": rpc error: code = NotFound desc = could not find container \"6770f43c773b6af9886e91804cfbae19f4e2f109e86710ac6c9e938974feb490\": container with ID starting with 6770f43c773b6af9886e91804cfbae19f4e2f109e86710ac6c9e938974feb490 not found: ID does not exist"
Jul 20 05:47:22.136733 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.136704    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"]
Jul 20 05:47:22.140257 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.140238    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-851aef/sub-test-model-851aef-kserve-58c7fb7499-6rq2d"]
Jul 20 05:47:22.232285 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.232244    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq" podUID="33a55197-48e0-4a96-a24d-509eccfff337" containerName="main" containerID="cri-o://baf8326057bcf308dfe08fa2477cbf034a15e42c722202294eef78a74d3b9871" gracePeriod=45
Jul 20 05:47:22.476611 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.476588    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:47:22.528585 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.528549    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"]
Jul 20 05:47:22.529109 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.529092    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33a55197-48e0-4a96-a24d-509eccfff337" containerName="main"
Jul 20 05:47:22.529158 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.529113    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="33a55197-48e0-4a96-a24d-509eccfff337" containerName="main"
Jul 20 05:47:22.529158 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.529130    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0" containerName="main"
Jul 20 05:47:22.529158 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.529140    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0" containerName="main"
Jul 20 05:47:22.529254 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.529233    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="33a55197-48e0-4a96-a24d-509eccfff337" containerName="main"
Jul 20 05:47:22.529254 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.529247    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0" containerName="main"
Jul 20 05:47:22.532529 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.532508    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.535101 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.535076    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-851aef\"/\"openshift-service-ca.crt\""
Jul 20 05:47:22.535216 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.535178    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-851aef\"/\"rate-test-model-851aef-kserve-self-signed-certs\""
Jul 20 05:47:22.535216 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.535204    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-851aef\"/\"kube-root-ca.crt\""
Jul 20 05:47:22.535400 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.535384    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-851aef\"/\"default-dockercfg-2k5b6\""
Jul 20 05:47:22.538510 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.538489    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"]
Jul 20 05:47:22.599109 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.599079    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-dshm\") pod \"33a55197-48e0-4a96-a24d-509eccfff337\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") "
Jul 20 05:47:22.599285 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.599143    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-tmp-dir\") pod \"33a55197-48e0-4a96-a24d-509eccfff337\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") "
Jul 20 05:47:22.599285 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.599195    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33a55197-48e0-4a96-a24d-509eccfff337-tls-certs\") pod \"33a55197-48e0-4a96-a24d-509eccfff337\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") "
Jul 20 05:47:22.599285 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.599276    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-home\") pod \"33a55197-48e0-4a96-a24d-509eccfff337\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") "
Jul 20 05:47:22.599449 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.599310    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctd5n\" (UniqueName: \"kubernetes.io/projected/33a55197-48e0-4a96-a24d-509eccfff337-kube-api-access-ctd5n\") pod \"33a55197-48e0-4a96-a24d-509eccfff337\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") "
Jul 20 05:47:22.599449 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.599336    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-model-cache\") pod \"33a55197-48e0-4a96-a24d-509eccfff337\" (UID: \"33a55197-48e0-4a96-a24d-509eccfff337\") "
Jul 20 05:47:22.599548 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.599479    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "33a55197-48e0-4a96-a24d-509eccfff337" (UID: "33a55197-48e0-4a96-a24d-509eccfff337"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:47:22.599605 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.599580    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-home" (OuterVolumeSpecName: "home") pod "33a55197-48e0-4a96-a24d-509eccfff337" (UID: "33a55197-48e0-4a96-a24d-509eccfff337"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:47:22.599665 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.599613    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-model-cache" (OuterVolumeSpecName: "model-cache") pod "33a55197-48e0-4a96-a24d-509eccfff337" (UID: "33a55197-48e0-4a96-a24d-509eccfff337"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:47:22.599708 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.599665    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-tmp-dir\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:47:22.599708 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.599682    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-home\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:47:22.601508 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.601488    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-dshm" (OuterVolumeSpecName: "dshm") pod "33a55197-48e0-4a96-a24d-509eccfff337" (UID: "33a55197-48e0-4a96-a24d-509eccfff337"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:47:22.601597 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.601533    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33a55197-48e0-4a96-a24d-509eccfff337-kube-api-access-ctd5n" (OuterVolumeSpecName: "kube-api-access-ctd5n") pod "33a55197-48e0-4a96-a24d-509eccfff337" (UID: "33a55197-48e0-4a96-a24d-509eccfff337"). InnerVolumeSpecName "kube-api-access-ctd5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:47:22.601673 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.601655    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33a55197-48e0-4a96-a24d-509eccfff337-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "33a55197-48e0-4a96-a24d-509eccfff337" (UID: "33a55197-48e0-4a96-a24d-509eccfff337"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:47:22.680647 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.680563    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0" path="/var/lib/kubelet/pods/d5d221f4-b0ed-41f8-9b4b-12cdf4e30cb0/volumes"
Jul 20 05:47:22.700535 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.700506    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-home\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.700649 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.700538    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-tmp-dir\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.700649 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.700557    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-model-cache\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.700649 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.700598    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsrnc\" (UniqueName: \"kubernetes.io/projected/63075ffb-813e-49dc-90b7-5af02cd829a8-kube-api-access-hsrnc\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.700767 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.700661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63075ffb-813e-49dc-90b7-5af02cd829a8-tls-certs\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.700767 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.700682    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-dshm\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.700767 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.700754    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctd5n\" (UniqueName: \"kubernetes.io/projected/33a55197-48e0-4a96-a24d-509eccfff337-kube-api-access-ctd5n\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:47:22.700767 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.700764    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-model-cache\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:47:22.700936 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.700775    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/33a55197-48e0-4a96-a24d-509eccfff337-dshm\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:47:22.700936 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.700793    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/33a55197-48e0-4a96-a24d-509eccfff337-tls-certs\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:47:22.801576 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.801551    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-tmp-dir\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.801576 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.801583    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-model-cache\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.801841 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.801612    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsrnc\" (UniqueName: \"kubernetes.io/projected/63075ffb-813e-49dc-90b7-5af02cd829a8-kube-api-access-hsrnc\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.801841 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.801677    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63075ffb-813e-49dc-90b7-5af02cd829a8-tls-certs\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.801841 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.801695    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-dshm\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.802027 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.801849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-home\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.802027 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.801995    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-tmp-dir\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.802202 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.802159    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-home\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.802305 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.802271    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-model-cache\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.804093 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.804069    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-dshm\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.804344 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.804325    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63075ffb-813e-49dc-90b7-5af02cd829a8-tls-certs\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.809069 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.809051    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsrnc\" (UniqueName: \"kubernetes.io/projected/63075ffb-813e-49dc-90b7-5af02cd829a8-kube-api-access-hsrnc\") pod \"rate-test-model-851aef-kserve-7c65d47467-qfd5d\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") " pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.843416 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.843390    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:22.978321 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:22.978288    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"]
Jul 20 05:47:22.980109 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:47:22.980081    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63075ffb_813e_49dc_90b7_5af02cd829a8.slice/crio-278e7c53818db3bfc9e6169e5f48983c4d092a343e8d8f285a78cff09fce066a WatchSource:0}: Error finding container 278e7c53818db3bfc9e6169e5f48983c4d092a343e8d8f285a78cff09fce066a: Status 404 returned error can't find the container with id 278e7c53818db3bfc9e6169e5f48983c4d092a343e8d8f285a78cff09fce066a
Jul 20 05:47:23.122549 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:23.122518    2576 generic.go:356] "Generic (PLEG): container finished" podID="33a55197-48e0-4a96-a24d-509eccfff337" containerID="baf8326057bcf308dfe08fa2477cbf034a15e42c722202294eef78a74d3b9871" exitCode=0
Jul 20 05:47:23.122731 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:23.122560    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"
Jul 20 05:47:23.122731 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:23.122594    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq" event={"ID":"33a55197-48e0-4a96-a24d-509eccfff337","Type":"ContainerDied","Data":"baf8326057bcf308dfe08fa2477cbf034a15e42c722202294eef78a74d3b9871"}
Jul 20 05:47:23.122731 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:23.122630    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq" event={"ID":"33a55197-48e0-4a96-a24d-509eccfff337","Type":"ContainerDied","Data":"2b00f8d8a2707c175a8faaa01c3cfffba4c92e6a0484266ba464eb1b54a1ca71"}
Jul 20 05:47:23.122731 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:23.122648    2576 scope.go:117] "RemoveContainer" containerID="baf8326057bcf308dfe08fa2477cbf034a15e42c722202294eef78a74d3b9871"
Jul 20 05:47:23.124320 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:23.124296    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d" event={"ID":"63075ffb-813e-49dc-90b7-5af02cd829a8","Type":"ContainerStarted","Data":"38af44b8b7e028ae4dad6d9907c35fae33dbb02b23ecf286bb5d3cabb9950a13"}
Jul 20 05:47:23.124442 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:23.124331    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d" event={"ID":"63075ffb-813e-49dc-90b7-5af02cd829a8","Type":"ContainerStarted","Data":"278e7c53818db3bfc9e6169e5f48983c4d092a343e8d8f285a78cff09fce066a"}
Jul 20 05:47:23.131444 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:23.131427    2576 scope.go:117] "RemoveContainer" containerID="baf8326057bcf308dfe08fa2477cbf034a15e42c722202294eef78a74d3b9871"
Jul 20 05:47:23.131705 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:47:23.131687    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"baf8326057bcf308dfe08fa2477cbf034a15e42c722202294eef78a74d3b9871\": container with ID starting with baf8326057bcf308dfe08fa2477cbf034a15e42c722202294eef78a74d3b9871 not found: ID does not exist" containerID="baf8326057bcf308dfe08fa2477cbf034a15e42c722202294eef78a74d3b9871"
Jul 20 05:47:23.131747 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:23.131712    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"baf8326057bcf308dfe08fa2477cbf034a15e42c722202294eef78a74d3b9871"} err="failed to get container status \"baf8326057bcf308dfe08fa2477cbf034a15e42c722202294eef78a74d3b9871\": rpc error: code = NotFound desc = could not find container \"baf8326057bcf308dfe08fa2477cbf034a15e42c722202294eef78a74d3b9871\": container with ID starting with baf8326057bcf308dfe08fa2477cbf034a15e42c722202294eef78a74d3b9871 not found: ID does not exist"
Jul 20 05:47:23.139161 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:23.139139    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"]
Jul 20 05:47:23.142532 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:23.142500    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/sub-test-model-82cedd-kserve-6c8d88d64c-qxscq"]
Jul 20 05:47:23.157150 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:23.157107    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d" podStartSLOduration=1.157092737 podStartE2EDuration="1.157092737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:47:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:47:23.155638548 +0000 UTC m=+2898.971132617" watchObservedRunningTime="2026-07-20 05:47:23.157092737 +0000 UTC m=+2898.972586808"
Jul 20 05:47:24.687185 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:24.687149    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33a55197-48e0-4a96-a24d-509eccfff337" path="/var/lib/kubelet/pods/33a55197-48e0-4a96-a24d-509eccfff337/volumes"
Jul 20 05:47:32.843721 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:32.843669    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:32.843721 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:32.843734    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:32.856083 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:32.856057    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:33.183702 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:33.183616    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:47:36.722118 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.722091    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"]
Jul 20 05:47:36.726652 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.726633    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.730597 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.730561    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-82cedd\"/\"default-dockercfg-cbjxn\""
Jul 20 05:47:36.730597 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.730563    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-82cedd\"/\"openshift-service-ca.crt\""
Jul 20 05:47:36.730843 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.730563    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-82cedd\"/\"rate-test-model-82cedd-kserve-self-signed-certs\""
Jul 20 05:47:36.730843 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.730567    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-82cedd\"/\"kube-root-ca.crt\""
Jul 20 05:47:36.734818 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.734796    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"]
Jul 20 05:47:36.818702 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.818672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-home\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.818860 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.818712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-dshm\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.818860 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.818728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-tmp-dir\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.818860 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.818827    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90cf86fb-7eda-41f6-b438-6fa1950ed86a-tls-certs\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.819016 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.818911    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-model-cache\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.819016 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.818944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7z9j\" (UniqueName: \"kubernetes.io/projected/90cf86fb-7eda-41f6-b438-6fa1950ed86a-kube-api-access-l7z9j\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.919766 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.919729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-model-cache\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.919766 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.919770    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7z9j\" (UniqueName: \"kubernetes.io/projected/90cf86fb-7eda-41f6-b438-6fa1950ed86a-kube-api-access-l7z9j\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.920034 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.919803    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-home\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.920034 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.919977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-dshm\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.920034 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.920011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-tmp-dir\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.920191 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.920093    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90cf86fb-7eda-41f6-b438-6fa1950ed86a-tls-certs\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.920250 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.920205    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-home\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.920307 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.920273    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-model-cache\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.920376 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.920361    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-tmp-dir\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.922417 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.922389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-dshm\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.922643 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.922627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90cf86fb-7eda-41f6-b438-6fa1950ed86a-tls-certs\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:36.927551 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:36.927531    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7z9j\" (UniqueName: \"kubernetes.io/projected/90cf86fb-7eda-41f6-b438-6fa1950ed86a-kube-api-access-l7z9j\") pod \"rate-test-model-82cedd-kserve-559fd57c55-ccbzw\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") " pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:37.037135 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:37.037047    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:37.170476 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:37.170444    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"]
Jul 20 05:47:37.173256 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:47:37.173227    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod90cf86fb_7eda_41f6_b438_6fa1950ed86a.slice/crio-b87cc7c75e5c01c6358b72b5a3dfe837ce7cc9349e675d2fe8f74ad00d4df3e2 WatchSource:0}: Error finding container b87cc7c75e5c01c6358b72b5a3dfe837ce7cc9349e675d2fe8f74ad00d4df3e2: Status 404 returned error can't find the container with id b87cc7c75e5c01c6358b72b5a3dfe837ce7cc9349e675d2fe8f74ad00d4df3e2
Jul 20 05:47:37.195917 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:37.195856    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw" event={"ID":"90cf86fb-7eda-41f6-b438-6fa1950ed86a","Type":"ContainerStarted","Data":"b87cc7c75e5c01c6358b72b5a3dfe837ce7cc9349e675d2fe8f74ad00d4df3e2"}
Jul 20 05:47:38.204082 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:38.204047    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw" event={"ID":"90cf86fb-7eda-41f6-b438-6fa1950ed86a","Type":"ContainerStarted","Data":"bdaf654256b9dccfd4af94534e169384bc9a7153b11dfd00029f318ce8ee2849"}
Jul 20 05:47:38.221611 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:38.221549    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw" podStartSLOduration=2.22153305 podStartE2EDuration="2.22153305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 05:47:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:47:38.219951366 +0000 UTC m=+2914.035445434" watchObservedRunningTime="2026-07-20 05:47:38.22153305 +0000 UTC m=+2914.037027122"
Jul 20 05:47:47.037433 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:47.037392    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:47.037918 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:47.037670    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:47.049983 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:47.049956    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:47:47.256415 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:47:47.256382    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:48:16.603172 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:16.603140    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"]
Jul 20 05:48:17.537276 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:17.537244    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"]
Jul 20 05:48:31.623923 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:31.623867    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d" podUID="63075ffb-813e-49dc-90b7-5af02cd829a8" containerName="main" containerID="cri-o://38af44b8b7e028ae4dad6d9907c35fae33dbb02b23ecf286bb5d3cabb9950a13" gracePeriod=45
Jul 20 05:48:31.870182 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:31.870159    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:48:31.900180 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:31.900117    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-tmp-dir\") pod \"63075ffb-813e-49dc-90b7-5af02cd829a8\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") "
Jul 20 05:48:31.900180 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:31.900158    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-model-cache\") pod \"63075ffb-813e-49dc-90b7-5af02cd829a8\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") "
Jul 20 05:48:31.900361 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:31.900194    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-dshm\") pod \"63075ffb-813e-49dc-90b7-5af02cd829a8\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") "
Jul 20 05:48:31.900361 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:31.900265    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63075ffb-813e-49dc-90b7-5af02cd829a8-tls-certs\") pod \"63075ffb-813e-49dc-90b7-5af02cd829a8\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") "
Jul 20 05:48:31.900361 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:31.900305    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsrnc\" (UniqueName: \"kubernetes.io/projected/63075ffb-813e-49dc-90b7-5af02cd829a8-kube-api-access-hsrnc\") pod \"63075ffb-813e-49dc-90b7-5af02cd829a8\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") "
Jul 20 05:48:31.900515 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:31.900365    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "63075ffb-813e-49dc-90b7-5af02cd829a8" (UID: "63075ffb-813e-49dc-90b7-5af02cd829a8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:48:31.900515 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:31.900388    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-home\") pod \"63075ffb-813e-49dc-90b7-5af02cd829a8\" (UID: \"63075ffb-813e-49dc-90b7-5af02cd829a8\") "
Jul 20 05:48:31.900515 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:31.900467    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-model-cache" (OuterVolumeSpecName: "model-cache") pod "63075ffb-813e-49dc-90b7-5af02cd829a8" (UID: "63075ffb-813e-49dc-90b7-5af02cd829a8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:48:31.900694 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:31.900675    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-home" (OuterVolumeSpecName: "home") pod "63075ffb-813e-49dc-90b7-5af02cd829a8" (UID: "63075ffb-813e-49dc-90b7-5af02cd829a8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:48:31.900763 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:31.900742    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-tmp-dir\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:48:31.900802 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:31.900769    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-model-cache\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:48:31.902660 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:31.902635    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63075ffb-813e-49dc-90b7-5af02cd829a8-kube-api-access-hsrnc" (OuterVolumeSpecName: "kube-api-access-hsrnc") pod "63075ffb-813e-49dc-90b7-5af02cd829a8" (UID: "63075ffb-813e-49dc-90b7-5af02cd829a8"). InnerVolumeSpecName "kube-api-access-hsrnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:48:31.902993 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:31.902971    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63075ffb-813e-49dc-90b7-5af02cd829a8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "63075ffb-813e-49dc-90b7-5af02cd829a8" (UID: "63075ffb-813e-49dc-90b7-5af02cd829a8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:48:31.902993 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:31.902977    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-dshm" (OuterVolumeSpecName: "dshm") pod "63075ffb-813e-49dc-90b7-5af02cd829a8" (UID: "63075ffb-813e-49dc-90b7-5af02cd829a8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:48:32.001664 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.001625    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63075ffb-813e-49dc-90b7-5af02cd829a8-tls-certs\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:48:32.001664 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.001658    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsrnc\" (UniqueName: \"kubernetes.io/projected/63075ffb-813e-49dc-90b7-5af02cd829a8-kube-api-access-hsrnc\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:48:32.001664 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.001669    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-home\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:48:32.001937 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.001679    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63075ffb-813e-49dc-90b7-5af02cd829a8-dshm\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:48:32.458006 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.457973    2576 generic.go:356] "Generic (PLEG): container finished" podID="63075ffb-813e-49dc-90b7-5af02cd829a8" containerID="38af44b8b7e028ae4dad6d9907c35fae33dbb02b23ecf286bb5d3cabb9950a13" exitCode=0
Jul 20 05:48:32.458198 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.458023    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d" event={"ID":"63075ffb-813e-49dc-90b7-5af02cd829a8","Type":"ContainerDied","Data":"38af44b8b7e028ae4dad6d9907c35fae33dbb02b23ecf286bb5d3cabb9950a13"}
Jul 20 05:48:32.458198 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.458029    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"
Jul 20 05:48:32.458198 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.458055    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d" event={"ID":"63075ffb-813e-49dc-90b7-5af02cd829a8","Type":"ContainerDied","Data":"278e7c53818db3bfc9e6169e5f48983c4d092a343e8d8f285a78cff09fce066a"}
Jul 20 05:48:32.458198 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.458072    2576 scope.go:117] "RemoveContainer" containerID="38af44b8b7e028ae4dad6d9907c35fae33dbb02b23ecf286bb5d3cabb9950a13"
Jul 20 05:48:32.467343 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.467324    2576 scope.go:117] "RemoveContainer" containerID="38af44b8b7e028ae4dad6d9907c35fae33dbb02b23ecf286bb5d3cabb9950a13"
Jul 20 05:48:32.467576 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:48:32.467558    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38af44b8b7e028ae4dad6d9907c35fae33dbb02b23ecf286bb5d3cabb9950a13\": container with ID starting with 38af44b8b7e028ae4dad6d9907c35fae33dbb02b23ecf286bb5d3cabb9950a13 not found: ID does not exist" containerID="38af44b8b7e028ae4dad6d9907c35fae33dbb02b23ecf286bb5d3cabb9950a13"
Jul 20 05:48:32.467614 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.467586    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38af44b8b7e028ae4dad6d9907c35fae33dbb02b23ecf286bb5d3cabb9950a13"} err="failed to get container status \"38af44b8b7e028ae4dad6d9907c35fae33dbb02b23ecf286bb5d3cabb9950a13\": rpc error: code = NotFound desc = could not find container \"38af44b8b7e028ae4dad6d9907c35fae33dbb02b23ecf286bb5d3cabb9950a13\": container with ID starting with 38af44b8b7e028ae4dad6d9907c35fae33dbb02b23ecf286bb5d3cabb9950a13 not found: ID does not exist"
Jul 20 05:48:32.479336 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.479309    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"]
Jul 20 05:48:32.482804 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.482782    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-851aef/rate-test-model-851aef-kserve-7c65d47467-qfd5d"]
Jul 20 05:48:32.557727 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.557686    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw" podUID="90cf86fb-7eda-41f6-b438-6fa1950ed86a" containerName="main" containerID="cri-o://bdaf654256b9dccfd4af94534e169384bc9a7153b11dfd00029f318ce8ee2849" gracePeriod=45
Jul 20 05:48:32.681937 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.681908    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63075ffb-813e-49dc-90b7-5af02cd829a8" path="/var/lib/kubelet/pods/63075ffb-813e-49dc-90b7-5af02cd829a8/volumes"
Jul 20 05:48:32.809998 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.809974    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:48:32.910563 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.910536    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-tmp-dir\") pod \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") "
Jul 20 05:48:32.910724 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.910580    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7z9j\" (UniqueName: \"kubernetes.io/projected/90cf86fb-7eda-41f6-b438-6fa1950ed86a-kube-api-access-l7z9j\") pod \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") "
Jul 20 05:48:32.910724 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.910633    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-model-cache\") pod \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") "
Jul 20 05:48:32.910724 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.910664    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-home\") pod \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") "
Jul 20 05:48:32.910724 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.910682    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-dshm\") pod \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") "
Jul 20 05:48:32.910974 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.910776    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90cf86fb-7eda-41f6-b438-6fa1950ed86a-tls-certs\") pod \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\" (UID: \"90cf86fb-7eda-41f6-b438-6fa1950ed86a\") "
Jul 20 05:48:32.910974 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.910823    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "90cf86fb-7eda-41f6-b438-6fa1950ed86a" (UID: "90cf86fb-7eda-41f6-b438-6fa1950ed86a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:48:32.910974 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.910959    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-model-cache" (OuterVolumeSpecName: "model-cache") pod "90cf86fb-7eda-41f6-b438-6fa1950ed86a" (UID: "90cf86fb-7eda-41f6-b438-6fa1950ed86a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:48:32.911142 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.910992    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-home" (OuterVolumeSpecName: "home") pod "90cf86fb-7eda-41f6-b438-6fa1950ed86a" (UID: "90cf86fb-7eda-41f6-b438-6fa1950ed86a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:48:32.911142 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.911092    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-tmp-dir\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:48:32.911142 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.911108    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-model-cache\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:48:32.911142 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.911116    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-home\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:48:32.912899 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.912848    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-dshm" (OuterVolumeSpecName: "dshm") pod "90cf86fb-7eda-41f6-b438-6fa1950ed86a" (UID: "90cf86fb-7eda-41f6-b438-6fa1950ed86a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 05:48:32.913008 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.912895    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90cf86fb-7eda-41f6-b438-6fa1950ed86a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "90cf86fb-7eda-41f6-b438-6fa1950ed86a" (UID: "90cf86fb-7eda-41f6-b438-6fa1950ed86a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:48:32.913008 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:32.912911    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90cf86fb-7eda-41f6-b438-6fa1950ed86a-kube-api-access-l7z9j" (OuterVolumeSpecName: "kube-api-access-l7z9j") pod "90cf86fb-7eda-41f6-b438-6fa1950ed86a" (UID: "90cf86fb-7eda-41f6-b438-6fa1950ed86a"). InnerVolumeSpecName "kube-api-access-l7z9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:48:33.012125 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:33.012046    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90cf86fb-7eda-41f6-b438-6fa1950ed86a-dshm\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:48:33.012125 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:33.012074    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90cf86fb-7eda-41f6-b438-6fa1950ed86a-tls-certs\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:48:33.012125 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:33.012089    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7z9j\" (UniqueName: \"kubernetes.io/projected/90cf86fb-7eda-41f6-b438-6fa1950ed86a-kube-api-access-l7z9j\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:48:33.464340 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:33.464302    2576 generic.go:356] "Generic (PLEG): container finished" podID="90cf86fb-7eda-41f6-b438-6fa1950ed86a" containerID="bdaf654256b9dccfd4af94534e169384bc9a7153b11dfd00029f318ce8ee2849" exitCode=0
Jul 20 05:48:33.464340 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:33.464343    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw" event={"ID":"90cf86fb-7eda-41f6-b438-6fa1950ed86a","Type":"ContainerDied","Data":"bdaf654256b9dccfd4af94534e169384bc9a7153b11dfd00029f318ce8ee2849"}
Jul 20 05:48:33.464558 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:33.464347    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"
Jul 20 05:48:33.464558 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:33.464372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw" event={"ID":"90cf86fb-7eda-41f6-b438-6fa1950ed86a","Type":"ContainerDied","Data":"b87cc7c75e5c01c6358b72b5a3dfe837ce7cc9349e675d2fe8f74ad00d4df3e2"}
Jul 20 05:48:33.464558 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:33.464393    2576 scope.go:117] "RemoveContainer" containerID="bdaf654256b9dccfd4af94534e169384bc9a7153b11dfd00029f318ce8ee2849"
Jul 20 05:48:33.473380 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:33.473360    2576 scope.go:117] "RemoveContainer" containerID="bdaf654256b9dccfd4af94534e169384bc9a7153b11dfd00029f318ce8ee2849"
Jul 20 05:48:33.473639 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:48:33.473617    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdaf654256b9dccfd4af94534e169384bc9a7153b11dfd00029f318ce8ee2849\": container with ID starting with bdaf654256b9dccfd4af94534e169384bc9a7153b11dfd00029f318ce8ee2849 not found: ID does not exist" containerID="bdaf654256b9dccfd4af94534e169384bc9a7153b11dfd00029f318ce8ee2849"
Jul 20 05:48:33.473721 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:33.473650    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdaf654256b9dccfd4af94534e169384bc9a7153b11dfd00029f318ce8ee2849"} err="failed to get container status \"bdaf654256b9dccfd4af94534e169384bc9a7153b11dfd00029f318ce8ee2849\": rpc error: code = NotFound desc = could not find container \"bdaf654256b9dccfd4af94534e169384bc9a7153b11dfd00029f318ce8ee2849\": container with ID starting with bdaf654256b9dccfd4af94534e169384bc9a7153b11dfd00029f318ce8ee2849 not found: ID does not exist"
Jul 20 05:48:33.485255 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:33.485233    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"]
Jul 20 05:48:33.490709 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:33.490689    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-82cedd/rate-test-model-82cedd-kserve-559fd57c55-ccbzw"]
Jul 20 05:48:34.680098 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:34.680066    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90cf86fb-7eda-41f6-b438-6fa1950ed86a" path="/var/lib/kubelet/pods/90cf86fb-7eda-41f6-b438-6fa1950ed86a/volumes"
Jul 20 05:48:46.917119 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:46.917085    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"]
Jul 20 05:48:46.917713 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:46.917338    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd" podUID="a9c09705-5596-4c27-98b7-00d64730e2c3" containerName="maas-api" containerID="cri-o://46bbacc1a1dc8f4c6959fee01084ef38273864c953df7b5b707f06d228f46cb1" gracePeriod=30
Jul 20 05:48:47.171326 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.171266    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"
Jul 20 05:48:47.237413 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.237381    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9c09705-5596-4c27-98b7-00d64730e2c3-maas-api-tls\") pod \"a9c09705-5596-4c27-98b7-00d64730e2c3\" (UID: \"a9c09705-5596-4c27-98b7-00d64730e2c3\") "
Jul 20 05:48:47.237572 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.237419    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qpgm\" (UniqueName: \"kubernetes.io/projected/a9c09705-5596-4c27-98b7-00d64730e2c3-kube-api-access-7qpgm\") pod \"a9c09705-5596-4c27-98b7-00d64730e2c3\" (UID: \"a9c09705-5596-4c27-98b7-00d64730e2c3\") "
Jul 20 05:48:47.237572 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.237458    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9c09705-5596-4c27-98b7-00d64730e2c3-openshift-service-ca\") pod \"a9c09705-5596-4c27-98b7-00d64730e2c3\" (UID: \"a9c09705-5596-4c27-98b7-00d64730e2c3\") "
Jul 20 05:48:47.237935 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.237870    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9c09705-5596-4c27-98b7-00d64730e2c3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a9c09705-5596-4c27-98b7-00d64730e2c3" (UID: "a9c09705-5596-4c27-98b7-00d64730e2c3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:48:47.239786 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.239758    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9c09705-5596-4c27-98b7-00d64730e2c3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a9c09705-5596-4c27-98b7-00d64730e2c3" (UID: "a9c09705-5596-4c27-98b7-00d64730e2c3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:48:47.239894 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.239783    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9c09705-5596-4c27-98b7-00d64730e2c3-kube-api-access-7qpgm" (OuterVolumeSpecName: "kube-api-access-7qpgm") pod "a9c09705-5596-4c27-98b7-00d64730e2c3" (UID: "a9c09705-5596-4c27-98b7-00d64730e2c3"). InnerVolumeSpecName "kube-api-access-7qpgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:48:47.338575 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.338547    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9c09705-5596-4c27-98b7-00d64730e2c3-maas-api-tls\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:48:47.338575 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.338573    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qpgm\" (UniqueName: \"kubernetes.io/projected/a9c09705-5596-4c27-98b7-00d64730e2c3-kube-api-access-7qpgm\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:48:47.338732 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.338583    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9c09705-5596-4c27-98b7-00d64730e2c3-openshift-service-ca\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:48:47.537787 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.537749    2576 generic.go:356] "Generic (PLEG): container finished" podID="a9c09705-5596-4c27-98b7-00d64730e2c3" containerID="46bbacc1a1dc8f4c6959fee01084ef38273864c953df7b5b707f06d228f46cb1" exitCode=0
Jul 20 05:48:47.537985 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.537801    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"
Jul 20 05:48:47.537985 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.537834    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd" event={"ID":"a9c09705-5596-4c27-98b7-00d64730e2c3","Type":"ContainerDied","Data":"46bbacc1a1dc8f4c6959fee01084ef38273864c953df7b5b707f06d228f46cb1"}
Jul 20 05:48:47.537985 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.537940    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd" event={"ID":"a9c09705-5596-4c27-98b7-00d64730e2c3","Type":"ContainerDied","Data":"d2956ae24be31a49870463131b68cbcccbedd47dfedac26f405afb5b0334272a"}
Jul 20 05:48:47.537985 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.537970    2576 scope.go:117] "RemoveContainer" containerID="46bbacc1a1dc8f4c6959fee01084ef38273864c953df7b5b707f06d228f46cb1"
Jul 20 05:48:47.547517 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.547497    2576 scope.go:117] "RemoveContainer" containerID="46bbacc1a1dc8f4c6959fee01084ef38273864c953df7b5b707f06d228f46cb1"
Jul 20 05:48:47.547780 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:48:47.547759    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46bbacc1a1dc8f4c6959fee01084ef38273864c953df7b5b707f06d228f46cb1\": container with ID starting with 46bbacc1a1dc8f4c6959fee01084ef38273864c953df7b5b707f06d228f46cb1 not found: ID does not exist" containerID="46bbacc1a1dc8f4c6959fee01084ef38273864c953df7b5b707f06d228f46cb1"
Jul 20 05:48:47.547847 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.547788    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46bbacc1a1dc8f4c6959fee01084ef38273864c953df7b5b707f06d228f46cb1"} err="failed to get container status \"46bbacc1a1dc8f4c6959fee01084ef38273864c953df7b5b707f06d228f46cb1\": rpc error: code = NotFound desc = could not find container \"46bbacc1a1dc8f4c6959fee01084ef38273864c953df7b5b707f06d228f46cb1\": container with ID starting with 46bbacc1a1dc8f4c6959fee01084ef38273864c953df7b5b707f06d228f46cb1 not found: ID does not exist"
Jul 20 05:48:47.558825 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.558797    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"]
Jul 20 05:48:47.562600 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:47.562573    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-851aef-66b577b64c-pcbjd"]
Jul 20 05:48:48.680251 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:48:48.680218    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9c09705-5596-4c27-98b7-00d64730e2c3" path="/var/lib/kubelet/pods/a9c09705-5596-4c27-98b7-00d64730e2c3/volumes"
Jul 20 05:49:09.066105 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.066070    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"]
Jul 20 05:49:09.066540 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.066321    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m" podUID="cf4df766-c37f-4697-8a37-69a0c30793f5" containerName="maas-api" containerID="cri-o://384be7696fbc0f62961ba7297c469bf45ba959d568dc71693b89bd933a907a6c" gracePeriod=30
Jul 20 05:49:09.305800 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.305774    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"
Jul 20 05:49:09.330218 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.330144    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf4df766-c37f-4697-8a37-69a0c30793f5-openshift-service-ca\") pod \"cf4df766-c37f-4697-8a37-69a0c30793f5\" (UID: \"cf4df766-c37f-4697-8a37-69a0c30793f5\") "
Jul 20 05:49:09.330218 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.330213    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf4df766-c37f-4697-8a37-69a0c30793f5-maas-api-tls\") pod \"cf4df766-c37f-4697-8a37-69a0c30793f5\" (UID: \"cf4df766-c37f-4697-8a37-69a0c30793f5\") "
Jul 20 05:49:09.330398 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.330238    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v46f6\" (UniqueName: \"kubernetes.io/projected/cf4df766-c37f-4697-8a37-69a0c30793f5-kube-api-access-v46f6\") pod \"cf4df766-c37f-4697-8a37-69a0c30793f5\" (UID: \"cf4df766-c37f-4697-8a37-69a0c30793f5\") "
Jul 20 05:49:09.330614 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.330589    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf4df766-c37f-4697-8a37-69a0c30793f5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cf4df766-c37f-4697-8a37-69a0c30793f5" (UID: "cf4df766-c37f-4697-8a37-69a0c30793f5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 05:49:09.332582 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.332547    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf4df766-c37f-4697-8a37-69a0c30793f5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cf4df766-c37f-4697-8a37-69a0c30793f5" (UID: "cf4df766-c37f-4697-8a37-69a0c30793f5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 05:49:09.332712 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.332628    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf4df766-c37f-4697-8a37-69a0c30793f5-kube-api-access-v46f6" (OuterVolumeSpecName: "kube-api-access-v46f6") pod "cf4df766-c37f-4697-8a37-69a0c30793f5" (UID: "cf4df766-c37f-4697-8a37-69a0c30793f5"). InnerVolumeSpecName "kube-api-access-v46f6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 05:49:09.431694 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.431644    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf4df766-c37f-4697-8a37-69a0c30793f5-maas-api-tls\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:49:09.431694 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.431689    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v46f6\" (UniqueName: \"kubernetes.io/projected/cf4df766-c37f-4697-8a37-69a0c30793f5-kube-api-access-v46f6\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:49:09.431694 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.431700    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf4df766-c37f-4697-8a37-69a0c30793f5-openshift-service-ca\") on node \"ip-10-0-135-196.ec2.internal\" DevicePath \"\""
Jul 20 05:49:09.638004 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.637917    2576 generic.go:356] "Generic (PLEG): container finished" podID="cf4df766-c37f-4697-8a37-69a0c30793f5" containerID="384be7696fbc0f62961ba7297c469bf45ba959d568dc71693b89bd933a907a6c" exitCode=0
Jul 20 05:49:09.638004 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.637959    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"
Jul 20 05:49:09.638206 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.637963    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m" event={"ID":"cf4df766-c37f-4697-8a37-69a0c30793f5","Type":"ContainerDied","Data":"384be7696fbc0f62961ba7297c469bf45ba959d568dc71693b89bd933a907a6c"}
Jul 20 05:49:09.638206 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.638090    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m" event={"ID":"cf4df766-c37f-4697-8a37-69a0c30793f5","Type":"ContainerDied","Data":"d45a12dace0b0420f525c7b65acf3c8961d4ded4e46a15d4be77565ed1acfa42"}
Jul 20 05:49:09.638206 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.638121    2576 scope.go:117] "RemoveContainer" containerID="384be7696fbc0f62961ba7297c469bf45ba959d568dc71693b89bd933a907a6c"
Jul 20 05:49:09.647575 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.647552    2576 scope.go:117] "RemoveContainer" containerID="384be7696fbc0f62961ba7297c469bf45ba959d568dc71693b89bd933a907a6c"
Jul 20 05:49:09.647839 ip-10-0-135-196 kubenswrapper[2576]: E0720 05:49:09.647814    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"384be7696fbc0f62961ba7297c469bf45ba959d568dc71693b89bd933a907a6c\": container with ID starting with 384be7696fbc0f62961ba7297c469bf45ba959d568dc71693b89bd933a907a6c not found: ID does not exist" containerID="384be7696fbc0f62961ba7297c469bf45ba959d568dc71693b89bd933a907a6c"
Jul 20 05:49:09.647942 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.647847    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"384be7696fbc0f62961ba7297c469bf45ba959d568dc71693b89bd933a907a6c"} err="failed to get container status \"384be7696fbc0f62961ba7297c469bf45ba959d568dc71693b89bd933a907a6c\": rpc error: code = NotFound desc = could not find container \"384be7696fbc0f62961ba7297c469bf45ba959d568dc71693b89bd933a907a6c\": container with ID starting with 384be7696fbc0f62961ba7297c469bf45ba959d568dc71693b89bd933a907a6c not found: ID does not exist"
Jul 20 05:49:09.658415 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.658391    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"]
Jul 20 05:49:09.662388 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:09.662368    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-82cedd-dfd7f968-fgm9m"]
Jul 20 05:49:10.680459 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:10.680425    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf4df766-c37f-4697-8a37-69a0c30793f5" path="/var/lib/kubelet/pods/cf4df766-c37f-4697-8a37-69a0c30793f5/volumes"
Jul 20 05:49:21.007747 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:21.007714    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-bb6b7f4c-qbff2_a5ad934c-257c-4344-a3ec-0248d18312f7/authorino/0.log"
Jul 20 05:49:27.534274 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:27.534246    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dff8fcf7-wj2md_d5d4c103-141a-46dc-85b6-b4845d5dee47/copy-manifests/0.log"
Jul 20 05:49:27.541536 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:27.541510    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dff8fcf7-wj2md_d5d4c103-141a-46dc-85b6-b4845d5dee47/manager/0.log"
Jul 20 05:49:27.911765 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:27.911681    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-547448bff5-9wx7b_7ec945dd-909d-4615-ad40-40dad3887f48/maas-api/0.log"
Jul 20 05:49:29.726979 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:29.726949    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-bb6b7f4c-qbff2_a5ad934c-257c-4344-a3ec-0248d18312f7/authorino/0.log"
Jul 20 05:49:30.614362 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:30.614330    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cqf4w_678468a3-c0a6-4631-ad9a-80a7e8a6d250/manager/0.log"
Jul 20 05:49:31.226103 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:31.226076    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bf9656866-bvrwg_8540b031-6e84-4c15-bb7c-51160870c58b/kube-auth-proxy/0.log"
Jul 20 05:49:32.309754 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:32.309725    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-wljgc_2003f6ab-73a9-4c0f-a332-8413e49b96c3/main/0.log"
Jul 20 05:49:32.428081 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:32.428040    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-8kwdv_1397342c-95e4-47b2-9110-d2f98ff67560/main/0.log"
Jul 20 05:49:32.786733 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:32.786692    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-ct82c_b5fb42c9-ac7c-43d4-a55a-055af9490c6f/main/0.log"
Jul 20 05:49:41.227321 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:41.227294    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rq2k2_d1d1f768-3baf-41e6-afbc-15c2b7856475/global-pull-secret-syncer/0.log"
Jul 20 05:49:41.306175 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:41.306147    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9kxcb_e97dc9be-002f-49cc-9308-66d2d9119e64/konnectivity-agent/0.log"
Jul 20 05:49:41.398988 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:41.398963    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-196.ec2.internal_fa8803663572406e0c5539a65925db49/haproxy/0.log"
Jul 20 05:49:46.580707 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:46.580618    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-bb6b7f4c-qbff2_a5ad934c-257c-4344-a3ec-0248d18312f7/authorino/0.log"
Jul 20 05:49:46.983861 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:46.983832    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cqf4w_678468a3-c0a6-4631-ad9a-80a7e8a6d250/manager/0.log"
Jul 20 05:49:49.052493 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:49.052462    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gvglj_56bc4d30-7a21-4f9b-88fb-5a6d84c4b022/node-exporter/0.log"
Jul 20 05:49:49.072752 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:49.072727    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gvglj_56bc4d30-7a21-4f9b-88fb-5a6d84c4b022/kube-rbac-proxy/0.log"
Jul 20 05:49:49.097584 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:49.097560    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gvglj_56bc4d30-7a21-4f9b-88fb-5a6d84c4b022/init-textfile/0.log"
Jul 20 05:49:49.294603 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:49.294570    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f627c787-0db2-4607-b9dd-ecde8e76922f/prometheus/0.log"
Jul 20 05:49:49.314430 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:49.314365    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f627c787-0db2-4607-b9dd-ecde8e76922f/config-reloader/0.log"
Jul 20 05:49:49.343586 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:49.343564    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f627c787-0db2-4607-b9dd-ecde8e76922f/thanos-sidecar/0.log"
Jul 20 05:49:49.365831 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:49.365810    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f627c787-0db2-4607-b9dd-ecde8e76922f/kube-rbac-proxy-web/0.log"
Jul 20 05:49:49.386590 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:49.386566    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f627c787-0db2-4607-b9dd-ecde8e76922f/kube-rbac-proxy/0.log"
Jul 20 05:49:49.406536 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:49.406520    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f627c787-0db2-4607-b9dd-ecde8e76922f/kube-rbac-proxy-thanos/0.log"
Jul 20 05:49:49.426453 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:49.426436    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f627c787-0db2-4607-b9dd-ecde8e76922f/init-config-reloader/0.log"
Jul 20 05:49:49.455633 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:49.455610    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-mm4xt_3b8317ee-3758-445b-8c6c-0490c71fce22/prometheus-operator/0.log"
Jul 20 05:49:49.474259 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:49.474239    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-mm4xt_3b8317ee-3758-445b-8c6c-0490c71fce22/kube-rbac-proxy/0.log"
Jul 20 05:49:49.524868 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:49.524846    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7dff8f57f5-mnlrm_e5bba51e-5a32-4e8c-98cc-d393af156522/telemeter-client/0.log"
Jul 20 05:49:49.546539 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:49.546519    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7dff8f57f5-mnlrm_e5bba51e-5a32-4e8c-98cc-d393af156522/reload/0.log"
Jul 20 05:49:49.567683 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:49.567630    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7dff8f57f5-mnlrm_e5bba51e-5a32-4e8c-98cc-d393af156522/kube-rbac-proxy/0.log"
Jul 20 05:49:50.818990 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:50.818954    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-nddcd_bab9155b-7f0f-49b7-bd95-bce008c0f322/networking-console-plugin/0.log"
Jul 20 05:49:51.292762 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.292729    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"]
Jul 20 05:49:51.293079 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.293066    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9c09705-5596-4c27-98b7-00d64730e2c3" containerName="maas-api"
Jul 20 05:49:51.293124 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.293081    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9c09705-5596-4c27-98b7-00d64730e2c3" containerName="maas-api"
Jul 20 05:49:51.293124 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.293089    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90cf86fb-7eda-41f6-b438-6fa1950ed86a" containerName="main"
Jul 20 05:49:51.293124 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.293094    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="90cf86fb-7eda-41f6-b438-6fa1950ed86a" containerName="main"
Jul 20 05:49:51.293124 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.293110    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63075ffb-813e-49dc-90b7-5af02cd829a8" containerName="main"
Jul 20 05:49:51.293124 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.293116    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="63075ffb-813e-49dc-90b7-5af02cd829a8" containerName="main"
Jul 20 05:49:51.293124 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.293123    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf4df766-c37f-4697-8a37-69a0c30793f5" containerName="maas-api"
Jul 20 05:49:51.293303 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.293128    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf4df766-c37f-4697-8a37-69a0c30793f5" containerName="maas-api"
Jul 20 05:49:51.293303 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.293176    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="63075ffb-813e-49dc-90b7-5af02cd829a8" containerName="main"
Jul 20 05:49:51.293303 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.293184    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9c09705-5596-4c27-98b7-00d64730e2c3" containerName="maas-api"
Jul 20 05:49:51.293303 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.293189    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf4df766-c37f-4697-8a37-69a0c30793f5" containerName="maas-api"
Jul 20 05:49:51.293303 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.293196    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="90cf86fb-7eda-41f6-b438-6fa1950ed86a" containerName="main"
Jul 20 05:49:51.296435 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.296417    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.299062 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.299044    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g8fln\"/\"openshift-service-ca.crt\""
Jul 20 05:49:51.299180 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.299058    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g8fln\"/\"kube-root-ca.crt\""
Jul 20 05:49:51.300035 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.300018    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g8fln\"/\"default-dockercfg-c52p4\""
Jul 20 05:49:51.303583 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.303551    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"]
Jul 20 05:49:51.398502 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.398465    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59kp2\" (UniqueName: \"kubernetes.io/projected/6af134e5-d969-46c6-9976-7fa0b0c22816-kube-api-access-59kp2\") pod \"perf-node-gather-daemonset-hxkcp\" (UID: \"6af134e5-d969-46c6-9976-7fa0b0c22816\") " pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.398668 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.398533    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6af134e5-d969-46c6-9976-7fa0b0c22816-podres\") pod \"perf-node-gather-daemonset-hxkcp\" (UID: \"6af134e5-d969-46c6-9976-7fa0b0c22816\") " pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.398668 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.398609    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6af134e5-d969-46c6-9976-7fa0b0c22816-sys\") pod \"perf-node-gather-daemonset-hxkcp\" (UID: \"6af134e5-d969-46c6-9976-7fa0b0c22816\") " pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.398668 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.398663    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6af134e5-d969-46c6-9976-7fa0b0c22816-proc\") pod \"perf-node-gather-daemonset-hxkcp\" (UID: \"6af134e5-d969-46c6-9976-7fa0b0c22816\") " pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.398831 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.398738    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6af134e5-d969-46c6-9976-7fa0b0c22816-lib-modules\") pod \"perf-node-gather-daemonset-hxkcp\" (UID: \"6af134e5-d969-46c6-9976-7fa0b0c22816\") " pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.499978 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.499940    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6af134e5-d969-46c6-9976-7fa0b0c22816-sys\") pod \"perf-node-gather-daemonset-hxkcp\" (UID: \"6af134e5-d969-46c6-9976-7fa0b0c22816\") " pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.500138 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.499996    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6af134e5-d969-46c6-9976-7fa0b0c22816-proc\") pod \"perf-node-gather-daemonset-hxkcp\" (UID: \"6af134e5-d969-46c6-9976-7fa0b0c22816\") " pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.500138 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.500039    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6af134e5-d969-46c6-9976-7fa0b0c22816-lib-modules\") pod \"perf-node-gather-daemonset-hxkcp\" (UID: \"6af134e5-d969-46c6-9976-7fa0b0c22816\") " pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.500138 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.500066    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6af134e5-d969-46c6-9976-7fa0b0c22816-sys\") pod \"perf-node-gather-daemonset-hxkcp\" (UID: \"6af134e5-d969-46c6-9976-7fa0b0c22816\") " pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.500138 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.500073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59kp2\" (UniqueName: \"kubernetes.io/projected/6af134e5-d969-46c6-9976-7fa0b0c22816-kube-api-access-59kp2\") pod \"perf-node-gather-daemonset-hxkcp\" (UID: \"6af134e5-d969-46c6-9976-7fa0b0c22816\") " pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.500138 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.500128    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6af134e5-d969-46c6-9976-7fa0b0c22816-proc\") pod \"perf-node-gather-daemonset-hxkcp\" (UID: \"6af134e5-d969-46c6-9976-7fa0b0c22816\") " pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.500333 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.500152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6af134e5-d969-46c6-9976-7fa0b0c22816-podres\") pod \"perf-node-gather-daemonset-hxkcp\" (UID: \"6af134e5-d969-46c6-9976-7fa0b0c22816\") " pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.500333 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.500225    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6af134e5-d969-46c6-9976-7fa0b0c22816-lib-modules\") pod \"perf-node-gather-daemonset-hxkcp\" (UID: \"6af134e5-d969-46c6-9976-7fa0b0c22816\") " pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.500333 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.500266    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6af134e5-d969-46c6-9976-7fa0b0c22816-podres\") pod \"perf-node-gather-daemonset-hxkcp\" (UID: \"6af134e5-d969-46c6-9976-7fa0b0c22816\") " pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.507518 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.507495    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59kp2\" (UniqueName: \"kubernetes.io/projected/6af134e5-d969-46c6-9976-7fa0b0c22816-kube-api-access-59kp2\") pod \"perf-node-gather-daemonset-hxkcp\" (UID: \"6af134e5-d969-46c6-9976-7fa0b0c22816\") " pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.607073 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.606988    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.736394 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.736364    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"]
Jul 20 05:49:51.740246 ip-10-0-135-196 kubenswrapper[2576]: W0720 05:49:51.740215    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6af134e5_d969_46c6_9976_7fa0b0c22816.slice/crio-6e8601f9e52085d65c9043008ba5aabcd0eaaa7fab03aa75af4058a11288320c WatchSource:0}: Error finding container 6e8601f9e52085d65c9043008ba5aabcd0eaaa7fab03aa75af4058a11288320c: Status 404 returned error can't find the container with id 6e8601f9e52085d65c9043008ba5aabcd0eaaa7fab03aa75af4058a11288320c
Jul 20 05:49:51.821106 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.821077    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp" event={"ID":"6af134e5-d969-46c6-9976-7fa0b0c22816","Type":"ContainerStarted","Data":"fab47cb58a24560b0458a0cadfff461ef01e70a027c7326869a7bf225555e679"}
Jul 20 05:49:51.821445 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.821125    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp" event={"ID":"6af134e5-d969-46c6-9976-7fa0b0c22816","Type":"ContainerStarted","Data":"6e8601f9e52085d65c9043008ba5aabcd0eaaa7fab03aa75af4058a11288320c"}
Jul 20 05:49:51.821445 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.821197    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:51.836870 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:51.836827    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp" podStartSLOduration=0.836813136 podStartE2EDuration="836.813136ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 05:49:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 05:49:51.836072471 +0000 UTC m=+3047.651566545" watchObservedRunningTime="2026-07-20 05:49:51.836813136 +0000 UTC m=+3047.652307208"
Jul 20 05:49:53.675845 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:53.675817    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-khcvq_93ea7d70-7e2b-4be9-bec1-42e998a570a9/dns/0.log"
Jul 20 05:49:53.694548 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:53.694522    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-khcvq_93ea7d70-7e2b-4be9-bec1-42e998a570a9/kube-rbac-proxy/0.log"
Jul 20 05:49:53.719476 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:53.719448    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7q97q_e5c87251-66a3-49c9-ae5f-8ed4e6ac4075/dns-node-resolver/0.log"
Jul 20 05:49:54.338774 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:54.338744    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qqt42_7aeacaeb-c51d-4a2c-962a-cc69281308f9/node-ca/0.log"
Jul 20 05:49:55.370115 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:55.370085    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bf9656866-bvrwg_8540b031-6e84-4c15-bb7c-51160870c58b/kube-auth-proxy/0.log"
Jul 20 05:49:56.264990 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:56.264917    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sq92c_d085e9fe-4517-4144-90fa-7e3b024db7f5/serve-healthcheck-canary/0.log"
Jul 20 05:49:56.723046 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:56.723021    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7s2b2_c3294c4a-46ba-4831-98f2-a50a37b980ff/kube-rbac-proxy/0.log"
Jul 20 05:49:56.743618 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:56.743594    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7s2b2_c3294c4a-46ba-4831-98f2-a50a37b980ff/exporter/0.log"
Jul 20 05:49:56.765434 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:56.765403    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7s2b2_c3294c4a-46ba-4831-98f2-a50a37b980ff/extractor/0.log"
Jul 20 05:49:57.836045 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:57.836012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g8fln/perf-node-gather-daemonset-hxkcp"
Jul 20 05:49:59.538114 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:59.538083    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dff8fcf7-wj2md_d5d4c103-141a-46dc-85b6-b4845d5dee47/manager/0.log"
Jul 20 05:49:59.556736 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:49:59.556707    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dff8fcf7-wj2md_d5d4c103-141a-46dc-85b6-b4845d5dee47/copy-manifests/0.log"
Jul 20 05:50:00.971651 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:00.971623    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-676c6f859f-fw2gg_4d1c8494-c70d-46a3-843a-de6bdf2f114d/manager/0.log"
Jul 20 05:50:01.948090 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:01.948067    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bf9656866-bvrwg_8540b031-6e84-4c15-bb7c-51160870c58b/kube-auth-proxy/0.log"
Jul 20 05:50:03.430093 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:03.430064    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-bf9656866-bvrwg_8540b031-6e84-4c15-bb7c-51160870c58b/kube-auth-proxy/0.log"
Jul 20 05:50:06.093820 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:06.093784    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-vsk8f_13349402-1257-4caf-983b-e7ea09f98f08/migrator/0.log"
Jul 20 05:50:06.113169 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:06.113136    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-vsk8f_13349402-1257-4caf-983b-e7ea09f98f08/graceful-termination/0.log"
Jul 20 05:50:06.463795 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:06.463751    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-2k7vc_592e503e-97d9-4011-9821-0a4320e1048e/kube-storage-version-migrator-operator/1.log"
Jul 20 05:50:06.464601 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:06.464569    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-2k7vc_592e503e-97d9-4011-9821-0a4320e1048e/kube-storage-version-migrator-operator/0.log"
Jul 20 05:50:07.697151 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:07.697122    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvzvv_37a2fefc-0ae8-45b5-893b-6d60a8dbe178/kube-multus-additional-cni-plugins/0.log"
Jul 20 05:50:07.717312 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:07.717284    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvzvv_37a2fefc-0ae8-45b5-893b-6d60a8dbe178/egress-router-binary-copy/0.log"
Jul 20 05:50:07.736871 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:07.736846    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvzvv_37a2fefc-0ae8-45b5-893b-6d60a8dbe178/cni-plugins/0.log"
Jul 20 05:50:07.755606 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:07.755581    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvzvv_37a2fefc-0ae8-45b5-893b-6d60a8dbe178/bond-cni-plugin/0.log"
Jul 20 05:50:07.773773 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:07.773750    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvzvv_37a2fefc-0ae8-45b5-893b-6d60a8dbe178/routeoverride-cni/0.log"
Jul 20 05:50:07.792771 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:07.792749    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvzvv_37a2fefc-0ae8-45b5-893b-6d60a8dbe178/whereabouts-cni-bincopy/0.log"
Jul 20 05:50:07.812036 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:07.811998    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qvzvv_37a2fefc-0ae8-45b5-893b-6d60a8dbe178/whereabouts-cni/0.log"
Jul 20 05:50:07.880149 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:07.880112    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nrrn9_9ad5e720-6cda-450f-966e-63560e8edbfe/kube-multus/0.log"
Jul 20 05:50:08.009402 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:08.009322    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wcqzq_00052a42-6eff-4102-b46e-67ee21d241f0/network-metrics-daemon/0.log"
Jul 20 05:50:08.026445 ip-10-0-135-196 kubenswrapper[2576]: I0720 05:50:08.026423    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wcqzq_00052a42-6eff-4102-b46e-67ee21d241f0/kube-rbac-proxy/0.log"